Jul 07 16:22:53.778796 ip-10-0-136-66 systemd[1]: Starting Kubernetes Kubelet... Jul 07 16:22:54.164751 ip-10-0-136-66 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:22:54.164751 ip-10-0-136-66 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 16:22:54.164751 ip-10-0-136-66 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:22:54.164751 ip-10-0-136-66 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 16:22:54.164751 ip-10-0-136-66 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:22:54.165526 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.165422 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 16:22:54.171244 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171215 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:54.171244 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171239 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:54.171244 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171243 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:54.171244 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171246 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:54.171244 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171249 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:54.171244 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171252 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:54.171244 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171255 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:54.171244 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171257 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171260 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171264 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171266 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171270 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171272 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171275 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171278 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171280 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171283 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171285 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171288 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171292 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171294 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171297 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171299 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171302 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171304 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171307 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:54.171565 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171309 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171313 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171318 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171320 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171323 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171325 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171328 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171331 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171333 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171336 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171338 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171342 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171344 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171347 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171349 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171353 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171356 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171358 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171361 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171363 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:54.172018 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171366 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171368 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171371 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171373 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171376 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171379 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171381 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171383 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171386 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171388 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171391 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171393 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171395 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171398 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171401 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171405 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171408 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171411 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171414 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171417 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:54.172570 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171419 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171423 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171427 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171430 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171433 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171436 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171439 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171442 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171445 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171448 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171450 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171452 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171455 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171457 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171460 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171462 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171464 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171467 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171470 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:54.173060 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171474 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171476 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171479 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171481 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171483 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171486 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171488 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171490 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171493 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171495 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171497 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171500 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171526 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.171530 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172282 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172291 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172294 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172297 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172299 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:54.173531 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172302 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172306 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172309 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172312 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172315 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172318 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172320 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172323 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172326 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172329 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172331 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172334 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172337 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172339 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172342 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172344 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172346 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172349 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172351 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172353 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172356 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:54.173997 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172359 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172362 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172364 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172367 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172370 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172374 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172377 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172379 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172382 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172385 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172387 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172390 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172393 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172395 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172398 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172401 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172403 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172406 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172409 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:54.174546 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172412 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172414 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172416 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172419 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172422 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172425 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172427 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172430 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172432 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172435 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172438 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172440 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172443 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172445 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172447 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172450 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172452 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172455 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172457 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172459 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:54.175016 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172462 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172464 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172466 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172469 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172471 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172474 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172477 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172479 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172481 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172484 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172486 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172489 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172494 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172496 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172499 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172520 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172523 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172526 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172530 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:54.175529 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172533 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172536 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172538 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172540 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172545 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172548 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172551 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172553 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172556 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172558 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172561 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172563 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172565 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172568 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172570 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172979 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172985 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172987 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172993 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172996 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:54.176000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.172998 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173001 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173004 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173006 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173008 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173012 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173015 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173017 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173020 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173023 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173025 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173028 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173031 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173034 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173036 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173039 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173041 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173043 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173046 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173048 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:54.176492 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173051 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173053 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173055 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173058 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173061 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173064 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173066 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173071 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173074 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173077 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173082 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173085 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173088 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173090 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173093 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173096 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173099 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173102 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173104 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:54.177000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173107 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173110 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173112 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173115 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173118 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173121 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173123 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173125 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173128 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173131 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173133 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173135 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173138 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173140 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173143 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173145 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173147 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173149 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173152 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173154 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:54.177522 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173157 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173159 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173162 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173165 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173168 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173170 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173174 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173177 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173180 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173182 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173185 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173187 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173192 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173196 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173198 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173201 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173203 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173206 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173208 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:54.178013 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173211 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173213 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173216 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173218 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173220 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173223 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173225 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173228 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173230 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173232 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173235 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173237 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173240 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173242 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173245 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173247 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173333 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173345 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173355 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173361 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173367 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 16:22:54.178473 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173371 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173376 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173380 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173383 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173386 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173389 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173393 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173396 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173399 2562 flags.go:64] FLAG: --cgroup-root="" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173402 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173405 2562 flags.go:64] FLAG: --client-ca-file="" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173408 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173411 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173415 2562 flags.go:64] FLAG: --cluster-domain="" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173418 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173421 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173424 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173427 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173431 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173434 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173437 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173440 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173443 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173446 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 16:22:54.178995 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173449 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173452 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173455 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173461 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173463 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173466 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173469 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173472 2562 flags.go:64] FLAG: --enable-server="true" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173475 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173480 2562 flags.go:64] FLAG: --event-burst="100" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173483 2562 flags.go:64] FLAG: --event-qps="50" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173486 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173489 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173492 2562 flags.go:64] FLAG: --eviction-hard="" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173496 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173498 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173517 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173521 2562 flags.go:64] FLAG: --eviction-soft="" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173524 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173527 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173531 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173534 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173537 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173540 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173543 2562 flags.go:64] FLAG: --feature-gates="" Jul 07 16:22:54.179593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173547 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173550 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173553 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173556 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173559 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173562 2562 flags.go:64] FLAG: --help="false" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173565 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173568 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173571 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173573 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173577 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173581 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173584 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173586 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173589 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173592 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173595 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173599 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173602 2562 flags.go:64] FLAG: --kube-reserved="" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173605 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173607 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173610 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173613 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173616 2562 flags.go:64] FLAG: --lock-file="" Jul 07 16:22:54.180213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173618 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173621 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173624 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173629 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173633 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173635 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173638 2562 flags.go:64] FLAG: --logging-format="text" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173641 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173644 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173647 2562 flags.go:64] FLAG: --manifest-url="" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173649 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173654 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173656 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173660 2562 flags.go:64] FLAG: --max-pods="110" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173663 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173666 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173668 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173672 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173675 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173678 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173681 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173690 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173693 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173696 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 16:22:54.180814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173699 2562 flags.go:64] FLAG: --pod-cidr="" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173703 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173708 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173711 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173714 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173717 2562 flags.go:64] FLAG: --port="10250" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173720 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173723 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fb789dfcc4c43461" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173726 2562 flags.go:64] FLAG: --qos-reserved="" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173729 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173732 2562 flags.go:64] FLAG: --register-node="true" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173735 2562 flags.go:64] FLAG: --register-with-taints="" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173739 2562 flags.go:64] FLAG: --registry-burst="10" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173743 2562 flags.go:64] FLAG: --registry-qps="5" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173746 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173748 2562 flags.go:64] FLAG: --reserved-memory="" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173752 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173755 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173758 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173760 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173763 2562 flags.go:64] FLAG: --runonce="false" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173766 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173769 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173772 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173775 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 16:22:54.181434 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173777 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173780 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173783 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173786 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173789 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173791 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173794 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173797 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173801 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173804 2562 flags.go:64] FLAG: --system-cgroups="" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173806 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173812 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173814 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173817 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173821 2562 flags.go:64] FLAG: --tls-min-version="" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173823 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173826 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173829 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173832 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173835 2562 flags.go:64] FLAG: --v="2" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173839 2562 flags.go:64] FLAG: --version="false" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173843 2562 flags.go:64] FLAG: --vmodule="" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173847 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.173850 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.173999 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:54.182069 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174004 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174007 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174011 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174013 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174016 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174019 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174021 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174025 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174029 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174032 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174035 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174038 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174040 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174042 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174045 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174049 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174052 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174054 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174057 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:54.182714 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174061 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174064 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174067 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174070 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174072 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174075 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174077 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174080 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174082 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174085 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174088 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174090 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174093 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174096 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174098 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174102 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174105 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174107 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174110 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174113 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:54.183182 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174115 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174118 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174122 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174125 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174128 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174131 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174133 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174136 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174140 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174142 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174145 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174147 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174149 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174152 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174155 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174157 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174159 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174162 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174164 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174167 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:54.183700 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174170 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174172 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174174 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174180 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174183 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174186 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174188 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174191 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174193 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174196 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174198 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174201 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174203 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174205 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174209 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174212 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174214 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174216 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174219 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174221 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:54.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174225 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174228 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174230 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174233 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174235 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174238 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174240 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174242 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174245 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174247 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174249 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174252 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174255 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174257 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174259 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174262 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174270 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174273 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:54.184689 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.174275 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.175192 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.181921 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.181940 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.181957 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.181963 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182027 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182032 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182036 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182039 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182042 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182044 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182047 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182050 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182053 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:54.185132 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182056 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182058 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182061 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182064 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182066 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182069 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182071 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182074 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182077 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182081 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182097 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182100 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182103 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182106 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182109 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182112 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182115 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182117 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182120 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:54.185524 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182124 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182128 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182131 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182134 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182136 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182141 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182144 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182148 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182150 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182152 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182174 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182178 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182182 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182185 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182187 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182190 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182193 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182195 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182198 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182200 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:54.186093 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182203 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182205 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182208 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182210 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182213 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182217 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182220 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182223 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182226 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182229 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182232 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182235 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182237 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182240 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182244 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182247 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182249 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182252 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182254 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:54.186688 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182257 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182259 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182262 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182264 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182266 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182269 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182271 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182274 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182276 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182279 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182281 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182283 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182286 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182288 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182291 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182293 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182296 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182299 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182301 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182304 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:54.187158 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182306 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182309 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182311 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182313 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182316 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182318 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182321 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182323 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182327 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182329 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182332 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182334 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.182340 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182491 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182497 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:54.187784 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182500 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182520 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182523 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182526 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182530 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182533 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182535 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182538 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182541 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182543 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182546 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182548 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182552 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182556 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182559 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182562 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182564 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182566 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:54.188164 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182570 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182574 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182577 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182580 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182582 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182584 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182587 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182590 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182599 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182602 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182605 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182607 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182610 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182612 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182615 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182617 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182619 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182622 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182624 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182627 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:54.188619 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182629 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182631 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182634 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182636 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182639 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182641 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182643 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182646 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182648 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182651 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182653 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182656 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182658 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182661 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182664 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182666 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182669 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182671 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182673 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182676 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:54.189109 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182678 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182687 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182689 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182692 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182698 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182700 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182702 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182705 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182707 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182710 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182712 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182715 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182717 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182721 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182723 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182726 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182728 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182731 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182733 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182735 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:54.189609 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182738 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182740 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182743 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182745 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182749 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182752 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182755 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182758 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182760 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182763 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182766 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182768 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182771 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182774 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182783 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182786 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182790 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182792 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:54.190099 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:54.182794 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:54.190595 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.182799 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:22:54.190595 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.182941 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 16:22:54.190595 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.185648 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 16:22:54.190595 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.186919 2562 server.go:1019] "Starting client certificate rotation" Jul 07 16:22:54.190595 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.187034 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:22:54.190595 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.187068 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:22:54.190595 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.189824 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:22:54.191579 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.191484 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:22:54.206752 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.206669 2562 log.go:25] "Validated CRI v1 runtime API" Jul 07 16:22:54.210874 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.210853 2562 log.go:25] "Validated CRI v1 image API" Jul 07 16:22:54.211768 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.211737 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 16:22:54.214447 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.214425 2562 fs.go:135] Filesystem UUIDs: map[33163b1d-3f66-4236-9cf4-fc14da28dc75:/dev/nvme0n1p4 531beca8-5a03-4518-bb40-2e7193c7ecc2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 16:22:54.214565 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.214445 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 16:22:54.220784 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.220655 2562 manager.go:216] Machine: {Timestamp:2026-07-07 16:22:54.219366505 +0000 UTC m=+0.328703181 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111761 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec214c5c819ea60cbaef330dded69028 SystemUUID:ec214c5c-819e-a60c-baef-330dded69028 BootID:711a2667-b2f6-40a2-9881-9ec07ca1af8d Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1b:d1:0b:8f:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1b:d1:0b:8f:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:63:0f:68:94:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 16:22:54.220784 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.220770 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 16:22:54.220941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.220855 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 16:22:54.221377 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.221356 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:22:54.223714 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.223679 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 16:22:54.223859 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.223717 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-66.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 16:22:54.224702 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.224690 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 16:22:54.224743 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.224704 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 16:22:54.224743 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.224711 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:22:54.225329 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.225318 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:22:54.226911 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.226898 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 16:22:54.229840 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.229826 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:22:54.229990 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.229979 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 16:22:54.230022 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.230014 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 07 16:22:54.230059 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.230029 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 16:22:54.230059 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.230044 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 16:22:54.230059 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.230054 2562 kubelet.go:398] "Adding apiserver pod source" Jul 07 16:22:54.230144 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.230064 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 16:22:54.230454 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.230441 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:22:54.230527 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.230462 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:22:54.232768 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.232752 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 16:22:54.234793 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.234780 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 16:22:54.234838 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.234809 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 16:22:54.235793 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235782 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 16:22:54.235840 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235798 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 16:22:54.235840 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235804 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 16:22:54.235840 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235809 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 16:22:54.235840 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235817 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 16:22:54.235840 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235822 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 16:22:54.235840 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235830 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 16:22:54.235840 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235835 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 16:22:54.235840 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235842 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 16:22:54.236045 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235847 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 16:22:54.236045 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235856 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 16:22:54.236045 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.235861 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 16:22:54.236617 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.236603 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 16:22:54.236678 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.236620 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 16:22:54.239871 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.239855 2562 server.go:1268] "Started kubelet" Jul 07 16:22:54.239969 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.239947 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 16:22:54.240104 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.240036 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 16:22:54.240187 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.240171 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 16:22:54.240812 ip-10-0-136-66 systemd[1]: Started Kubernetes Kubelet. Jul 07 16:22:54.241085 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.241026 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 16:22:54.241165 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.240986 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-66.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 16:22:54.241215 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.241169 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 16:22:54.241911 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.241791 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 16:22:54.243293 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.243271 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 07 16:22:54.245613 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.245591 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 16:22:54.245724 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.244621 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-66.ec2.internal.18c00e7b154c998d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-66.ec2.internal,UID:ip-10-0-136-66.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-66.ec2.internal,},FirstTimestamp:2026-07-07 16:22:54.239824269 +0000 UTC m=+0.349160946,LastTimestamp:2026-07-07 16:22:54.239824269 +0000 UTC m=+0.349160946,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-66.ec2.internal,}" Jul 07 16:22:54.248376 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.248359 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sxf4q" Jul 07 16:22:54.249096 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.249077 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 16:22:54.249096 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.249091 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 16:22:54.249256 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.249227 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:54.250064 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.249941 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 16:22:54.250160 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.250082 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 16:22:54.250260 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.250248 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 07 16:22:54.250260 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.250261 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 07 16:22:54.250357 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.250272 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 16:22:54.251725 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.251481 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 16:22:54.252071 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.252056 2562 factory.go:55] Registering systemd factory Jul 07 16:22:54.252155 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.252140 2562 factory.go:223] Registration of the systemd container factory successfully Jul 07 16:22:54.252470 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.252437 2562 factory.go:153] Registering CRI-O factory Jul 07 16:22:54.252470 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.252458 2562 factory.go:223] Registration of the crio container factory successfully Jul 07 16:22:54.252605 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.252561 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 16:22:54.252605 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.252583 2562 factory.go:103] Registering Raw factory Jul 07 16:22:54.252605 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.252597 2562 manager.go:1196] Started watching for new ooms in manager Jul 07 16:22:54.253368 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.253351 2562 manager.go:349] Starting recovery of all containers Jul 07 16:22:54.256903 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.256879 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sxf4q" Jul 07 16:22:54.260356 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.260328 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 16:22:54.262295 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.262275 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:54.266268 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.266137 2562 manager.go:354] Recovery completed Jul 07 16:22:54.270604 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.270590 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:54.273602 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.273585 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:54.273680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.273618 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:54.273680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.273636 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:54.274195 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.274181 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 16:22:54.274195 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.274192 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 16:22:54.274327 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.274184 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:54.274327 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.274213 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:22:54.274977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.274959 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:54.275022 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.274991 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:54.275022 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.275002 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:54.275580 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.275569 2562 policy_none.go:49] "None policy: Start" Jul 07 16:22:54.275657 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.275586 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 16:22:54.275657 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.275597 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 16:22:54.276567 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.276557 2562 policy_none.go:47] "Start" Jul 07 16:22:54.311163 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.311144 2562 manager.go:337] "Starting Device Plugin manager" Jul 07 16:22:54.311276 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.311178 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 16:22:54.311276 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.311189 2562 server.go:87] "Starting device plugin registration server" Jul 07 16:22:54.311473 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.311460 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 16:22:54.311566 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.311475 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 16:22:54.311664 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.311642 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 16:22:54.311786 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.311733 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 16:22:54.311786 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.311748 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 16:22:54.312256 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.312239 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 16:22:54.312340 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.312291 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:54.411766 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.411733 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:54.412885 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.412774 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:54.412885 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.412811 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:54.412885 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.412826 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:54.412885 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.412878 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.418911 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.418849 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.418911 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.418876 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-66.ec2.internal\": node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:54.431525 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.431480 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:54.457097 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.457067 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 16:22:54.457214 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.457119 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 16:22:54.457214 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.457151 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 16:22:54.457214 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.457192 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 16:22:54.459175 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.459151 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:54.532526 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.532448 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:54.557959 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.557915 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal"] Jul 07 16:22:54.558025 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.558005 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:54.559159 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.559142 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:54.559253 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.559176 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:54.559253 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.559186 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:54.560519 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.560488 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:54.560664 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.560649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.560723 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.560685 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:54.561546 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.561533 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:54.561614 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.561541 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:54.561614 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.561562 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:54.561614 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.561566 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:54.561614 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.561573 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:54.561614 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.561580 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:54.562857 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.562838 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.562921 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.562873 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:54.563734 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.563715 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:54.563838 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.563743 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:54.563838 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.563753 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:54.591568 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.591542 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-66.ec2.internal\" not found" node="ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.596308 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.596287 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-66.ec2.internal\" not found" node="ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.633555 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.633528 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:54.652395 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.652359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1928947df3c239c9c706211bc208097d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"1928947df3c239c9c706211bc208097d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.652464 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.652400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/062671a5da55ed99bbda883c048796b7-config\") pod \"kube-apiserver-proxy-ip-10-0-136-66.ec2.internal\" (UID: \"062671a5da55ed99bbda883c048796b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.652464 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.652426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1928947df3c239c9c706211bc208097d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"1928947df3c239c9c706211bc208097d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.733857 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.733792 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:54.753254 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.753222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1928947df3c239c9c706211bc208097d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"1928947df3c239c9c706211bc208097d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.753319 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.753258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1928947df3c239c9c706211bc208097d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"1928947df3c239c9c706211bc208097d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.753319 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.753282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/062671a5da55ed99bbda883c048796b7-config\") pod \"kube-apiserver-proxy-ip-10-0-136-66.ec2.internal\" (UID: \"062671a5da55ed99bbda883c048796b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.753376 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.753339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/062671a5da55ed99bbda883c048796b7-config\") pod \"kube-apiserver-proxy-ip-10-0-136-66.ec2.internal\" (UID: \"062671a5da55ed99bbda883c048796b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.753376 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.753340 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1928947df3c239c9c706211bc208097d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"1928947df3c239c9c706211bc208097d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.753376 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.753347 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1928947df3c239c9c706211bc208097d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"1928947df3c239c9c706211bc208097d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.834410 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.834366 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:54.894947 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.894920 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.899829 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:54.899811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" Jul 07 16:22:54.935447 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:54.935416 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:55.036068 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:55.035977 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:55.136581 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:55.136553 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:55.187089 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.187064 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 16:22:55.187645 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.187221 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:22:55.187645 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.187264 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:22:55.209917 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.209883 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:55.237576 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:55.237545 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:55.259457 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.259425 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:17:55 +0000 UTC" deadline="2028-02-01 20:40:17.201243136 +0000 UTC" Jul 07 16:22:55.259457 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.259455 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13780h17m21.94179273s" Jul 07 16:22:55.338991 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:55.338884 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found" Jul 07 16:22:55.345856 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.345834 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:55.350555 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.350537 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" Jul 07 16:22:55.364207 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.364187 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:22:55.365101 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.365088 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" Jul 07 16:22:55.376155 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.376135 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:22:55.668171 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:55.668131 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062671a5da55ed99bbda883c048796b7.slice/crio-b6a66fd826b6d28221f0b6f06dfaa72ce5996be38ed8a882f0a2c7b9672c53c7 WatchSource:0}: Error finding container b6a66fd826b6d28221f0b6f06dfaa72ce5996be38ed8a882f0a2c7b9672c53c7: Status 404 returned error can't find the container with id b6a66fd826b6d28221f0b6f06dfaa72ce5996be38ed8a882f0a2c7b9672c53c7 Jul 07 16:22:55.668484 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:55.668462 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1928947df3c239c9c706211bc208097d.slice/crio-e36ae1970935daf658e9536e09537f51ef791a67ad450ebfd29d55226a6ece35 WatchSource:0}: Error finding container e36ae1970935daf658e9536e09537f51ef791a67ad450ebfd29d55226a6ece35: Status 404 returned error can't find the container with id e36ae1970935daf658e9536e09537f51ef791a67ad450ebfd29d55226a6ece35 Jul 07 16:22:55.676313 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:55.676296 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:22:56.230665 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.230629 2562 apiserver.go:52] "Watching apiserver" Jul 07 16:22:56.243262 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.243223 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 16:22:56.243749 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.243721 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal","openshift-image-registry/node-ca-4tsqd","openshift-multus/multus-additional-cni-plugins-bb5dp","openshift-network-operator/iptables-alerter-skct2","openshift-ovn-kubernetes/ovnkube-node-sbfrs","kube-system/global-pull-secret-syncer-dlvbc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784","openshift-cluster-node-tuning-operator/tuned-7zxmg","openshift-dns/node-resolver-dsnpp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal","openshift-multus/multus-2c2cd","openshift-multus/network-metrics-daemon-ppxgj","openshift-network-diagnostics/network-check-target-bzt2h","kube-system/konnectivity-agent-fgwb9"] Jul 07 16:22:56.246006 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.245976 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.247288 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.247256 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:22:56.247397 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.247332 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:22:56.248546 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.248505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.250189 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.249691 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 16:22:56.250189 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.249804 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.250189 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.249962 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 16:22:56.250397 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.250341 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 16:22:56.250456 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.250420 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9qkpw\"" Jul 07 16:22:56.250591 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.250552 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 16:22:56.252705 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.251623 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-49ccj\"" Jul 07 16:22:56.252705 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.251919 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.252705 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.252408 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 16:22:56.253066 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.253045 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 16:22:56.253153 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.253068 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 16:22:56.253762 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.253469 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.253762 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.253570 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:22:56.254528 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.254503 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:22:56.254882 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.254863 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 16:22:56.255022 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.255001 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 16:22:56.256648 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.255373 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hdb49\"" Jul 07 16:22:56.256648 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.255412 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 16:22:56.256648 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.255697 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 16:22:56.256648 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.255840 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.256648 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.256417 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 16:22:56.257684 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.257661 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 16:22:56.257879 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.257856 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 16:22:56.263216 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.263195 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 16:22:56.263319 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.263304 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-psp69\"" Jul 07 16:22:56.263384 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.263355 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 16:22:56.263470 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.263452 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 16:22:56.263650 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.263629 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:56.263776 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.263714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:22:56.263844 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.263786 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 16:22:56.263905 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.263854 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 16:22:56.264121 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264104 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v6dc2\"" Jul 07 16:22:56.264341 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-slash\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264401 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-run-ovn\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264401 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-log-socket\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264497 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h88c7\" (UniqueName: \"kubernetes.io/projected/df53ac47-e829-4404-83cf-2d5db8a8398a-kube-api-access-h88c7\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264497 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-os-release\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.264497 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-var-lib-openvswitch\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-etc-openvswitch\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264514 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-sys-fs\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.264673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.264673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264572 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gflrr\" (UniqueName: \"kubernetes.io/projected/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-kube-api-access-gflrr\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.264673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-kubelet\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df53ac47-e829-4404-83cf-2d5db8a8398a-ovn-node-metrics-cert\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-device-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.264977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97e5480e-a79a-4591-8d41-b828380b0d0c-iptables-alerter-script\") pod \"iptables-alerter-skct2\" (UID: \"97e5480e-a79a-4591-8d41-b828380b0d0c\") " pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.264977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97e5480e-a79a-4591-8d41-b828380b0d0c-host-slash\") pod \"iptables-alerter-skct2\" (UID: \"97e5480e-a79a-4591-8d41-b828380b0d0c\") " pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.264977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.264977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.264977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-run-systemd\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-node-log\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.264977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.264973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df53ac47-e829-4404-83cf-2d5db8a8398a-env-overrides\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df53ac47-e829-4404-83cf-2d5db8a8398a-ovnkube-script-lib\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-registration-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-cnibin\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nllkp\" (UniqueName: \"kubernetes.io/projected/97e5480e-a79a-4591-8d41-b828380b0d0c-kube-api-access-nllkp\") pod \"iptables-alerter-skct2\" (UID: \"97e5480e-a79a-4591-8d41-b828380b0d0c\") " pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-cni-bin\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-cni-netd\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfvtw\" (UniqueName: \"kubernetes.io/projected/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-kube-api-access-bfvtw\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.265312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265316 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-run-netns\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.265862 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df53ac47-e829-4404-83cf-2d5db8a8398a-ovnkube-config\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.265862 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:22:56.265862 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-system-cni-dir\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.265862 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265417 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-systemd-units\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.265862 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265442 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-run-openvswitch\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.265862 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-run-ovn-kubernetes\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.265862 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-socket-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.265862 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.265625 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.267225 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.267204 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.268801 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.268761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.269525 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.269510 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 16:22:56.269779 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.269759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 16:22:56.270375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.270327 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:22:56.270452 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.270423 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:22:56.271034 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.270669 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 16:22:56.271034 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.270753 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gf4wd\"" Jul 07 16:22:56.271034 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.270830 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:22:56.271034 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.271017 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-56r5l\"" Jul 07 16:22:56.271328 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.271248 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 16:22:56.272375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.272354 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 16:22:56.272463 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.272435 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8s7hp\"" Jul 07 16:22:56.272598 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.272575 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cnsb9\"" Jul 07 16:22:56.273022 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.272996 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 16:22:56.273118 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.273054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 16:22:56.278419 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.278347 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:22:56.298341 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.298320 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tht9h" Jul 07 16:22:56.308204 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.308176 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tht9h" Jul 07 16:22:56.352087 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.352060 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 16:22:56.366363 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.366544 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-node-log\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.366544 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.366544 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-registration-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.366544 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-etc-kubernetes\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.366544 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-tuned\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.366544 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nllkp\" (UniqueName: \"kubernetes.io/projected/97e5480e-a79a-4591-8d41-b828380b0d0c-kube-api-access-nllkp\") pod \"iptables-alerter-skct2\" (UID: \"97e5480e-a79a-4591-8d41-b828380b0d0c\") " pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fa469eb-0e51-449b-94fe-9f30c399c3ad-cni-binary-copy\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-conf-dir\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngg82\" (UniqueName: \"kubernetes.io/projected/00a7e93d-aa93-43ec-b668-9ad7eb86de77-kube-api-access-ngg82\") pod \"node-ca-4tsqd\" (UID: \"00a7e93d-aa93-43ec-b668-9ad7eb86de77\") " pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-var-lib-cni-multus\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb9bn\" (UniqueName: \"kubernetes.io/projected/f4afb73f-78a1-4453-bf2f-880c9eba98a7-kube-api-access-qb9bn\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-system-cni-dir\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-systemd-units\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-socket-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.366892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.366889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-var-lib-kubelet\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.369933 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.369892 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.370540 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.370512 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.370964 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.370709 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-system-cni-dir\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.370964 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.370771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-systemd-units\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.370964 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.370877 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-socket-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.370964 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.370923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00a7e93d-aa93-43ec-b668-9ad7eb86de77-serviceca\") pod \"node-ca-4tsqd\" (UID: \"00a7e93d-aa93-43ec-b668-9ad7eb86de77\") " pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.370964 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.370963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-run-ovn\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.370993 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-log-socket\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-cni-dir\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-socket-dir-parent\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-run-k8s-cni-cncf-io\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-lib-modules\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-os-release\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-etc-openvswitch\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-sys-fs\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-kubernetes\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.371278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df53ac47-e829-4404-83cf-2d5db8a8398a-ovn-node-metrics-cert\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-run-multus-certs\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-modprobe-d\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97e5480e-a79a-4591-8d41-b828380b0d0c-iptables-alerter-script\") pod \"iptables-alerter-skct2\" (UID: \"97e5480e-a79a-4591-8d41-b828380b0d0c\") " pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97e5480e-a79a-4591-8d41-b828380b0d0c-host-slash\") pod \"iptables-alerter-skct2\" (UID: \"97e5480e-a79a-4591-8d41-b828380b0d0c\") " pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-os-release\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371535 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-daemon-config\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-run\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzk4k\" (UniqueName: \"kubernetes.io/projected/d6557e80-b889-4203-b5cd-4b3f1aa3082e-kube-api-access-gzk4k\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-run-systemd\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df53ac47-e829-4404-83cf-2d5db8a8398a-env-overrides\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df53ac47-e829-4404-83cf-2d5db8a8398a-ovnkube-script-lib\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.371767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-hostroot\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-cnibin\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-cni-bin\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-cni-netd\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfvtw\" (UniqueName: \"kubernetes.io/projected/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-kube-api-access-bfvtw\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4-tmp-dir\") pod \"node-resolver-dsnpp\" (UID: \"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4\") " pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.371971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-system-cni-dir\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54c8\" (UniqueName: \"kubernetes.io/projected/2fa469eb-0e51-449b-94fe-9f30c399c3ad-kube-api-access-z54c8\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-run-netns\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df53ac47-e829-4404-83cf-2d5db8a8398a-ovnkube-config\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w6xc\" (UniqueName: \"kubernetes.io/projected/d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4-kube-api-access-9w6xc\") pod \"node-resolver-dsnpp\" (UID: \"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4\") " pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-sysctl-conf\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4afb73f-78a1-4453-bf2f-880c9eba98a7-tmp\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-run-openvswitch\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-run-ovn-kubernetes\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.372415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4-hosts-file\") pod \"node-resolver-dsnpp\" (UID: \"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4\") " pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b1e4307-5b1e-415f-a948-910797770d3e-konnectivity-ca\") pod \"konnectivity-agent-fgwb9\" (UID: \"8b1e4307-5b1e-415f-a948-910797770d3e\") " pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-systemd\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-sys\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-slash\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h88c7\" (UniqueName: \"kubernetes.io/projected/df53ac47-e829-4404-83cf-2d5db8a8398a-kube-api-access-h88c7\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b1e4307-5b1e-415f-a948-910797770d3e-agent-certs\") pod \"konnectivity-agent-fgwb9\" (UID: \"8b1e4307-5b1e-415f-a948-910797770d3e\") " pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-cnibin\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-run-netns\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-var-lib-openvswitch\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-sysconfig\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-sysctl-d\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-var-lib-kubelet\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gflrr\" (UniqueName: \"kubernetes.io/projected/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-kube-api-access-gflrr\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.372981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-kubelet\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.373226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-device-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-var-lib-cni-bin\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00a7e93d-aa93-43ec-b668-9ad7eb86de77-host\") pod \"node-ca-4tsqd\" (UID: \"00a7e93d-aa93-43ec-b668-9ad7eb86de77\") " pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-host\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-kubelet-config\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-dbus\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373493 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-run-ovn\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373546 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-log-socket\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-os-release\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-etc-openvswitch\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.374051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.373805 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-sys-fs\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.374548 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.374353 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.374813 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.374785 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.376467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-var-lib-openvswitch\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.376491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-registration-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.376620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-device-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.376710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-run-systemd\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df53ac47-e829-4404-83cf-2d5db8a8398a-env-overrides\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377539 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df53ac47-e829-4404-83cf-2d5db8a8398a-ovnkube-config\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377699 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377768 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-node-log\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97e5480e-a79a-4591-8d41-b828380b0d0c-host-slash\") pod \"iptables-alerter-skct2\" (UID: \"97e5480e-a79a-4591-8d41-b828380b0d0c\") " pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377859 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-cni-netd\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-slash\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-cnibin\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.377929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-run-ovn-kubernetes\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.378134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-cni-bin\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.378492 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.378193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-run-openvswitch\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.379299 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.378243 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-kubelet\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.379299 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.378286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df53ac47-e829-4404-83cf-2d5db8a8398a-ovnkube-script-lib\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.379299 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.378346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.379299 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.378363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97e5480e-a79a-4591-8d41-b828380b0d0c-iptables-alerter-script\") pod \"iptables-alerter-skct2\" (UID: \"97e5480e-a79a-4591-8d41-b828380b0d0c\") " pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.379677 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.379616 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df53ac47-e829-4404-83cf-2d5db8a8398a-host-run-netns\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.380718 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.380116 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df53ac47-e829-4404-83cf-2d5db8a8398a-ovn-node-metrics-cert\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.395568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.395436 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h88c7\" (UniqueName: \"kubernetes.io/projected/df53ac47-e829-4404-83cf-2d5db8a8398a-kube-api-access-h88c7\") pod \"ovnkube-node-sbfrs\" (UID: \"df53ac47-e829-4404-83cf-2d5db8a8398a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.395737 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.395580 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:22:56.395737 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.395624 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:22:56.395737 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.395641 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbgwq for pod openshift-network-diagnostics/network-check-target-bzt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:56.395737 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.395720 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq podName:b4b914ad-0839-4c7a-81ef-43f4ed47b815 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:56.895697064 +0000 UTC m=+3.005033750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rbgwq" (UniqueName: "kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq") pod "network-check-target-bzt2h" (UID: "b4b914ad-0839-4c7a-81ef-43f4ed47b815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:56.396980 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.396953 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfvtw\" (UniqueName: \"kubernetes.io/projected/16b79f0f-7cb0-4de4-8a78-081f8560ccd4-kube-api-access-bfvtw\") pod \"aws-ebs-csi-driver-node-hz784\" (UID: \"16b79f0f-7cb0-4de4-8a78-081f8560ccd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.397460 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.397409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gflrr\" (UniqueName: \"kubernetes.io/projected/3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8-kube-api-access-gflrr\") pod \"multus-additional-cni-plugins-bb5dp\" (UID: \"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8\") " pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.399279 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.399257 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nllkp\" (UniqueName: \"kubernetes.io/projected/97e5480e-a79a-4591-8d41-b828380b0d0c-kube-api-access-nllkp\") pod \"iptables-alerter-skct2\" (UID: \"97e5480e-a79a-4591-8d41-b828380b0d0c\") " pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.462704 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.462644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" event={"ID":"062671a5da55ed99bbda883c048796b7","Type":"ContainerStarted","Data":"b6a66fd826b6d28221f0b6f06dfaa72ce5996be38ed8a882f0a2c7b9672c53c7"} Jul 07 16:22:56.464858 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.464822 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" event={"ID":"1928947df3c239c9c706211bc208097d","Type":"ContainerStarted","Data":"e36ae1970935daf658e9536e09537f51ef791a67ad450ebfd29d55226a6ece35"} Jul 07 16:22:56.473693 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-os-release\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.473857 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-daemon-config\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.473857 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-run\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.473857 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzk4k\" (UniqueName: \"kubernetes.io/projected/d6557e80-b889-4203-b5cd-4b3f1aa3082e-kube-api-access-gzk4k\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:22:56.473857 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-hostroot\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.473857 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4-tmp-dir\") pod \"node-resolver-dsnpp\" (UID: \"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4\") " pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.473857 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-system-cni-dir\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.473857 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z54c8\" (UniqueName: \"kubernetes.io/projected/2fa469eb-0e51-449b-94fe-9f30c399c3ad-kube-api-access-z54c8\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w6xc\" (UniqueName: \"kubernetes.io/projected/d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4-kube-api-access-9w6xc\") pod \"node-resolver-dsnpp\" (UID: \"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4\") " pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473924 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-sysctl-conf\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4afb73f-78a1-4453-bf2f-880c9eba98a7-tmp\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.473980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4-hosts-file\") pod \"node-resolver-dsnpp\" (UID: \"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4\") " pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b1e4307-5b1e-415f-a948-910797770d3e-konnectivity-ca\") pod \"konnectivity-agent-fgwb9\" (UID: \"8b1e4307-5b1e-415f-a948-910797770d3e\") " pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-systemd\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-sys\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474108 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b1e4307-5b1e-415f-a948-910797770d3e-agent-certs\") pod \"konnectivity-agent-fgwb9\" (UID: \"8b1e4307-5b1e-415f-a948-910797770d3e\") " pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-cnibin\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-run-netns\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.474220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-sysconfig\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-sysctl-d\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-var-lib-kubelet\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-var-lib-cni-bin\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00a7e93d-aa93-43ec-b668-9ad7eb86de77-host\") pod \"node-ca-4tsqd\" (UID: \"00a7e93d-aa93-43ec-b668-9ad7eb86de77\") " pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474389 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-host\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-kubelet-config\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-dbus\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-etc-kubernetes\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-tuned\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fa469eb-0e51-449b-94fe-9f30c399c3ad-cni-binary-copy\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-conf-dir\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngg82\" (UniqueName: \"kubernetes.io/projected/00a7e93d-aa93-43ec-b668-9ad7eb86de77-kube-api-access-ngg82\") pod \"node-ca-4tsqd\" (UID: \"00a7e93d-aa93-43ec-b668-9ad7eb86de77\") " pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-var-lib-cni-multus\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb9bn\" (UniqueName: \"kubernetes.io/projected/f4afb73f-78a1-4453-bf2f-880c9eba98a7-kube-api-access-qb9bn\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-var-lib-kubelet\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00a7e93d-aa93-43ec-b668-9ad7eb86de77-serviceca\") pod \"node-ca-4tsqd\" (UID: \"00a7e93d-aa93-43ec-b668-9ad7eb86de77\") " pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.474853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-cni-dir\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.475794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-socket-dir-parent\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.475794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-run-k8s-cni-cncf-io\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.475794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474840 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-lib-modules\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.475794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474869 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-kubernetes\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.475794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-run-multus-certs\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.475794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.474926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-modprobe-d\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.475794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.475096 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-modprobe-d\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.475794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.475175 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-os-release\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.476179 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.475816 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-daemon-config\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.476179 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.475901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-run\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.476299 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.476188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-hostroot\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.476501 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.476474 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4-tmp-dir\") pod \"node-resolver-dsnpp\" (UID: \"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4\") " pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.476651 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.476574 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-system-cni-dir\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.477101 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477079 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-sysctl-conf\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477472 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-kubelet-config\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-run-netns\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477563 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-sysconfig\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.477611 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.477687 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret podName:9c1363b6-9067-4e74-b135-c8eb7e04b5c3 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:56.977669126 +0000 UTC m=+3.087005819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret") pod "global-pull-secret-syncer-dlvbc" (UID: "9c1363b6-9067-4e74-b135-c8eb7e04b5c3") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-sysctl-d\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477733 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-var-lib-kubelet\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-var-lib-cni-bin\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477861 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00a7e93d-aa93-43ec-b668-9ad7eb86de77-host\") pod \"node-ca-4tsqd\" (UID: \"00a7e93d-aa93-43ec-b668-9ad7eb86de77\") " pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477893 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4-hosts-file\") pod \"node-resolver-dsnpp\" (UID: \"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4\") " pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.477907 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-host\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.477983 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.478030 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs podName:d6557e80-b889-4203-b5cd-4b3f1aa3082e nodeName:}" failed. No retries permitted until 2026-07-07 16:22:56.978014476 +0000 UTC m=+3.087351145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs") pod "network-metrics-daemon-ppxgj" (UID: "d6557e80-b889-4203-b5cd-4b3f1aa3082e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.478073 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-systemd\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.478118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-sys\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.478185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-cnibin\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.478782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.478398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b1e4307-5b1e-415f-a948-910797770d3e-konnectivity-ca\") pod \"konnectivity-agent-fgwb9\" (UID: \"8b1e4307-5b1e-415f-a948-910797770d3e\") " pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:22:56.479728 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.478894 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fa469eb-0e51-449b-94fe-9f30c399c3ad-cni-binary-copy\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.479728 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479016 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-dbus\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.479728 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479062 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-etc-kubernetes\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.479728 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-conf-dir\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.479728 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479332 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-var-lib-cni-multus\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.479728 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-socket-dir-parent\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.479728 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479442 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-var-lib-kubelet\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.479728 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-multus-cni-dir\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.479728 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-lib-modules\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.480225 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479724 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-run-k8s-cni-cncf-io\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.480225 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479780 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fa469eb-0e51-449b-94fe-9f30c399c3ad-host-run-multus-certs\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.480225 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-kubernetes\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.480225 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.479877 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00a7e93d-aa93-43ec-b668-9ad7eb86de77-serviceca\") pod \"node-ca-4tsqd\" (UID: \"00a7e93d-aa93-43ec-b668-9ad7eb86de77\") " pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.481112 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.481060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4afb73f-78a1-4453-bf2f-880c9eba98a7-tmp\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.482081 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.481615 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f4afb73f-78a1-4453-bf2f-880c9eba98a7-etc-tuned\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.482757 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.482738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b1e4307-5b1e-415f-a948-910797770d3e-agent-certs\") pod \"konnectivity-agent-fgwb9\" (UID: \"8b1e4307-5b1e-415f-a948-910797770d3e\") " pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:22:56.490440 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.490415 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w6xc\" (UniqueName: \"kubernetes.io/projected/d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4-kube-api-access-9w6xc\") pod \"node-resolver-dsnpp\" (UID: \"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4\") " pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.492378 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.492352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngg82\" (UniqueName: \"kubernetes.io/projected/00a7e93d-aa93-43ec-b668-9ad7eb86de77-kube-api-access-ngg82\") pod \"node-ca-4tsqd\" (UID: \"00a7e93d-aa93-43ec-b668-9ad7eb86de77\") " pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.493013 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.492959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb9bn\" (UniqueName: \"kubernetes.io/projected/f4afb73f-78a1-4453-bf2f-880c9eba98a7-kube-api-access-qb9bn\") pod \"tuned-7zxmg\" (UID: \"f4afb73f-78a1-4453-bf2f-880c9eba98a7\") " pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.494078 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.494047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzk4k\" (UniqueName: \"kubernetes.io/projected/d6557e80-b889-4203-b5cd-4b3f1aa3082e-kube-api-access-gzk4k\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:22:56.494401 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.494357 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54c8\" (UniqueName: \"kubernetes.io/projected/2fa469eb-0e51-449b-94fe-9f30c399c3ad-kube-api-access-z54c8\") pod \"multus-2c2cd\" (UID: \"2fa469eb-0e51-449b-94fe-9f30c399c3ad\") " pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.523944 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.523909 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:56.567351 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.567316 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" Jul 07 16:22:56.574779 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.574756 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" Jul 07 16:22:56.578030 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:56.577998 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b79f0f_7cb0_4de4_8a78_081f8560ccd4.slice/crio-613c09ef9f730b228641ea989382b1e2498d508dad5b639cb106eb9a1cc3d9b2 WatchSource:0}: Error finding container 613c09ef9f730b228641ea989382b1e2498d508dad5b639cb106eb9a1cc3d9b2: Status 404 returned error can't find the container with id 613c09ef9f730b228641ea989382b1e2498d508dad5b639cb106eb9a1cc3d9b2 Jul 07 16:22:56.584585 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.584561 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-skct2" Jul 07 16:22:56.584820 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:56.584748 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea2f89e_d6d9_4457_8d4c_a84d2b6b78d8.slice/crio-e336322c1158ec13a994d2e2356be7d8442162555be2fca0ce51243138545cb9 WatchSource:0}: Error finding container e336322c1158ec13a994d2e2356be7d8442162555be2fca0ce51243138545cb9: Status 404 returned error can't find the container with id e336322c1158ec13a994d2e2356be7d8442162555be2fca0ce51243138545cb9 Jul 07 16:22:56.591028 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.591006 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:22:56.594724 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:56.594692 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e5480e_a79a_4591_8d41_b828380b0d0c.slice/crio-15cae117b6eb87a1b4ae8e4e3c9c54ed990f791e54f095e1a923ed05e9bc1a8b WatchSource:0}: Error finding container 15cae117b6eb87a1b4ae8e4e3c9c54ed990f791e54f095e1a923ed05e9bc1a8b: Status 404 returned error can't find the container with id 15cae117b6eb87a1b4ae8e4e3c9c54ed990f791e54f095e1a923ed05e9bc1a8b Jul 07 16:22:56.597420 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.597372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dsnpp" Jul 07 16:22:56.602022 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:56.601995 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf53ac47_e829_4404_83cf_2d5db8a8398a.slice/crio-613006365f38721a5d8876d661954cd6c1461c0f0fc328981ccfb0f688d15282 WatchSource:0}: Error finding container 613006365f38721a5d8876d661954cd6c1461c0f0fc328981ccfb0f688d15282: Status 404 returned error can't find the container with id 613006365f38721a5d8876d661954cd6c1461c0f0fc328981ccfb0f688d15282 Jul 07 16:22:56.604355 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.604321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:22:56.609319 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:56.609292 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ee3b92_41a3_45c2_9e87_f1c5847d5cd4.slice/crio-9fcf6aa83a31496f2e0fff433cdd6b4a921caaeee32e3a39d8cf5d3457ec4ba3 WatchSource:0}: Error finding container 9fcf6aa83a31496f2e0fff433cdd6b4a921caaeee32e3a39d8cf5d3457ec4ba3: Status 404 returned error can't find the container with id 9fcf6aa83a31496f2e0fff433cdd6b4a921caaeee32e3a39d8cf5d3457ec4ba3 Jul 07 16:22:56.613399 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.613300 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4tsqd" Jul 07 16:22:56.614626 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:56.614570 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1e4307_5b1e_415f_a948_910797770d3e.slice/crio-a5834b0ed94a1349d98668c5df3c0c349aa98a92550f1bd1c395a611c099f6eb WatchSource:0}: Error finding container a5834b0ed94a1349d98668c5df3c0c349aa98a92550f1bd1c395a611c099f6eb: Status 404 returned error can't find the container with id a5834b0ed94a1349d98668c5df3c0c349aa98a92550f1bd1c395a611c099f6eb Jul 07 16:22:56.620997 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.620970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" Jul 07 16:22:56.623085 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:56.623061 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a7e93d_aa93_43ec_b668_9ad7eb86de77.slice/crio-baf6b63d648f721d4f5b1b5e2658dd50c6523d1b8df07473d65c79c38b2c8a13 WatchSource:0}: Error finding container baf6b63d648f721d4f5b1b5e2658dd50c6523d1b8df07473d65c79c38b2c8a13: Status 404 returned error can't find the container with id baf6b63d648f721d4f5b1b5e2658dd50c6523d1b8df07473d65c79c38b2c8a13 Jul 07 16:22:56.630377 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.630353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2c2cd" Jul 07 16:22:56.631650 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:56.631623 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4afb73f_78a1_4453_bf2f_880c9eba98a7.slice/crio-2825923edc878e6a7da9ea636dba853842bc9df9dd1b7646dde1f3a621fa8efa WatchSource:0}: Error finding container 2825923edc878e6a7da9ea636dba853842bc9df9dd1b7646dde1f3a621fa8efa: Status 404 returned error can't find the container with id 2825923edc878e6a7da9ea636dba853842bc9df9dd1b7646dde1f3a621fa8efa Jul 07 16:22:56.641206 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:22:56.641177 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa469eb_0e51_449b_94fe_9f30c399c3ad.slice/crio-b58a600e02ff76a9e4ad2b79a14f92c827fcce5e242dd03d46ed090fac38da18 WatchSource:0}: Error finding container b58a600e02ff76a9e4ad2b79a14f92c827fcce5e242dd03d46ed090fac38da18: Status 404 returned error can't find the container with id b58a600e02ff76a9e4ad2b79a14f92c827fcce5e242dd03d46ed090fac38da18 Jul 07 16:22:56.980040 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.980004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:22:56.980247 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.980062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:22:56.980247 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.980184 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:56.980247 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.980215 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:22:56.980247 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.980249 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:22:56.980468 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.980263 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbgwq for pod openshift-network-diagnostics/network-check-target-bzt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:56.980468 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.980301 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:56.980468 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:56.980219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:56.980468 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.980250 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs podName:d6557e80-b889-4203-b5cd-4b3f1aa3082e nodeName:}" failed. No retries permitted until 2026-07-07 16:22:57.980229787 +0000 UTC m=+4.089566452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs") pod "network-metrics-daemon-ppxgj" (UID: "d6557e80-b889-4203-b5cd-4b3f1aa3082e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:56.980468 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.980369 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret podName:9c1363b6-9067-4e74-b135-c8eb7e04b5c3 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:57.980350562 +0000 UTC m=+4.089687236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret") pod "global-pull-secret-syncer-dlvbc" (UID: "9c1363b6-9067-4e74-b135-c8eb7e04b5c3") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:56.980468 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:56.980385 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq podName:b4b914ad-0839-4c7a-81ef-43f4ed47b815 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:57.980378375 +0000 UTC m=+4.089715039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbgwq" (UniqueName: "kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq") pod "network-check-target-bzt2h" (UID: "b4b914ad-0839-4c7a-81ef-43f4ed47b815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:57.311121 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.311028 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:17:57 +0000 UTC" deadline="2027-12-09 04:27:30.869571169 +0000 UTC" Jul 07 16:22:57.311121 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.311079 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12468h4m33.558511961s" Jul 07 16:22:57.457885 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.457788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:57.458038 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:57.457946 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:22:57.480839 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.480795 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4tsqd" event={"ID":"00a7e93d-aa93-43ec-b668-9ad7eb86de77","Type":"ContainerStarted","Data":"baf6b63d648f721d4f5b1b5e2658dd50c6523d1b8df07473d65c79c38b2c8a13"} Jul 07 16:22:57.484084 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.483995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fgwb9" event={"ID":"8b1e4307-5b1e-415f-a948-910797770d3e","Type":"ContainerStarted","Data":"a5834b0ed94a1349d98668c5df3c0c349aa98a92550f1bd1c395a611c099f6eb"} Jul 07 16:22:57.487404 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.487365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dsnpp" event={"ID":"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4","Type":"ContainerStarted","Data":"9fcf6aa83a31496f2e0fff433cdd6b4a921caaeee32e3a39d8cf5d3457ec4ba3"} Jul 07 16:22:57.494322 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.494282 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-skct2" event={"ID":"97e5480e-a79a-4591-8d41-b828380b0d0c","Type":"ContainerStarted","Data":"15cae117b6eb87a1b4ae8e4e3c9c54ed990f791e54f095e1a923ed05e9bc1a8b"} Jul 07 16:22:57.505097 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.505038 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" event={"ID":"16b79f0f-7cb0-4de4-8a78-081f8560ccd4","Type":"ContainerStarted","Data":"613c09ef9f730b228641ea989382b1e2498d508dad5b639cb106eb9a1cc3d9b2"} Jul 07 16:22:57.509642 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.509603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2c2cd" event={"ID":"2fa469eb-0e51-449b-94fe-9f30c399c3ad","Type":"ContainerStarted","Data":"b58a600e02ff76a9e4ad2b79a14f92c827fcce5e242dd03d46ed090fac38da18"} Jul 07 16:22:57.513829 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.513769 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" event={"ID":"f4afb73f-78a1-4453-bf2f-880c9eba98a7","Type":"ContainerStarted","Data":"2825923edc878e6a7da9ea636dba853842bc9df9dd1b7646dde1f3a621fa8efa"} Jul 07 16:22:57.517162 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.517128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerStarted","Data":"613006365f38721a5d8876d661954cd6c1461c0f0fc328981ccfb0f688d15282"} Jul 07 16:22:57.523734 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.523704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" event={"ID":"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8","Type":"ContainerStarted","Data":"e336322c1158ec13a994d2e2356be7d8442162555be2fca0ce51243138545cb9"} Jul 07 16:22:57.988563 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.988483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:22:57.988563 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.988561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:22:57.988563 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:57.988596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:57.988904 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:57.988767 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:57.988904 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:57.988839 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret podName:9c1363b6-9067-4e74-b135-c8eb7e04b5c3 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:59.988819299 +0000 UTC m=+6.098155978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret") pod "global-pull-secret-syncer-dlvbc" (UID: "9c1363b6-9067-4e74-b135-c8eb7e04b5c3") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:57.989422 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:57.989394 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:22:57.989422 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:57.989418 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:22:57.989643 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:57.989432 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbgwq for pod openshift-network-diagnostics/network-check-target-bzt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:57.989643 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:57.989484 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq podName:b4b914ad-0839-4c7a-81ef-43f4ed47b815 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:59.989467193 +0000 UTC m=+6.098803895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbgwq" (UniqueName: "kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq") pod "network-check-target-bzt2h" (UID: "b4b914ad-0839-4c7a-81ef-43f4ed47b815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:57.989772 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:57.989671 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:57.989772 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:57.989721 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs podName:d6557e80-b889-4203-b5cd-4b3f1aa3082e nodeName:}" failed. No retries permitted until 2026-07-07 16:22:59.989706162 +0000 UTC m=+6.099042829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs") pod "network-metrics-daemon-ppxgj" (UID: "d6557e80-b889-4203-b5cd-4b3f1aa3082e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:58.312367 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:58.312217 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:17:57 +0000 UTC" deadline="2028-01-13 07:06:44.187474745 +0000 UTC" Jul 07 16:22:58.312367 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:58.312279 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13310h43m45.875200374s" Jul 07 16:22:58.458097 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:58.458065 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:22:58.458276 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:58.458206 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:22:58.458800 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:58.458775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:22:58.458934 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:58.458910 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:22:59.458018 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:22:59.457980 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:22:59.458511 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:22:59.458126 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:00.007159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:00.007211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:00.007247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.007419 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.007500 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret podName:9c1363b6-9067-4e74-b135-c8eb7e04b5c3 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:04.007481045 +0000 UTC m=+10.116817714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret") pod "global-pull-secret-syncer-dlvbc" (UID: "9c1363b6-9067-4e74-b135-c8eb7e04b5c3") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.007977 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.007997 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.008011 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbgwq for pod openshift-network-diagnostics/network-check-target-bzt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.008060 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq podName:b4b914ad-0839-4c7a-81ef-43f4ed47b815 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:04.008043544 +0000 UTC m=+10.117380225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbgwq" (UniqueName: "kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq") pod "network-check-target-bzt2h" (UID: "b4b914ad-0839-4c7a-81ef-43f4ed47b815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.008125 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:00.008225 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.008171 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs podName:d6557e80-b889-4203-b5cd-4b3f1aa3082e nodeName:}" failed. No retries permitted until 2026-07-07 16:23:04.0081467 +0000 UTC m=+10.117483367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs") pod "network-metrics-daemon-ppxgj" (UID: "d6557e80-b889-4203-b5cd-4b3f1aa3082e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:00.460863 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:00.460825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:00.461363 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.460943 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:00.461363 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:00.461335 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:00.461499 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:00.461455 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:01.457937 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:01.457876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:01.458136 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:01.458040 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:02.459036 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:02.458317 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:02.459036 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:02.458486 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:02.459036 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:02.458890 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:02.459036 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:02.458994 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:03.458036 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:03.458000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:03.458254 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:03.458118 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:04.046870 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:04.046824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:04.047351 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:04.046895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:04.047351 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:04.046928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:04.047351 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.047049 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:04.047351 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.047106 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret podName:9c1363b6-9067-4e74-b135-c8eb7e04b5c3 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:12.047092313 +0000 UTC m=+18.156428978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret") pod "global-pull-secret-syncer-dlvbc" (UID: "9c1363b6-9067-4e74-b135-c8eb7e04b5c3") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:04.047631 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.047474 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:04.047631 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.047489 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:04.047631 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.047500 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbgwq for pod openshift-network-diagnostics/network-check-target-bzt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:04.047631 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.047550 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq podName:b4b914ad-0839-4c7a-81ef-43f4ed47b815 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:12.047533895 +0000 UTC m=+18.156870562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbgwq" (UniqueName: "kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq") pod "network-check-target-bzt2h" (UID: "b4b914ad-0839-4c7a-81ef-43f4ed47b815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:04.047815 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.047661 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:04.047815 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.047709 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs podName:d6557e80-b889-4203-b5cd-4b3f1aa3082e nodeName:}" failed. No retries permitted until 2026-07-07 16:23:12.047692984 +0000 UTC m=+18.157029649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs") pod "network-metrics-daemon-ppxgj" (UID: "d6557e80-b889-4203-b5cd-4b3f1aa3082e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:04.459796 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:04.459700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:04.459967 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.459829 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:04.459967 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:04.459924 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:04.460090 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:04.460067 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:05.458094 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:05.457831 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:05.458588 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:05.458249 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:06.457580 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:06.457540 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:06.457749 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:06.457597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:06.457749 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:06.457705 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:06.457872 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:06.457828 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:07.458199 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:07.458165 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:07.458701 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:07.458296 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:08.458047 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:08.458009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:08.458047 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:08.458044 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:08.458251 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:08.458150 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:08.458497 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:08.458284 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:09.457651 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:09.457616 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:09.457830 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:09.457745 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:10.457558 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:10.457498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:10.458016 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:10.457525 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:10.458016 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:10.457640 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:10.458016 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:10.457758 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:11.457584 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:11.457548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:11.458108 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:11.457685 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:12.107457 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:12.107420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:12.107465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:12.107490 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.107611 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.107615 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.107628 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.107653 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.107667 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbgwq for pod openshift-network-diagnostics/network-check-target-bzt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.107682 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret podName:9c1363b6-9067-4e74-b135-c8eb7e04b5c3 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.107661237 +0000 UTC m=+34.216997921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret") pod "global-pull-secret-syncer-dlvbc" (UID: "9c1363b6-9067-4e74-b135-c8eb7e04b5c3") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.107704 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs podName:d6557e80-b889-4203-b5cd-4b3f1aa3082e nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.107693146 +0000 UTC m=+34.217029811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs") pod "network-metrics-daemon-ppxgj" (UID: "d6557e80-b889-4203-b5cd-4b3f1aa3082e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:12.107741 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.107720 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq podName:b4b914ad-0839-4c7a-81ef-43f4ed47b815 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.107711746 +0000 UTC m=+34.217048415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbgwq" (UniqueName: "kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq") pod "network-check-target-bzt2h" (UID: "b4b914ad-0839-4c7a-81ef-43f4ed47b815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:12.457671 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:12.457598 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:12.458025 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:12.457596 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:12.458025 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.457708 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:12.458025 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:12.457797 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:13.457615 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:13.457578 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:13.457813 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:13.457722 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:14.458914 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:14.458867 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:14.459379 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:14.459012 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:14.459379 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:14.459072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:14.459379 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:14.459169 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:15.457642 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:15.457603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:15.457833 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:15.457743 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:16.457593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:16.457543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:16.457593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:16.457584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:16.458207 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:16.457709 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:16.458207 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:16.457820 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:17.457352 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.457321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:17.457500 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:17.457472 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:17.576709 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.576671 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2c2cd" event={"ID":"2fa469eb-0e51-449b-94fe-9f30c399c3ad","Type":"ContainerStarted","Data":"e44a1b9cf6a5a52cc7fe2c30cf4cab0a55324a83e9a1cfa547a6b2564d3d653e"} Jul 07 16:23:17.578522 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.578470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" event={"ID":"f4afb73f-78a1-4453-bf2f-880c9eba98a7","Type":"ContainerStarted","Data":"2418246158a5e15ec134e24f44a4255a9f288abe0b3d6230a88e357cb13e39bc"} Jul 07 16:23:17.583144 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.583123 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbfrs_df53ac47-e829-4404-83cf-2d5db8a8398a/ovn-acl-logging/0.log" Jul 07 16:23:17.583654 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.583629 2562 generic.go:356] "Generic (PLEG): container finished" podID="df53ac47-e829-4404-83cf-2d5db8a8398a" containerID="94092fdd0bbc9d2ae0a1233dfed2024a0b6a8d5cf754dba6e1691222230df1ef" exitCode=1 Jul 07 16:23:17.583771 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.583707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerStarted","Data":"21e8d1c79ebadcd6c930730ee509fdeb39b90149263a0987265511515447b4be"} Jul 07 16:23:17.583826 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.583796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerStarted","Data":"47ff2120e35dae8435fc905c2fd83a75af6332eb649aeb348d1a59937412240f"} Jul 07 16:23:17.583872 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.583843 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerStarted","Data":"cbb7bbc0a66500cf95c6ecfcaf5ef00d1e9070ac1b0c5c32b555e216238defe6"} Jul 07 16:23:17.583913 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.583873 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerDied","Data":"94092fdd0bbc9d2ae0a1233dfed2024a0b6a8d5cf754dba6e1691222230df1ef"} Jul 07 16:23:17.583961 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.583914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerStarted","Data":"323f1f9107e2619a8d621e2635d49447ac660c4dd2349a3f558421537eda9039"} Jul 07 16:23:17.585313 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.585289 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" event={"ID":"062671a5da55ed99bbda883c048796b7","Type":"ContainerStarted","Data":"25763e82936e7ae73ba896266b43c5a4f90cd256033d6e55ae9bb89e6c373a04"} Jul 07 16:23:17.598443 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.598381 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2c2cd" podStartSLOduration=2.288273404 podStartE2EDuration="22.598366087s" totalImagesPullingTime="20.310092683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:17.598103767 +0000 UTC m=+23.707440452" watchObservedRunningTime="2026-07-07 16:23:17.598366087 +0000 UTC m=+23.707702771" Jul 07 16:23:17.640460 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.640416 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" podStartSLOduration=21.640398706 podStartE2EDuration="21.640398706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:17.617938283 +0000 UTC m=+23.727274969" watchObservedRunningTime="2026-07-07 16:23:17.640398706 +0000 UTC m=+23.749735385" Jul 07 16:23:17.640872 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:17.640843 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7zxmg" podStartSLOduration=2.341522264 podStartE2EDuration="22.64083664s" totalImagesPullingTime="20.299314376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:17.640530829 +0000 UTC m=+23.749867508" watchObservedRunningTime="2026-07-07 16:23:17.64083664 +0000 UTC m=+23.750173325" Jul 07 16:23:18.457793 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.457562 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:18.457793 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.457613 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:18.458002 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:18.457839 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:18.458002 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:18.457870 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:18.588467 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.588425 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fgwb9" event={"ID":"8b1e4307-5b1e-415f-a948-910797770d3e","Type":"ContainerStarted","Data":"7d4ca90459609e362272cbc9707e8db5d37ecdbee71fd3b51e36b3a6c8d74086"} Jul 07 16:23:18.590088 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.590056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dsnpp" event={"ID":"d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4","Type":"ContainerStarted","Data":"c05fd487dd198327e38c3d481ec546bb5396e7ffc1e216fdab7e864bb6f07a40"} Jul 07 16:23:18.591617 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.591594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-skct2" event={"ID":"97e5480e-a79a-4591-8d41-b828380b0d0c","Type":"ContainerStarted","Data":"c2fd3a8aa1f1cdbcb8de608e35666fe524f861a4794df4952ea563a77fecb77e"} Jul 07 16:23:18.593120 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.593096 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" event={"ID":"16b79f0f-7cb0-4de4-8a78-081f8560ccd4","Type":"ContainerStarted","Data":"7c95c88d39215378a3b16b4c60e118bb084ed7e6d76d8689d93e012c7c5db65c"} Jul 07 16:23:18.597697 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.597680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbfrs_df53ac47-e829-4404-83cf-2d5db8a8398a/ovn-acl-logging/0.log" Jul 07 16:23:18.598084 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.598053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerStarted","Data":"43ca8d89513705bd681e192dd6970af92c8b8f697580ca9a8d97a9dd0d413a36"} Jul 07 16:23:18.599482 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.599456 2562 generic.go:356] "Generic (PLEG): container finished" podID="3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8" containerID="5e8e43b4d1a8c3e8be5eb8bf17e0f6fd4db02a400cecbcf3eaa0f46b19fea8da" exitCode=0 Jul 07 16:23:18.599579 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.599544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" event={"ID":"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8","Type":"ContainerDied","Data":"5e8e43b4d1a8c3e8be5eb8bf17e0f6fd4db02a400cecbcf3eaa0f46b19fea8da"} Jul 07 16:23:18.601012 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.600992 2562 generic.go:356] "Generic (PLEG): container finished" podID="1928947df3c239c9c706211bc208097d" containerID="2822145cde863eb643ad8a2cad4db0e5a39696ea92ea56b5d747d9185a88fe46" exitCode=0 Jul 07 16:23:18.601091 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.601045 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" event={"ID":"1928947df3c239c9c706211bc208097d","Type":"ContainerDied","Data":"2822145cde863eb643ad8a2cad4db0e5a39696ea92ea56b5d747d9185a88fe46"} Jul 07 16:23:18.602441 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.602417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4tsqd" event={"ID":"00a7e93d-aa93-43ec-b668-9ad7eb86de77","Type":"ContainerStarted","Data":"e5ff9391637ccc574bd6f2a7732deb0859ff611ffc61168b96b2cafb5732d31a"} Jul 07 16:23:18.607036 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.606989 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fgwb9" podStartSLOduration=7.763216927 podStartE2EDuration="23.606973415s" totalImagesPullingTime="15.843756488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:18.606744055 +0000 UTC m=+24.716080743" watchObservedRunningTime="2026-07-07 16:23:18.606973415 +0000 UTC m=+24.716310100" Jul 07 16:23:18.627107 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.627068 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-skct2" podStartSLOduration=3.324652546 podStartE2EDuration="23.627054761s" totalImagesPullingTime="20.302402215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:18.626883252 +0000 UTC m=+24.736219937" watchObservedRunningTime="2026-07-07 16:23:18.627054761 +0000 UTC m=+24.736391445" Jul 07 16:23:18.646437 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.646396 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dsnpp" podStartSLOduration=3.349721428 podStartE2EDuration="23.646382665s" totalImagesPullingTime="20.296661237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:18.646216745 +0000 UTC m=+24.755553430" watchObservedRunningTime="2026-07-07 16:23:18.646382665 +0000 UTC m=+24.755719349" Jul 07 16:23:18.699053 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.699002 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4tsqd" podStartSLOduration=3.423036347 podStartE2EDuration="23.698987216s" totalImagesPullingTime="20.275950869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:18.666098933 +0000 UTC m=+24.775435618" watchObservedRunningTime="2026-07-07 16:23:18.698987216 +0000 UTC m=+24.808323901" Jul 07 16:23:18.796060 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.795969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgwb9_8b1e4307-5b1e-415f-a948-910797770d3e/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:18.882973 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:18.882935 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgwb9_8b1e4307-5b1e-415f-a948-910797770d3e/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:19.458861 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:19.458375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:19.458861 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:19.458531 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:19.519633 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:19.519606 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgwb9_8b1e4307-5b1e-415f-a948-910797770d3e/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:19.524523 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:19.524484 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 16:23:19.606960 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:19.606926 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" event={"ID":"16b79f0f-7cb0-4de4-8a78-081f8560ccd4","Type":"ContainerStarted","Data":"5d177fe8088fa947f0dc017cf3c260ee94fa5ece81177fe67f49650f4618a371"} Jul 07 16:23:20.326841 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.326737 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:23:19.524517322Z","UUID":"c6e6e504-2561-4510-83a8-62c48cf066bf","Handler":null,"Name":"","Endpoint":""} Jul 07 16:23:20.328164 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.328145 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 16:23:20.328261 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.328183 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 16:23:20.460738 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.460686 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:20.460883 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:20.460810 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:20.460883 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.460864 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:20.460978 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:20.460960 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:20.611281 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.611243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" event={"ID":"1928947df3c239c9c706211bc208097d","Type":"ContainerStarted","Data":"f51079be351cfba694f82d553132228b16f06457a920b8469375e0032c72cc9e"} Jul 07 16:23:20.613833 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.613806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" event={"ID":"16b79f0f-7cb0-4de4-8a78-081f8560ccd4","Type":"ContainerStarted","Data":"b8c9e29a1b8e3b2dba209dbdb8210406b3af6a683d25ccaa0d98aefcd83f8864"} Jul 07 16:23:20.617707 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.617680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbfrs_df53ac47-e829-4404-83cf-2d5db8a8398a/ovn-acl-logging/0.log" Jul 07 16:23:20.618168 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.618143 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerStarted","Data":"d14e8776d049188dc5442947d2558daef9d3e3258f4212f20462bad4a7079b93"} Jul 07 16:23:20.634459 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.634410 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" podStartSLOduration=24.634395673 podStartE2EDuration="24.634395673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:20.633924939 +0000 UTC m=+26.743261624" watchObservedRunningTime="2026-07-07 16:23:20.634395673 +0000 UTC m=+26.743732357" Jul 07 16:23:20.661560 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.661486 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hz784" podStartSLOduration=3.184937658 podStartE2EDuration="25.661471383s" totalImagesPullingTime="22.476533725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:20.660989975 +0000 UTC m=+26.770326660" watchObservedRunningTime="2026-07-07 16:23:20.661471383 +0000 UTC m=+26.770808067" Jul 07 16:23:20.849395 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.849306 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:23:20.849922 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:20.849903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:23:21.458056 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:21.458013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:21.458243 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:21.458158 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:21.620274 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:21.620244 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:23:21.620724 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:21.620708 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fgwb9" Jul 07 16:23:21.787460 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:21.787375 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgwb9_8b1e4307-5b1e-415f-a948-910797770d3e/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:21.898097 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:21.897932 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgwb9_8b1e4307-5b1e-415f-a948-910797770d3e/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:22.458436 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:22.458354 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:22.458621 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:22.458484 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:22.458621 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:22.458538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:22.458736 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:22.458659 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:22.625201 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:22.625172 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbfrs_df53ac47-e829-4404-83cf-2d5db8a8398a/ovn-acl-logging/0.log" Jul 07 16:23:22.625848 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:22.625555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerStarted","Data":"dd98faedccf264681e15873c13f2bf4659ebd8a4e0688d02f7e167090e5a1e2b"} Jul 07 16:23:22.626083 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:22.626060 2562 scope.go:117] "RemoveContainer" containerID="94092fdd0bbc9d2ae0a1233dfed2024a0b6a8d5cf754dba6e1691222230df1ef" Jul 07 16:23:23.457814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:23.457779 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:23.457957 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:23.457884 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:23.632750 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:23.632720 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbfrs_df53ac47-e829-4404-83cf-2d5db8a8398a/ovn-acl-logging/0.log" Jul 07 16:23:23.633383 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:23.633348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" event={"ID":"df53ac47-e829-4404-83cf-2d5db8a8398a","Type":"ContainerStarted","Data":"53fbee62ef9dfdd3698b73c54f9d7f5444af22e486b1e0657c63252a04863389"} Jul 07 16:23:23.633829 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:23.633805 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:23:23.633931 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:23.633887 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:23:23.634005 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:23.633939 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:23:23.653890 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:23.653861 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:23:23.654095 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:23.653970 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:23:23.671637 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:23.671584 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" podStartSLOduration=8.308562458 podStartE2EDuration="28.671563572s" totalImagesPullingTime="20.363001114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.671178304 +0000 UTC m=+29.780514988" watchObservedRunningTime="2026-07-07 16:23:23.671563572 +0000 UTC m=+29.780900258" Jul 07 16:23:24.300937 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:24.300712 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzt2h"] Jul 07 16:23:24.301111 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:24.301044 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:24.301178 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:24.301152 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:24.302943 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:24.302920 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ppxgj"] Jul 07 16:23:24.303086 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:24.303030 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:24.303161 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:24.303139 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:24.304865 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:24.304840 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlvbc"] Jul 07 16:23:24.304961 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:24.304923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:24.305029 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:24.305013 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:25.457381 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:25.457346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:25.457872 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:25.457481 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:25.962220 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:25.962195 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dsnpp_d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4/dns-node-resolver/0.log" Jul 07 16:23:26.458262 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:26.458230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:26.458680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:26.458230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:26.458680 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:26.458360 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:26.458680 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:26.458421 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:26.642022 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:26.641990 2562 generic.go:356] "Generic (PLEG): container finished" podID="3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8" containerID="5b522a6d155eac41e1794137d4c654dd46651a1f43c543b800f457a19f806e7d" exitCode=0 Jul 07 16:23:26.642169 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:26.642053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" event={"ID":"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8","Type":"ContainerDied","Data":"5b522a6d155eac41e1794137d4c654dd46651a1f43c543b800f457a19f806e7d"} Jul 07 16:23:26.762873 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:26.762847 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4tsqd_00a7e93d-aa93-43ec-b668-9ad7eb86de77/node-ca/0.log" Jul 07 16:23:27.458109 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:27.458068 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:27.458265 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:27.458241 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:28.122007 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:28.121974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:28.122369 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:28.122017 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:28.122369 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.122135 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:28.122369 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.122137 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:28.122369 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.122191 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret podName:9c1363b6-9067-4e74-b135-c8eb7e04b5c3 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:00.122170238 +0000 UTC m=+66.231506919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret") pod "global-pull-secret-syncer-dlvbc" (UID: "9c1363b6-9067-4e74-b135-c8eb7e04b5c3") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:28.122369 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:28.122211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:28.122369 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.122261 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs podName:d6557e80-b889-4203-b5cd-4b3f1aa3082e nodeName:}" failed. No retries permitted until 2026-07-07 16:24:00.122249156 +0000 UTC m=+66.231585819 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs") pod "network-metrics-daemon-ppxgj" (UID: "d6557e80-b889-4203-b5cd-4b3f1aa3082e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:28.122369 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.122323 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:28.122369 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.122336 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:28.122369 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.122349 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbgwq for pod openshift-network-diagnostics/network-check-target-bzt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:28.122677 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.122387 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq podName:b4b914ad-0839-4c7a-81ef-43f4ed47b815 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:00.122374617 +0000 UTC m=+66.231711280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbgwq" (UniqueName: "kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq") pod "network-check-target-bzt2h" (UID: "b4b914ad-0839-4c7a-81ef-43f4ed47b815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:28.457694 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:28.457602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:28.457836 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:28.457602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:28.457836 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.457714 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:28.457836 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:28.457797 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:28.649338 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:28.649300 2562 generic.go:356] "Generic (PLEG): container finished" podID="3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8" containerID="a85890525af815d6c12429035104be9e6515b0f1853c0909080e8545fc938644" exitCode=0 Jul 07 16:23:28.649499 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:28.649362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" event={"ID":"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8","Type":"ContainerDied","Data":"a85890525af815d6c12429035104be9e6515b0f1853c0909080e8545fc938644"} Jul 07 16:23:29.458304 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:29.458279 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:29.458595 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:29.458389 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:29.654379 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:29.654209 2562 generic.go:356] "Generic (PLEG): container finished" podID="3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8" containerID="a5c6dafaebfd4b56d5f859756e5b69c7144a4a75c520f83146a4898979b07543" exitCode=0 Jul 07 16:23:29.654379 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:29.654297 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" event={"ID":"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8","Type":"ContainerDied","Data":"a5c6dafaebfd4b56d5f859756e5b69c7144a4a75c520f83146a4898979b07543"} Jul 07 16:23:30.458051 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:30.458024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:30.458235 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:30.458139 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:30.458235 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:30.458210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:30.458322 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:30.458305 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:31.457708 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:31.457675 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:31.457932 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:31.457778 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:32.457447 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:32.457411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:32.457852 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:32.457465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:32.457852 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:32.457572 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:32.457852 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:32.457757 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:33.457896 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:33.457865 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:33.458309 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:33.457998 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:34.463030 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:34.463003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:34.463475 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:34.463003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:34.463475 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:34.463103 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:34.463475 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:34.463186 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:35.457607 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:35.457576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:35.457773 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:35.457684 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:35.671646 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:35.671606 2562 generic.go:356] "Generic (PLEG): container finished" podID="3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8" containerID="561e561e78ff8837e8e39d7a3dfb2de55ffde76754b630ce904ca2bfa268ff70" exitCode=0 Jul 07 16:23:35.672072 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:35.671659 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" event={"ID":"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8","Type":"ContainerDied","Data":"561e561e78ff8837e8e39d7a3dfb2de55ffde76754b630ce904ca2bfa268ff70"} Jul 07 16:23:36.457408 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:36.457366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:36.457626 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:36.457473 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:36.457626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:36.457563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:36.457752 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:36.457662 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:36.677294 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:36.677254 2562 generic.go:356] "Generic (PLEG): container finished" podID="3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8" containerID="643a5c18bfbcc73650c712494d02002b56bdcd83db056b32813399cf1e1b895f" exitCode=0 Jul 07 16:23:36.677671 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:36.677296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" event={"ID":"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8","Type":"ContainerDied","Data":"643a5c18bfbcc73650c712494d02002b56bdcd83db056b32813399cf1e1b895f"} Jul 07 16:23:37.457839 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:37.457806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:37.457996 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:37.457910 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:37.682645 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:37.682601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" event={"ID":"3ea2f89e-d6d9-4457-8d4c-a84d2b6b78d8","Type":"ContainerStarted","Data":"8ea0d6b188c41085eb763408c13c5dbf0c0963a15a420925546c77920375db2b"} Jul 07 16:23:37.721052 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:37.720907 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bb5dp" podStartSLOduration=8.125055087 podStartE2EDuration="42.720891362s" totalImagesPullingTime="34.595836275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:37.719442284 +0000 UTC m=+43.828778968" watchObservedRunningTime="2026-07-07 16:23:37.720891362 +0000 UTC m=+43.830228037" Jul 07 16:23:38.458115 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:38.458074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:38.458115 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:38.458113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:38.458339 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:38.458187 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:38.458339 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:38.458311 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:39.457833 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:39.457794 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:39.458273 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:39.457947 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:40.458286 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:40.458250 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:40.458678 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:40.458363 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:40.458678 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:40.458425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:40.458678 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:40.458560 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:41.458368 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:41.458329 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:41.458778 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:41.458437 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:42.457719 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:42.457680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:42.457904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:42.457786 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:42.457904 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:42.457831 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:42.457904 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:42.457869 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:43.457660 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:43.457623 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:43.458115 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:43.457756 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:44.458975 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:44.458937 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:44.459424 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:44.459084 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:44.459424 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:44.459141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:44.459424 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:44.459245 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:45.458324 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:45.458283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:45.458527 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:45.458390 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:46.458202 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:46.458165 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:46.458690 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:46.458165 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:46.458690 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:46.458275 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:46.458690 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:46.458340 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:47.458170 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:47.458132 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:47.458329 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:47.458240 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppxgj" podUID="d6557e80-b889-4203-b5cd-4b3f1aa3082e" Jul 07 16:23:48.457573 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:48.457541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:48.457573 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:48.457568 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:48.457782 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:48.457650 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvbc" podUID="9c1363b6-9067-4e74-b135-c8eb7e04b5c3" Jul 07 16:23:48.457782 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:48.457769 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzt2h" podUID="b4b914ad-0839-4c7a-81ef-43f4ed47b815" Jul 07 16:23:49.232316 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.232283 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeReady" Jul 07 16:23:49.232816 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.232442 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 16:23:49.301403 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.301372 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64dbd44b55-nxqct"] Jul 07 16:23:49.325457 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.325424 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.329188 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.329160 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 16:23:49.329333 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.329274 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 16:23:49.329523 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.329490 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g8vwq\"" Jul 07 16:23:49.330582 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.330565 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 16:23:49.330838 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.330817 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64dbd44b55-nxqct"] Jul 07 16:23:49.332881 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.332656 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ntf68"] Jul 07 16:23:49.346031 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.346011 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g5lrf"] Jul 07 16:23:49.346155 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.346141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ntf68" Jul 07 16:23:49.350657 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.350639 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 16:23:49.360072 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.360048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ntf68"] Jul 07 16:23:49.360177 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.360147 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.372547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.372528 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 16:23:49.373039 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.373017 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 16:23:49.373842 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.373825 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g5lrf"] Jul 07 16:23:49.374943 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.374921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8924b6-4453-40c2-b0a5-6e90f14c141f-tmp-dir\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.375055 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.374950 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62d13e68-15fc-4316-8f80-cee20130c5f4-installation-pull-secrets\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.375055 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.374971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b8924b6-4453-40c2-b0a5-6e90f14c141f-metrics-tls\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.375055 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.374988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b8924b6-4453-40c2-b0a5-6e90f14c141f-config-volume\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.375055 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62d13e68-15fc-4316-8f80-cee20130c5f4-image-registry-private-configuration\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.375273 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62d13e68-15fc-4316-8f80-cee20130c5f4-ca-trust-extracted\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.375273 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62d13e68-15fc-4316-8f80-cee20130c5f4-bound-sa-token\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.375273 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69d16ee8-8778-4379-a3da-58056f769428-cert\") pod \"ingress-canary-ntf68\" (UID: \"69d16ee8-8778-4379-a3da-58056f769428\") " pod="openshift-ingress-canary/ingress-canary-ntf68" Jul 07 16:23:49.375273 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375180 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62d13e68-15fc-4316-8f80-cee20130c5f4-registry-certificates\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.375273 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfv9g\" (UniqueName: \"kubernetes.io/projected/62d13e68-15fc-4316-8f80-cee20130c5f4-kube-api-access-cfv9g\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.375273 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k8l5\" (UniqueName: \"kubernetes.io/projected/69d16ee8-8778-4379-a3da-58056f769428-kube-api-access-9k8l5\") pod \"ingress-canary-ntf68\" (UID: \"69d16ee8-8778-4379-a3da-58056f769428\") " pod="openshift-ingress-canary/ingress-canary-ntf68" Jul 07 16:23:49.375273 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62d13e68-15fc-4316-8f80-cee20130c5f4-registry-tls\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.375644 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62d13e68-15fc-4316-8f80-cee20130c5f4-trusted-ca\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.375644 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.375311 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxmf5\" (UniqueName: \"kubernetes.io/projected/1b8924b6-4453-40c2-b0a5-6e90f14c141f-kube-api-access-zxmf5\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.377777 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.377758 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mlgdt\"" Jul 07 16:23:49.377869 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.377766 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 16:23:49.377869 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.377829 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jgc6k\"" Jul 07 16:23:49.378089 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.378072 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 16:23:49.379924 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.379904 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 16:23:49.424989 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.424961 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jhnl6"] Jul 07 16:23:49.445677 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.445644 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.449888 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.449863 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 16:23:49.450131 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.450105 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 16:23:49.450228 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.450113 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 16:23:49.450228 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.450169 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhnl6"] Jul 07 16:23:49.450228 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.450123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 16:23:49.450398 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.450377 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qgfn\"" Jul 07 16:23:49.458005 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.457987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:23:49.463096 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.463076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:23:49.463201 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.463130 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxp9t\"" Jul 07 16:23:49.475691 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfv9g\" (UniqueName: \"kubernetes.io/projected/62d13e68-15fc-4316-8f80-cee20130c5f4-kube-api-access-cfv9g\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.475799 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdwms\" (UniqueName: \"kubernetes.io/projected/be2adfac-cdee-4756-9c15-1069a6bd3b15-kube-api-access-sdwms\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.475799 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k8l5\" (UniqueName: \"kubernetes.io/projected/69d16ee8-8778-4379-a3da-58056f769428-kube-api-access-9k8l5\") pod \"ingress-canary-ntf68\" (UID: \"69d16ee8-8778-4379-a3da-58056f769428\") " pod="openshift-ingress-canary/ingress-canary-ntf68" Jul 07 16:23:49.475799 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62d13e68-15fc-4316-8f80-cee20130c5f4-registry-tls\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.475958 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62d13e68-15fc-4316-8f80-cee20130c5f4-trusted-ca\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.475958 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxmf5\" (UniqueName: \"kubernetes.io/projected/1b8924b6-4453-40c2-b0a5-6e90f14c141f-kube-api-access-zxmf5\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.475958 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be2adfac-cdee-4756-9c15-1069a6bd3b15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.475958 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8924b6-4453-40c2-b0a5-6e90f14c141f-tmp-dir\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.475958 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62d13e68-15fc-4316-8f80-cee20130c5f4-installation-pull-secrets\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.476210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.475976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b8924b6-4453-40c2-b0a5-6e90f14c141f-metrics-tls\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.476210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be2adfac-cdee-4756-9c15-1069a6bd3b15-crio-socket\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.476210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b8924b6-4453-40c2-b0a5-6e90f14c141f-config-volume\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.476210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be2adfac-cdee-4756-9c15-1069a6bd3b15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.476210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62d13e68-15fc-4316-8f80-cee20130c5f4-image-registry-private-configuration\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.476210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62d13e68-15fc-4316-8f80-cee20130c5f4-ca-trust-extracted\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.476210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62d13e68-15fc-4316-8f80-cee20130c5f4-bound-sa-token\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.476574 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476238 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8924b6-4453-40c2-b0a5-6e90f14c141f-tmp-dir\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.476574 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69d16ee8-8778-4379-a3da-58056f769428-cert\") pod \"ingress-canary-ntf68\" (UID: \"69d16ee8-8778-4379-a3da-58056f769428\") " pod="openshift-ingress-canary/ingress-canary-ntf68" Jul 07 16:23:49.476574 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62d13e68-15fc-4316-8f80-cee20130c5f4-registry-certificates\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.476574 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476330 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be2adfac-cdee-4756-9c15-1069a6bd3b15-data-volume\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.477039 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476948 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62d13e68-15fc-4316-8f80-cee20130c5f4-trusted-ca\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.477039 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.476964 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62d13e68-15fc-4316-8f80-cee20130c5f4-ca-trust-extracted\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.477423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.477284 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62d13e68-15fc-4316-8f80-cee20130c5f4-registry-certificates\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.477524 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.477432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b8924b6-4453-40c2-b0a5-6e90f14c141f-config-volume\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.480547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.480476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62d13e68-15fc-4316-8f80-cee20130c5f4-registry-tls\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.480547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.480524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b8924b6-4453-40c2-b0a5-6e90f14c141f-metrics-tls\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.480709 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.480575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62d13e68-15fc-4316-8f80-cee20130c5f4-image-registry-private-configuration\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.480709 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.480669 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62d13e68-15fc-4316-8f80-cee20130c5f4-installation-pull-secrets\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.480788 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.480715 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69d16ee8-8778-4379-a3da-58056f769428-cert\") pod \"ingress-canary-ntf68\" (UID: \"69d16ee8-8778-4379-a3da-58056f769428\") " pod="openshift-ingress-canary/ingress-canary-ntf68" Jul 07 16:23:49.507520 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.507449 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfv9g\" (UniqueName: \"kubernetes.io/projected/62d13e68-15fc-4316-8f80-cee20130c5f4-kube-api-access-cfv9g\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.508573 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.508553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxmf5\" (UniqueName: \"kubernetes.io/projected/1b8924b6-4453-40c2-b0a5-6e90f14c141f-kube-api-access-zxmf5\") pod \"dns-default-g5lrf\" (UID: \"1b8924b6-4453-40c2-b0a5-6e90f14c141f\") " pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.521797 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.521777 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k8l5\" (UniqueName: \"kubernetes.io/projected/69d16ee8-8778-4379-a3da-58056f769428-kube-api-access-9k8l5\") pod \"ingress-canary-ntf68\" (UID: \"69d16ee8-8778-4379-a3da-58056f769428\") " pod="openshift-ingress-canary/ingress-canary-ntf68" Jul 07 16:23:49.525386 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.525362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62d13e68-15fc-4316-8f80-cee20130c5f4-bound-sa-token\") pod \"image-registry-64dbd44b55-nxqct\" (UID: \"62d13e68-15fc-4316-8f80-cee20130c5f4\") " pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.576965 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.576923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be2adfac-cdee-4756-9c15-1069a6bd3b15-crio-socket\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.576965 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.576970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be2adfac-cdee-4756-9c15-1069a6bd3b15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.577202 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.577021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be2adfac-cdee-4756-9c15-1069a6bd3b15-data-volume\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.577202 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.577041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdwms\" (UniqueName: \"kubernetes.io/projected/be2adfac-cdee-4756-9c15-1069a6bd3b15-kube-api-access-sdwms\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.577202 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.577070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be2adfac-cdee-4756-9c15-1069a6bd3b15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.577202 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.577133 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be2adfac-cdee-4756-9c15-1069a6bd3b15-crio-socket\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.577430 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.577410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be2adfac-cdee-4756-9c15-1069a6bd3b15-data-volume\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.577681 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.577662 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be2adfac-cdee-4756-9c15-1069a6bd3b15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.579545 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.579526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be2adfac-cdee-4756-9c15-1069a6bd3b15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.594547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.594520 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdwms\" (UniqueName: \"kubernetes.io/projected/be2adfac-cdee-4756-9c15-1069a6bd3b15-kube-api-access-sdwms\") pod \"insights-runtime-extractor-jhnl6\" (UID: \"be2adfac-cdee-4756-9c15-1069a6bd3b15\") " pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.634913 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.634882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:49.657012 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.656984 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ntf68" Jul 07 16:23:49.669357 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.669340 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:49.755704 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.755591 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhnl6" Jul 07 16:23:49.888775 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.888744 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64dbd44b55-nxqct"] Jul 07 16:23:49.889559 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.889498 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ntf68"] Jul 07 16:23:49.893030 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:23:49.892990 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d13e68_15fc_4316_8f80_cee20130c5f4.slice/crio-02eb6bf0556861e6e962c490a6dd092190b11f72f9e33e59bbec3c827d4ce64f WatchSource:0}: Error finding container 02eb6bf0556861e6e962c490a6dd092190b11f72f9e33e59bbec3c827d4ce64f: Status 404 returned error can't find the container with id 02eb6bf0556861e6e962c490a6dd092190b11f72f9e33e59bbec3c827d4ce64f Jul 07 16:23:49.900943 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.900915 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g5lrf"] Jul 07 16:23:49.904535 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:23:49.904488 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8924b6_4453_40c2_b0a5_6e90f14c141f.slice/crio-e600131f86c5a2d3531c62d86bf3725233ca024935f4c94ed665f8063560375e WatchSource:0}: Error finding container e600131f86c5a2d3531c62d86bf3725233ca024935f4c94ed665f8063560375e: Status 404 returned error can't find the container with id e600131f86c5a2d3531c62d86bf3725233ca024935f4c94ed665f8063560375e Jul 07 16:23:49.933169 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:49.933146 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhnl6"] Jul 07 16:23:49.936684 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:23:49.936651 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2adfac_cdee_4756_9c15_1069a6bd3b15.slice/crio-bf7c5e8e358c09dc0e2740706289175ad39dc32ebc2d794b778356daabb12d51 WatchSource:0}: Error finding container bf7c5e8e358c09dc0e2740706289175ad39dc32ebc2d794b778356daabb12d51: Status 404 returned error can't find the container with id bf7c5e8e358c09dc0e2740706289175ad39dc32ebc2d794b778356daabb12d51 Jul 07 16:23:50.458692 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.458652 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:23:50.459085 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.458702 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:23:50.462396 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.462359 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:23:50.463730 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.463464 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vjw6s\"" Jul 07 16:23:50.463890 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.463811 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:23:50.464018 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.463993 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:23:50.717150 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.717104 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ntf68" event={"ID":"69d16ee8-8778-4379-a3da-58056f769428","Type":"ContainerStarted","Data":"1bb68763a82bd6d18fee0a0e2a9e25b4c083c8084e8add560a8141fbaa519b19"} Jul 07 16:23:50.721288 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.721257 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" event={"ID":"62d13e68-15fc-4316-8f80-cee20130c5f4","Type":"ContainerStarted","Data":"e22cb169728bf324872a28831aed6dd3a0c6b9407c09486a670ce08b3fc6b46b"} Jul 07 16:23:50.721409 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.721311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" event={"ID":"62d13e68-15fc-4316-8f80-cee20130c5f4","Type":"ContainerStarted","Data":"02eb6bf0556861e6e962c490a6dd092190b11f72f9e33e59bbec3c827d4ce64f"} Jul 07 16:23:50.721647 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.721593 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:23:50.724158 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.724130 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhnl6" event={"ID":"be2adfac-cdee-4756-9c15-1069a6bd3b15","Type":"ContainerStarted","Data":"bf7c5e8e358c09dc0e2740706289175ad39dc32ebc2d794b778356daabb12d51"} Jul 07 16:23:50.726136 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:50.726077 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g5lrf" event={"ID":"1b8924b6-4453-40c2-b0a5-6e90f14c141f","Type":"ContainerStarted","Data":"e600131f86c5a2d3531c62d86bf3725233ca024935f4c94ed665f8063560375e"} Jul 07 16:23:53.323743 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:53.323688 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" podStartSLOduration=5.323664068 podStartE2EDuration="5.323664068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:50.746978267 +0000 UTC m=+56.856314954" watchObservedRunningTime="2026-07-07 16:23:53.323664068 +0000 UTC m=+59.433000754" Jul 07 16:23:53.324557 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:53.324498 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh"] Jul 07 16:23:53.331837 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:53.331811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" Jul 07 16:23:53.335284 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:53.335072 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d9r5f\"" Jul 07 16:23:53.336643 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:53.336593 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 16:23:53.337794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:53.337773 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh"] Jul 07 16:23:53.413680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:53.413640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1991102c-2793-4ae4-bc2c-b9beada8dcd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cglxh\" (UID: \"1991102c-2793-4ae4-bc2c-b9beada8dcd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" Jul 07 16:23:53.514619 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:53.514577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1991102c-2793-4ae4-bc2c-b9beada8dcd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cglxh\" (UID: \"1991102c-2793-4ae4-bc2c-b9beada8dcd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" Jul 07 16:23:53.514804 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:53.514740 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 16:23:53.515360 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:53.515336 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1991102c-2793-4ae4-bc2c-b9beada8dcd4-tls-certificates podName:1991102c-2793-4ae4-bc2c-b9beada8dcd4 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:54.015303723 +0000 UTC m=+60.124640390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1991102c-2793-4ae4-bc2c-b9beada8dcd4-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-cglxh" (UID: "1991102c-2793-4ae4-bc2c-b9beada8dcd4") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 16:23:54.019423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:54.019295 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1991102c-2793-4ae4-bc2c-b9beada8dcd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cglxh\" (UID: \"1991102c-2793-4ae4-bc2c-b9beada8dcd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" Jul 07 16:23:54.019585 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:54.019499 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 16:23:54.019637 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:23:54.019588 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1991102c-2793-4ae4-bc2c-b9beada8dcd4-tls-certificates podName:1991102c-2793-4ae4-bc2c-b9beada8dcd4 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:55.019574447 +0000 UTC m=+61.128911109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1991102c-2793-4ae4-bc2c-b9beada8dcd4-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-cglxh" (UID: "1991102c-2793-4ae4-bc2c-b9beada8dcd4") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 16:23:55.029623 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.029588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1991102c-2793-4ae4-bc2c-b9beada8dcd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cglxh\" (UID: \"1991102c-2793-4ae4-bc2c-b9beada8dcd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" Jul 07 16:23:55.032939 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.032910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1991102c-2793-4ae4-bc2c-b9beada8dcd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cglxh\" (UID: \"1991102c-2793-4ae4-bc2c-b9beada8dcd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" Jul 07 16:23:55.148486 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.148457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d9r5f\"" Jul 07 16:23:55.155627 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.155558 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" Jul 07 16:23:55.280372 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.280349 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh"] Jul 07 16:23:55.282701 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:23:55.282679 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1991102c_2793_4ae4_bc2c_b9beada8dcd4.slice/crio-e8e63a7211863d4c2a8ad9f8c4ff4144776d267da1e42da35d35026c046b26c9 WatchSource:0}: Error finding container e8e63a7211863d4c2a8ad9f8c4ff4144776d267da1e42da35d35026c046b26c9: Status 404 returned error can't find the container with id e8e63a7211863d4c2a8ad9f8c4ff4144776d267da1e42da35d35026c046b26c9 Jul 07 16:23:55.653928 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.653901 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbfrs" Jul 07 16:23:55.744238 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.744200 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ntf68" event={"ID":"69d16ee8-8778-4379-a3da-58056f769428","Type":"ContainerStarted","Data":"d9513d2f0251e77840c4ebe9977fc920cef0a53118287207cffcfa0b25a40305"} Jul 07 16:23:55.745958 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.745924 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhnl6" event={"ID":"be2adfac-cdee-4756-9c15-1069a6bd3b15","Type":"ContainerStarted","Data":"9158caa829cb62d6bb062cb1e5d2ed645655fc82591e40ea90ab4e42ce0ab54f"} Jul 07 16:23:55.748009 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.747983 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g5lrf" event={"ID":"1b8924b6-4453-40c2-b0a5-6e90f14c141f","Type":"ContainerStarted","Data":"7a82a5bee38520a8d9747da471f2a7503218c4302ea8adbecef3b900d3483fc9"} Jul 07 16:23:55.748125 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.748035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g5lrf" event={"ID":"1b8924b6-4453-40c2-b0a5-6e90f14c141f","Type":"ContainerStarted","Data":"2fff119c4aaa9496b44efd6d8dc935db1a62e9e5cbe615b1dc9def65c6575334"} Jul 07 16:23:55.748125 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.748060 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g5lrf" Jul 07 16:23:55.749491 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.749468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" event={"ID":"1991102c-2793-4ae4-bc2c-b9beada8dcd4","Type":"ContainerStarted","Data":"e8e63a7211863d4c2a8ad9f8c4ff4144776d267da1e42da35d35026c046b26c9"} Jul 07 16:23:55.810866 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.810808 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ntf68" podStartSLOduration=1.800441085 podStartE2EDuration="6.810790223s" totalImagesPullingTime="5.010349138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:55.809630476 +0000 UTC m=+61.918967162" watchObservedRunningTime="2026-07-07 16:23:55.810790223 +0000 UTC m=+61.920126907" Jul 07 16:23:55.883844 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:55.883793 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g5lrf" podStartSLOduration=1.886498838 podStartE2EDuration="6.883775112s" totalImagesPullingTime="4.997276274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:55.883299408 +0000 UTC m=+61.992636097" watchObservedRunningTime="2026-07-07 16:23:55.883775112 +0000 UTC m=+61.993111797" Jul 07 16:23:56.754768 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:56.754726 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhnl6" event={"ID":"be2adfac-cdee-4756-9c15-1069a6bd3b15","Type":"ContainerStarted","Data":"9d47def999c5aed6424689fa014f249a5594e0eecb950cce4a643390e06f19eb"} Jul 07 16:23:57.759914 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:57.759880 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" event={"ID":"1991102c-2793-4ae4-bc2c-b9beada8dcd4","Type":"ContainerStarted","Data":"c0be9db4aadc648de2702bcd33ceb448f73744187dfb717d7711d3badb42c088"} Jul 07 16:23:57.760388 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:57.760178 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" Jul 07 16:23:57.764862 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:57.764840 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" Jul 07 16:23:57.777669 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:57.777622 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cglxh" podStartSLOduration=3.038432423 podStartE2EDuration="4.777606428s" totalImagesPullingTime="1.739174005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:57.776971908 +0000 UTC m=+63.886308594" watchObservedRunningTime="2026-07-07 16:23:57.777606428 +0000 UTC m=+63.886943113" Jul 07 16:23:59.767899 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:59.767799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhnl6" event={"ID":"be2adfac-cdee-4756-9c15-1069a6bd3b15","Type":"ContainerStarted","Data":"5cf581a85d4b88c9d3363844bc084d2613c2489517cbdbcd3ebb275be011b587"} Jul 07 16:23:59.788000 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:23:59.787917 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jhnl6" podStartSLOduration=1.5106115390000001 podStartE2EDuration="10.787898955s" totalImagesPullingTime="9.277287416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:59.787337553 +0000 UTC m=+65.896674249" watchObservedRunningTime="2026-07-07 16:23:59.787898955 +0000 UTC m=+65.897235640" Jul 07 16:24:00.172403 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.172356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:24:00.172636 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.172412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:24:00.172636 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.172525 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:24:00.178765 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.178737 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:24:00.178890 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.178738 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:24:00.178890 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.178738 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:24:00.185942 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.185920 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1363b6-9067-4e74-b135-c8eb7e04b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-dlvbc\" (UID: \"9c1363b6-9067-4e74-b135-c8eb7e04b5c3\") " pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:24:00.185942 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.185936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6557e80-b889-4203-b5cd-4b3f1aa3082e-metrics-certs\") pod \"network-metrics-daemon-ppxgj\" (UID: \"d6557e80-b889-4203-b5cd-4b3f1aa3082e\") " pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:24:00.186770 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.186756 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:24:00.195921 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.195902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbgwq\" (UniqueName: \"kubernetes.io/projected/b4b914ad-0839-4c7a-81ef-43f4ed47b815-kube-api-access-rbgwq\") pod \"network-check-target-bzt2h\" (UID: \"b4b914ad-0839-4c7a-81ef-43f4ed47b815\") " pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:24:00.269175 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.269139 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxp9t\"" Jul 07 16:24:00.277165 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.277139 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppxgj" Jul 07 16:24:00.374678 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.374649 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vjw6s\"" Jul 07 16:24:00.381348 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.381320 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:24:00.382598 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.382578 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvbc" Jul 07 16:24:00.406223 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.406188 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ppxgj"] Jul 07 16:24:00.409278 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:24:00.409242 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6557e80_b889_4203_b5cd_4b3f1aa3082e.slice/crio-878ca155249ca7f5ea42b86544ef87f54c57240135e750df541ea8382810a320 WatchSource:0}: Error finding container 878ca155249ca7f5ea42b86544ef87f54c57240135e750df541ea8382810a320: Status 404 returned error can't find the container with id 878ca155249ca7f5ea42b86544ef87f54c57240135e750df541ea8382810a320 Jul 07 16:24:00.541041 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.541012 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzt2h"] Jul 07 16:24:00.543940 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:24:00.543914 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b914ad_0839_4c7a_81ef_43f4ed47b815.slice/crio-f66670bec0fabdb53705d8ae93267cc779bf55490783a542462c10c44e89baf3 WatchSource:0}: Error finding container f66670bec0fabdb53705d8ae93267cc779bf55490783a542462c10c44e89baf3: Status 404 returned error can't find the container with id f66670bec0fabdb53705d8ae93267cc779bf55490783a542462c10c44e89baf3 Jul 07 16:24:00.563341 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.563317 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlvbc"] Jul 07 16:24:00.566259 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:24:00.566233 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1363b6_9067_4e74_b135_c8eb7e04b5c3.slice/crio-d5ca23631be0f4d04a02ab2456cb797c81d59dc9af621c07d5df49523a6d2bed WatchSource:0}: Error finding container d5ca23631be0f4d04a02ab2456cb797c81d59dc9af621c07d5df49523a6d2bed: Status 404 returned error can't find the container with id d5ca23631be0f4d04a02ab2456cb797c81d59dc9af621c07d5df49523a6d2bed Jul 07 16:24:00.772299 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.772207 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlvbc" event={"ID":"9c1363b6-9067-4e74-b135-c8eb7e04b5c3","Type":"ContainerStarted","Data":"d5ca23631be0f4d04a02ab2456cb797c81d59dc9af621c07d5df49523a6d2bed"} Jul 07 16:24:00.773520 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.773477 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzt2h" event={"ID":"b4b914ad-0839-4c7a-81ef-43f4ed47b815","Type":"ContainerStarted","Data":"f66670bec0fabdb53705d8ae93267cc779bf55490783a542462c10c44e89baf3"} Jul 07 16:24:00.774564 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:00.774539 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ppxgj" event={"ID":"d6557e80-b889-4203-b5cd-4b3f1aa3082e","Type":"ContainerStarted","Data":"878ca155249ca7f5ea42b86544ef87f54c57240135e750df541ea8382810a320"} Jul 07 16:24:01.781493 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:01.781381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ppxgj" event={"ID":"d6557e80-b889-4203-b5cd-4b3f1aa3082e","Type":"ContainerStarted","Data":"2b2a71f28ca5cb8234f7891d8207198a15ed7633840957998c4a8b0886009993"} Jul 07 16:24:01.781493 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:01.781461 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ppxgj" event={"ID":"d6557e80-b889-4203-b5cd-4b3f1aa3082e","Type":"ContainerStarted","Data":"7c2f768fca0969e235aaf1fa64aae53a8d1db74b716e43ffd646476bffe656d9"} Jul 07 16:24:01.802116 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:01.802045 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ppxgj" podStartSLOduration=65.78723778 podStartE2EDuration="1m6.802029133s" totalImagesPullingTime="1.014791353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:01.801703469 +0000 UTC m=+67.911040156" watchObservedRunningTime="2026-07-07 16:24:01.802029133 +0000 UTC m=+67.911365818" Jul 07 16:24:03.389098 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.389061 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f876dfd96-pdgxf"] Jul 07 16:24:03.393617 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.393588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.396625 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.396595 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 16:24:03.397500 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.397481 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 16:24:03.397621 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.397593 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 16:24:03.398297 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.398178 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 16:24:03.398297 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.398205 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 16:24:03.405941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.402316 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 16:24:03.405941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.402702 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 16:24:03.405941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.405163 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9w2mw\"" Jul 07 16:24:03.409194 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.409168 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f876dfd96-pdgxf"] Jul 07 16:24:03.412259 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.412240 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 16:24:03.495615 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.495574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njqb5\" (UniqueName: \"kubernetes.io/projected/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-kube-api-access-njqb5\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.495615 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.495623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-config\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.495878 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.495660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-oauth-config\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.495878 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.495692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-service-ca\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.495878 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.495720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-serving-cert\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.495878 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.495751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-trusted-ca-bundle\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.495878 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.495772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-oauth-serving-cert\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.597050 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.597013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njqb5\" (UniqueName: \"kubernetes.io/projected/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-kube-api-access-njqb5\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.597290 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.597078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-config\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.597290 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.597123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-oauth-config\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.597290 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.597149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-service-ca\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.597290 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.597169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-serving-cert\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.597290 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.597211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-trusted-ca-bundle\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.597290 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.597233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-oauth-serving-cert\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.598008 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.597943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-service-ca\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.598008 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.597943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-config\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.598184 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.598011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-oauth-serving-cert\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.598242 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.598219 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-trusted-ca-bundle\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.600155 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.600128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-serving-cert\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.600274 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.600215 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-oauth-config\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.606252 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.606225 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njqb5\" (UniqueName: \"kubernetes.io/projected/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-kube-api-access-njqb5\") pod \"console-7f876dfd96-pdgxf\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.713112 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.713021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:03.868365 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:03.868333 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f876dfd96-pdgxf"] Jul 07 16:24:03.871580 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:24:03.871555 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1738d6fa_fc1c_4c06_81c5_ad6db3d72022.slice/crio-6af1625790804809a9781e2cbf07c2b9d778c3cc3f0a4454173bbfea4f85a52d WatchSource:0}: Error finding container 6af1625790804809a9781e2cbf07c2b9d778c3cc3f0a4454173bbfea4f85a52d: Status 404 returned error can't find the container with id 6af1625790804809a9781e2cbf07c2b9d778c3cc3f0a4454173bbfea4f85a52d Jul 07 16:24:04.796770 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:04.796730 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f876dfd96-pdgxf" event={"ID":"1738d6fa-fc1c-4c06-81c5-ad6db3d72022","Type":"ContainerStarted","Data":"6af1625790804809a9781e2cbf07c2b9d778c3cc3f0a4454173bbfea4f85a52d"} Jul 07 16:24:05.758052 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.758022 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g5lrf" Jul 07 16:24:05.884309 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.884257 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w4hdv"] Jul 07 16:24:05.887971 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.887946 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:05.894530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.893491 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 16:24:05.894530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.893553 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 16:24:05.894530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.893780 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 16:24:05.894530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.893857 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 16:24:05.894530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.893966 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 16:24:05.894530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.894072 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 16:24:05.894530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:05.894175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b7h4n\"" Jul 07 16:24:06.019133 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.019035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-tls\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.019133 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.019083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a407fe7-76bc-4743-8cde-091e1ed8350b-metrics-client-ca\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.019133 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.019124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a407fe7-76bc-4743-8cde-091e1ed8350b-sys\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.019389 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.019156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-accelerators-collector-config\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.019389 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.019198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxnt7\" (UniqueName: \"kubernetes.io/projected/4a407fe7-76bc-4743-8cde-091e1ed8350b-kube-api-access-sxnt7\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.019389 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.019226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-wtmp\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.019389 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.019291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.019389 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.019345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-textfile\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.019651 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.019399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a407fe7-76bc-4743-8cde-091e1ed8350b-root\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120265 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-tls\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120265 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a407fe7-76bc-4743-8cde-091e1ed8350b-metrics-client-ca\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a407fe7-76bc-4743-8cde-091e1ed8350b-sys\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-accelerators-collector-config\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxnt7\" (UniqueName: \"kubernetes.io/projected/4a407fe7-76bc-4743-8cde-091e1ed8350b-kube-api-access-sxnt7\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-wtmp\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-textfile\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120547 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120476 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a407fe7-76bc-4743-8cde-091e1ed8350b-root\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120847 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.120573 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a407fe7-76bc-4743-8cde-091e1ed8350b-root\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.120847 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:24:06.120680 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 16:24:06.120847 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:24:06.120741 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-tls podName:4a407fe7-76bc-4743-8cde-091e1ed8350b nodeName:}" failed. No retries permitted until 2026-07-07 16:24:06.620721195 +0000 UTC m=+72.730057871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-tls") pod "node-exporter-w4hdv" (UID: "4a407fe7-76bc-4743-8cde-091e1ed8350b") : secret "node-exporter-tls" not found Jul 07 16:24:06.121563 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.121537 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a407fe7-76bc-4743-8cde-091e1ed8350b-metrics-client-ca\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.121673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.121615 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a407fe7-76bc-4743-8cde-091e1ed8350b-sys\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.122038 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.122010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-accelerators-collector-config\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.122412 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.122391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-wtmp\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.123111 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.122943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-textfile\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.125054 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.125029 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.140678 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.140649 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxnt7\" (UniqueName: \"kubernetes.io/projected/4a407fe7-76bc-4743-8cde-091e1ed8350b-kube-api-access-sxnt7\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.624738 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.624711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-tls\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.627062 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.627037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a407fe7-76bc-4743-8cde-091e1ed8350b-node-exporter-tls\") pod \"node-exporter-w4hdv\" (UID: \"4a407fe7-76bc-4743-8cde-091e1ed8350b\") " pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.801749 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.801662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w4hdv" Jul 07 16:24:06.807087 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.806662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlvbc" event={"ID":"9c1363b6-9067-4e74-b135-c8eb7e04b5c3","Type":"ContainerStarted","Data":"8e36467a9b48394db43c1a9e057b522087444476c2c938569b8747ff2285b4e1"} Jul 07 16:24:06.808546 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.808470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzt2h" event={"ID":"b4b914ad-0839-4c7a-81ef-43f4ed47b815","Type":"ContainerStarted","Data":"6cbbb10597faeea0c4613c9ec1af65ab4bc4c6aeef1ca360a86e244abfe93050"} Jul 07 16:24:06.808740 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.808717 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:24:06.813713 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:24:06.813687 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a407fe7_76bc_4743_8cde_091e1ed8350b.slice/crio-7ddaf1087181b8c8f6cd653502458031a11199cc9784ccee6f50cd6496e39f59 WatchSource:0}: Error finding container 7ddaf1087181b8c8f6cd653502458031a11199cc9784ccee6f50cd6496e39f59: Status 404 returned error can't find the container with id 7ddaf1087181b8c8f6cd653502458031a11199cc9784ccee6f50cd6496e39f59 Jul 07 16:24:06.833198 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.833156 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dlvbc" podStartSLOduration=65.854129521 podStartE2EDuration="1m11.833136894s" totalImagesPullingTime="5.979007373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:06.832435239 +0000 UTC m=+72.941771923" watchObservedRunningTime="2026-07-07 16:24:06.833136894 +0000 UTC m=+72.942473580" Jul 07 16:24:06.859141 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.859088 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bzt2h" podStartSLOduration=65.858528772 podStartE2EDuration="1m11.85907265s" totalImagesPullingTime="6.000543878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:06.857958311 +0000 UTC m=+72.967294997" watchObservedRunningTime="2026-07-07 16:24:06.85907265 +0000 UTC m=+72.968409335" Jul 07 16:24:06.972306 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.972267 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 16:24:06.977223 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.977197 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:06.980521 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.980482 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 16:24:06.982562 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.982541 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 16:24:06.982942 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.982885 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 16:24:06.983061 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.983043 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 16:24:06.983154 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.983072 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 16:24:06.983154 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.983145 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kkdxz\"" Jul 07 16:24:06.983300 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.983282 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 16:24:06.983300 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.983290 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 16:24:06.983300 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.983293 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 16:24:06.983600 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.983583 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 16:24:06.996238 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:06.996211 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 16:24:07.028034 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.027997 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028034 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028258 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028258 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028258 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028258 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028205 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028258 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028258 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-web-config\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028464 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028464 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-config-out\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028464 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028311 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028464 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2f4d\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-kube-api-access-j2f4d\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.028464 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.028380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.129446 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.129412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.129647 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.129466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.129726 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:24:07.129705 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 07 16:24:07.129792 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:24:07.129780 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-main-tls podName:863c01be-3420-45f5-8e4f-451dbc8677e9 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:07.629757056 +0000 UTC m=+73.739093720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9") : secret "alertmanager-main-tls" not found Jul 07 16:24:07.130350 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130490 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.129498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130490 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130623 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130623 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130623 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130623 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-web-config\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130820 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130820 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-config-out\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130820 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130820 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2f4d\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-kube-api-access-j2f4d\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.130820 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.130761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.135049 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.131145 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.135049 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.134157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.135049 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.134935 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.135049 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.134932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.135371 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.135067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.136523 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.136479 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.136748 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.136725 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-config-out\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.137902 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.137878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-web-config\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.137902 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.137890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.140694 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.140669 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.152277 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.152248 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2f4d\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-kube-api-access-j2f4d\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.635360 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.635321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.638429 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.638403 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:07.813918 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.813862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w4hdv" event={"ID":"4a407fe7-76bc-4743-8cde-091e1ed8350b","Type":"ContainerStarted","Data":"7ddaf1087181b8c8f6cd653502458031a11199cc9784ccee6f50cd6496e39f59"} Jul 07 16:24:07.888863 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:07.888776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:24:09.399849 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:09.399822 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 16:24:09.401646 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:24:09.401619 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863c01be_3420_45f5_8e4f_451dbc8677e9.slice/crio-6b6efc9fa6cbcdb30b1dcd86ae3d2cc14a62183da6167dc1f0645cf656a2e3c7 WatchSource:0}: Error finding container 6b6efc9fa6cbcdb30b1dcd86ae3d2cc14a62183da6167dc1f0645cf656a2e3c7: Status 404 returned error can't find the container with id 6b6efc9fa6cbcdb30b1dcd86ae3d2cc14a62183da6167dc1f0645cf656a2e3c7 Jul 07 16:24:09.639111 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:09.639077 2562 patch_prober.go:28] interesting pod/image-registry-64dbd44b55-nxqct container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 16:24:09.639278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:09.639129 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" podUID="62d13e68-15fc-4316-8f80-cee20130c5f4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 16:24:09.821967 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:09.821876 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f876dfd96-pdgxf" event={"ID":"1738d6fa-fc1c-4c06-81c5-ad6db3d72022","Type":"ContainerStarted","Data":"f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676"} Jul 07 16:24:09.823481 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:09.823455 2562 generic.go:356] "Generic (PLEG): container finished" podID="4a407fe7-76bc-4743-8cde-091e1ed8350b" containerID="684de72548585a4bbb2e71e75c1140edd58206df996c58c416d2efd0ad00dd48" exitCode=0 Jul 07 16:24:09.823627 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:09.823547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w4hdv" event={"ID":"4a407fe7-76bc-4743-8cde-091e1ed8350b","Type":"ContainerDied","Data":"684de72548585a4bbb2e71e75c1140edd58206df996c58c416d2efd0ad00dd48"} Jul 07 16:24:09.824587 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:09.824569 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerStarted","Data":"6b6efc9fa6cbcdb30b1dcd86ae3d2cc14a62183da6167dc1f0645cf656a2e3c7"} Jul 07 16:24:09.858016 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:09.857974 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f876dfd96-pdgxf" podStartSLOduration=1.484051321 podStartE2EDuration="6.857956259s" totalImagesPullingTime="5.373904938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:09.857688842 +0000 UTC m=+75.967025533" watchObservedRunningTime="2026-07-07 16:24:09.857956259 +0000 UTC m=+75.967292945" Jul 07 16:24:10.241870 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.241834 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-798f978477-m92mg"] Jul 07 16:24:10.244080 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.244052 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.247140 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.247120 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-33fv4lnrs6k0v\"" Jul 07 16:24:10.247140 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.247122 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 16:24:10.247307 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.247204 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 16:24:10.248526 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.248494 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 16:24:10.248633 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.248549 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gjvks\"" Jul 07 16:24:10.248633 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.248576 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 16:24:10.256054 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.256037 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-798f978477-m92mg"] Jul 07 16:24:10.358936 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.358899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad917a8-de69-4508-b3be-ac7602852cdb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.359109 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.358949 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1ad917a8-de69-4508-b3be-ac7602852cdb-metrics-server-audit-profiles\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.359109 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.358980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1ad917a8-de69-4508-b3be-ac7602852cdb-audit-log\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.359109 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.359007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1ad917a8-de69-4508-b3be-ac7602852cdb-secret-metrics-server-client-certs\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.359109 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.359031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ad917a8-de69-4508-b3be-ac7602852cdb-client-ca-bundle\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.359255 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.359108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp477\" (UniqueName: \"kubernetes.io/projected/1ad917a8-de69-4508-b3be-ac7602852cdb-kube-api-access-pp477\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.359255 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.359162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1ad917a8-de69-4508-b3be-ac7602852cdb-secret-metrics-server-tls\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.460230 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.460192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1ad917a8-de69-4508-b3be-ac7602852cdb-metrics-server-audit-profiles\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.460682 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.460238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1ad917a8-de69-4508-b3be-ac7602852cdb-audit-log\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.460682 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.460260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1ad917a8-de69-4508-b3be-ac7602852cdb-secret-metrics-server-client-certs\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.460682 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.460294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ad917a8-de69-4508-b3be-ac7602852cdb-client-ca-bundle\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.460682 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.460320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp477\" (UniqueName: \"kubernetes.io/projected/1ad917a8-de69-4508-b3be-ac7602852cdb-kube-api-access-pp477\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.460682 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.460364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1ad917a8-de69-4508-b3be-ac7602852cdb-secret-metrics-server-tls\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.460682 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.460431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad917a8-de69-4508-b3be-ac7602852cdb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.461006 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.460763 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1ad917a8-de69-4508-b3be-ac7602852cdb-audit-log\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.461138 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.461115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad917a8-de69-4508-b3be-ac7602852cdb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.461551 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.461499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1ad917a8-de69-4508-b3be-ac7602852cdb-metrics-server-audit-profiles\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.463664 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.463609 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1ad917a8-de69-4508-b3be-ac7602852cdb-secret-metrics-server-tls\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.467274 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.464231 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1ad917a8-de69-4508-b3be-ac7602852cdb-secret-metrics-server-client-certs\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.468459 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.468432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ad917a8-de69-4508-b3be-ac7602852cdb-client-ca-bundle\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.470810 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.470782 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp477\" (UniqueName: \"kubernetes.io/projected/1ad917a8-de69-4508-b3be-ac7602852cdb-kube-api-access-pp477\") pod \"metrics-server-798f978477-m92mg\" (UID: \"1ad917a8-de69-4508-b3be-ac7602852cdb\") " pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.553300 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.553210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:10.692773 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.692728 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-798f978477-m92mg"] Jul 07 16:24:10.827971 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:24:10.827891 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad917a8_de69_4508_b3be_ac7602852cdb.slice/crio-c8c6ac578109f4d6716369765dab5d45c0a0517fb1fcdf38ad74103499ea40c5 WatchSource:0}: Error finding container c8c6ac578109f4d6716369765dab5d45c0a0517fb1fcdf38ad74103499ea40c5: Status 404 returned error can't find the container with id c8c6ac578109f4d6716369765dab5d45c0a0517fb1fcdf38ad74103499ea40c5 Jul 07 16:24:10.832012 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.831438 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w4hdv" event={"ID":"4a407fe7-76bc-4743-8cde-091e1ed8350b","Type":"ContainerStarted","Data":"c11842a9a9393b587db5a27de0bbee469e2b3a7385d49510ce1060e34558e055"} Jul 07 16:24:10.832012 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.831531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w4hdv" event={"ID":"4a407fe7-76bc-4743-8cde-091e1ed8350b","Type":"ContainerStarted","Data":"c50d0c91c99e6a17ebc57ffbd07a434733553217fe80f8681d2174d8466c4bab"} Jul 07 16:24:10.855684 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:10.855641 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w4hdv" podStartSLOduration=3.329802745 podStartE2EDuration="5.855625397s" totalImagesPullingTime="2.433081353s" totalInitContainerRuntime="92.741299ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:10.853728842 +0000 UTC m=+76.963065526" watchObservedRunningTime="2026-07-07 16:24:10.855625397 +0000 UTC m=+76.964962082" Jul 07 16:24:11.100124 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.100039 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9bbc96f79-bn4kj"] Jul 07 16:24:11.102240 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.102223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.115014 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.114990 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 16:24:11.115127 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.114993 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 16:24:11.116684 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.116667 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 16:24:11.118247 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.118231 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 16:24:11.118385 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.118371 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mjgdv\"" Jul 07 16:24:11.119927 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.119911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 16:24:11.148359 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.148331 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 16:24:11.166071 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.166043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d631939-f628-4e41-90ac-96b85d4b0e53-metrics-client-ca\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.166213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.166078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-secret-telemeter-client\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.166213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.166112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-telemeter-client-tls\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.166213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.166202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4czk\" (UniqueName: \"kubernetes.io/projected/3d631939-f628-4e41-90ac-96b85d4b0e53-kube-api-access-k4czk\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.166334 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.166224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d631939-f628-4e41-90ac-96b85d4b0e53-serving-certs-ca-bundle\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.166334 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.166249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-federate-client-tls\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.166334 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.166293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d631939-f628-4e41-90ac-96b85d4b0e53-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.166334 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.166323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.203832 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.203780 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9bbc96f79-bn4kj"] Jul 07 16:24:11.267132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.267100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d631939-f628-4e41-90ac-96b85d4b0e53-metrics-client-ca\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.267292 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.267137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-secret-telemeter-client\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.267292 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.267163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-telemeter-client-tls\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.267292 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.267195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4czk\" (UniqueName: \"kubernetes.io/projected/3d631939-f628-4e41-90ac-96b85d4b0e53-kube-api-access-k4czk\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.267292 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.267219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d631939-f628-4e41-90ac-96b85d4b0e53-serving-certs-ca-bundle\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.267530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.267412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-federate-client-tls\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.267530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.267475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d631939-f628-4e41-90ac-96b85d4b0e53-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.267643 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.267541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.268239 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.268057 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d631939-f628-4e41-90ac-96b85d4b0e53-metrics-client-ca\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.268239 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.268066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d631939-f628-4e41-90ac-96b85d4b0e53-serving-certs-ca-bundle\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.268963 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.268941 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d631939-f628-4e41-90ac-96b85d4b0e53-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.269985 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.269957 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-telemeter-client-tls\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.270135 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.270037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-federate-client-tls\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.270378 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.270360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-secret-telemeter-client\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.270436 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.270373 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d631939-f628-4e41-90ac-96b85d4b0e53-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.278776 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.278750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4czk\" (UniqueName: \"kubernetes.io/projected/3d631939-f628-4e41-90ac-96b85d4b0e53-kube-api-access-k4czk\") pod \"telemeter-client-9bbc96f79-bn4kj\" (UID: \"3d631939-f628-4e41-90ac-96b85d4b0e53\") " pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.410938 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.410899 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" Jul 07 16:24:11.546899 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.546863 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9bbc96f79-bn4kj"] Jul 07 16:24:11.549635 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:24:11.549608 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d631939_f628_4e41_90ac_96b85d4b0e53.slice/crio-57ad8e3428f77022a03a8645b2b0f346efc77e52732c1a763af5bb9152c203b0 WatchSource:0}: Error finding container 57ad8e3428f77022a03a8645b2b0f346efc77e52732c1a763af5bb9152c203b0: Status 404 returned error can't find the container with id 57ad8e3428f77022a03a8645b2b0f346efc77e52732c1a763af5bb9152c203b0 Jul 07 16:24:11.736277 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.736186 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64dbd44b55-nxqct" Jul 07 16:24:11.837235 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.837190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" event={"ID":"3d631939-f628-4e41-90ac-96b85d4b0e53","Type":"ContainerStarted","Data":"57ad8e3428f77022a03a8645b2b0f346efc77e52732c1a763af5bb9152c203b0"} Jul 07 16:24:11.838596 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.838559 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-798f978477-m92mg" event={"ID":"1ad917a8-de69-4508-b3be-ac7602852cdb","Type":"ContainerStarted","Data":"c8c6ac578109f4d6716369765dab5d45c0a0517fb1fcdf38ad74103499ea40c5"} Jul 07 16:24:11.840079 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.840051 2562 generic.go:356] "Generic (PLEG): container finished" podID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerID="c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549" exitCode=0 Jul 07 16:24:11.840215 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:11.840144 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerDied","Data":"c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549"} Jul 07 16:24:12.148712 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.148670 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:24:12.151368 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.151345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.156498 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.156473 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 16:24:12.156656 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.156632 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 16:24:12.157047 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.157030 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 16:24:12.158144 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.158114 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 16:24:12.159138 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.159105 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 16:24:12.159138 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.159126 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 16:24:12.159278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.159179 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 16:24:12.159278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.159247 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 16:24:12.160778 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.160757 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 16:24:12.160778 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.160774 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 16:24:12.160924 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.160885 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-glsg9bjj41tq\"" Jul 07 16:24:12.160924 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.160899 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 16:24:12.160997 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.160931 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 16:24:12.161103 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.161075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 16:24:12.161315 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.161301 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cjvjx\"" Jul 07 16:24:12.164913 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.164894 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 16:24:12.176718 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.176699 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:24:12.276584 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm28f\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-kube-api-access-dm28f\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.276772 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.276772 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.276772 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.276772 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.276955 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-config\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.276955 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.276955 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.276955 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.276955 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277183 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277183 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.276986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277183 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.277005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277183 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.277023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-config-out\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277183 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.277100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277183 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.277131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-web-config\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277183 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.277181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277442 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.277230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277442 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.277261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.277442 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.277283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.379103 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.378599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.379103 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.378639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-config\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.379103 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.378668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.379103 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.378704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380035 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380172 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380236 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380236 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380334 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380334 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380334 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-config-out\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380477 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380477 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-web-config\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380477 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380477 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380477 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380762 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380762 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm28f\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-kube-api-access-dm28f\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380762 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380762 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.380762 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.380660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.381273 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.381102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.381454 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.381429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.381775 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.381748 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.383957 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.382403 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.383957 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.383192 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.383957 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.383706 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.384214 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.384181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.384258 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.384215 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.384640 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.384603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.385662 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.385606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-config-out\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.385898 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.385852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.386396 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.386346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.386533 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.386488 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.387186 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.387157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-web-config\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.387683 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.387645 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.388370 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.388042 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.388370 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.388337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-config\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.388598 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.388576 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.395904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.395875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm28f\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-kube-api-access-dm28f\") pod \"prometheus-k8s-0\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.461853 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.461728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:12.935877 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:12.935782 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:24:12.943259 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:24:12.943052 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde58e444_5339_4d04_8083_cadf08c75917.slice/crio-7e400a9f44b05a324f91c9a950af54d5c7accd1423a7f2961222680e71bd6de1 WatchSource:0}: Error finding container 7e400a9f44b05a324f91c9a950af54d5c7accd1423a7f2961222680e71bd6de1: Status 404 returned error can't find the container with id 7e400a9f44b05a324f91c9a950af54d5c7accd1423a7f2961222680e71bd6de1 Jul 07 16:24:13.714161 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:13.714109 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:13.714342 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:13.714200 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:13.724703 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:13.724632 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:13.849748 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:13.849713 2562 generic.go:356] "Generic (PLEG): container finished" podID="de58e444-5339-4d04-8083-cadf08c75917" containerID="9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35" exitCode=0 Jul 07 16:24:13.849942 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:13.849813 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerDied","Data":"9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35"} Jul 07 16:24:13.849942 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:13.849908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerStarted","Data":"7e400a9f44b05a324f91c9a950af54d5c7accd1423a7f2961222680e71bd6de1"} Jul 07 16:24:13.852730 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:13.852683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-798f978477-m92mg" event={"ID":"1ad917a8-de69-4508-b3be-ac7602852cdb","Type":"ContainerStarted","Data":"c148061bd1d8feea20a745e2ae444219107debbad538570c70d3d5919a62e775"} Jul 07 16:24:13.857494 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:13.857471 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:13.906204 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:13.906149 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-798f978477-m92mg" podStartSLOduration=1.908940529 podStartE2EDuration="3.90613385s" totalImagesPullingTime="1.997193321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:13.905804858 +0000 UTC m=+80.015141542" watchObservedRunningTime="2026-07-07 16:24:13.90613385 +0000 UTC m=+80.015470513" Jul 07 16:24:14.859243 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:14.859147 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" event={"ID":"3d631939-f628-4e41-90ac-96b85d4b0e53","Type":"ContainerStarted","Data":"f0fd9c593f6b616e7a5a80d48d72ea2a40b88726b8410d1abe6f0db25170083e"} Jul 07 16:24:14.859243 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:14.859228 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" event={"ID":"3d631939-f628-4e41-90ac-96b85d4b0e53","Type":"ContainerStarted","Data":"7f24ea146ced25b12000fef65f36c4c637dc2313a862c40922ddc86ff0c99c26"} Jul 07 16:24:14.859731 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:14.859263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" event={"ID":"3d631939-f628-4e41-90ac-96b85d4b0e53","Type":"ContainerStarted","Data":"e03e5e72d6ca60d7660b7153a8bde94cf3c60ece10e57185ec8f4e341dca5e8c"} Jul 07 16:24:14.863049 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:14.863015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerStarted","Data":"c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c"} Jul 07 16:24:14.863205 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:14.863100 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerStarted","Data":"abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882"} Jul 07 16:24:14.863205 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:14.863149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerStarted","Data":"4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024"} Jul 07 16:24:14.863205 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:14.863190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerStarted","Data":"eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a"} Jul 07 16:24:14.863375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:14.863230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerStarted","Data":"c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904"} Jul 07 16:24:14.886408 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:14.886342 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9bbc96f79-bn4kj" podStartSLOduration=1.132963673 podStartE2EDuration="3.886321326s" totalImagesPullingTime="2.753357653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:14.884964324 +0000 UTC m=+80.994301011" watchObservedRunningTime="2026-07-07 16:24:14.886321326 +0000 UTC m=+80.995658012" Jul 07 16:24:15.872574 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:15.872532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerStarted","Data":"a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825"} Jul 07 16:24:15.910066 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:15.910013 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.246079132 podStartE2EDuration="9.909995452s" totalImagesPullingTime="4.647934743s" totalInitContainerRuntime="15.981577ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:15.907125243 +0000 UTC m=+82.016461918" watchObservedRunningTime="2026-07-07 16:24:15.909995452 +0000 UTC m=+82.019332137" Jul 07 16:24:17.887580 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:17.887545 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerStarted","Data":"4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed"} Jul 07 16:24:17.888026 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:17.887722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerStarted","Data":"8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d"} Jul 07 16:24:20.903224 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:20.903188 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerStarted","Data":"6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15"} Jul 07 16:24:20.903744 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:20.903251 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerStarted","Data":"f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece"} Jul 07 16:24:20.903744 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:20.903276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerStarted","Data":"ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b"} Jul 07 16:24:20.903744 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:20.903299 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerStarted","Data":"5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e"} Jul 07 16:24:20.940980 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:20.940930 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.614955824 podStartE2EDuration="8.940909052s" totalImagesPullingTime="6.297280182s" totalInitContainerRuntime="28.673046ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:20.938836469 +0000 UTC m=+87.048173166" watchObservedRunningTime="2026-07-07 16:24:20.940909052 +0000 UTC m=+87.050245737" Jul 07 16:24:22.462228 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:22.462194 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:24:26.123381 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:26.123331 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f876dfd96-pdgxf"] Jul 07 16:24:30.554188 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:30.554137 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:30.554605 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:30.554217 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:37.816388 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:37.816352 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bzt2h" Jul 07 16:24:50.559551 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:50.559494 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:50.563522 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:50.563479 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-798f978477-m92mg" Jul 07 16:24:51.144694 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.144630 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f876dfd96-pdgxf" podUID="1738d6fa-fc1c-4c06-81c5-ad6db3d72022" containerName="console" containerID="cri-o://f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676" gracePeriod=15 Jul 07 16:24:51.422711 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.422633 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:51.526869 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.526831 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-trusted-ca-bundle\") pod \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " Jul 07 16:24:51.526869 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.526880 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njqb5\" (UniqueName: \"kubernetes.io/projected/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-kube-api-access-njqb5\") pod \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " Jul 07 16:24:51.527132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.526941 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-service-ca\") pod \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " Jul 07 16:24:51.527132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.526975 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-config\") pod \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " Jul 07 16:24:51.527132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.527003 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-oauth-serving-cert\") pod \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " Jul 07 16:24:51.527132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.527028 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-oauth-config\") pod \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " Jul 07 16:24:51.527132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.527059 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-serving-cert\") pod \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\" (UID: \"1738d6fa-fc1c-4c06-81c5-ad6db3d72022\") " Jul 07 16:24:51.527390 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.527361 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1738d6fa-fc1c-4c06-81c5-ad6db3d72022" (UID: "1738d6fa-fc1c-4c06-81c5-ad6db3d72022"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:51.527458 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.527405 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-service-ca" (OuterVolumeSpecName: "service-ca") pod "1738d6fa-fc1c-4c06-81c5-ad6db3d72022" (UID: "1738d6fa-fc1c-4c06-81c5-ad6db3d72022"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:51.527541 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.527455 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-config" (OuterVolumeSpecName: "console-config") pod "1738d6fa-fc1c-4c06-81c5-ad6db3d72022" (UID: "1738d6fa-fc1c-4c06-81c5-ad6db3d72022"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:51.527605 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.527535 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1738d6fa-fc1c-4c06-81c5-ad6db3d72022" (UID: "1738d6fa-fc1c-4c06-81c5-ad6db3d72022"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:51.529447 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.529422 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-kube-api-access-njqb5" (OuterVolumeSpecName: "kube-api-access-njqb5") pod "1738d6fa-fc1c-4c06-81c5-ad6db3d72022" (UID: "1738d6fa-fc1c-4c06-81c5-ad6db3d72022"). InnerVolumeSpecName "kube-api-access-njqb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:24:51.529663 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.529443 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1738d6fa-fc1c-4c06-81c5-ad6db3d72022" (UID: "1738d6fa-fc1c-4c06-81c5-ad6db3d72022"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:24:51.529663 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.529482 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1738d6fa-fc1c-4c06-81c5-ad6db3d72022" (UID: "1738d6fa-fc1c-4c06-81c5-ad6db3d72022"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:24:51.628522 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.628465 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-service-ca\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:24:51.628522 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.628497 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:24:51.628522 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.628530 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-oauth-serving-cert\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:24:51.628950 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.628539 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-oauth-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:24:51.628950 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.628548 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-console-serving-cert\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:24:51.628950 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.628557 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-trusted-ca-bundle\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:24:51.628950 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:51.628565 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njqb5\" (UniqueName: \"kubernetes.io/projected/1738d6fa-fc1c-4c06-81c5-ad6db3d72022-kube-api-access-njqb5\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:24:52.027599 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.026702 2562 generic.go:356] "Generic (PLEG): container finished" podID="1738d6fa-fc1c-4c06-81c5-ad6db3d72022" containerID="f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676" exitCode=0 Jul 07 16:24:52.027599 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.026760 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f876dfd96-pdgxf" Jul 07 16:24:52.027599 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.026839 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f876dfd96-pdgxf" event={"ID":"1738d6fa-fc1c-4c06-81c5-ad6db3d72022","Type":"ContainerDied","Data":"f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676"} Jul 07 16:24:52.027599 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.026883 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f876dfd96-pdgxf" event={"ID":"1738d6fa-fc1c-4c06-81c5-ad6db3d72022","Type":"ContainerDied","Data":"6af1625790804809a9781e2cbf07c2b9d778c3cc3f0a4454173bbfea4f85a52d"} Jul 07 16:24:52.027599 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.026909 2562 scope.go:117] "RemoveContainer" containerID="f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676" Jul 07 16:24:52.040171 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.040144 2562 scope.go:117] "RemoveContainer" containerID="f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676" Jul 07 16:24:52.040536 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:24:52.040493 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676\": container with ID starting with f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676 not found: ID does not exist" containerID="f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676" Jul 07 16:24:52.040622 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.040545 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676"} err="failed to get container status \"f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676\": rpc error: code = NotFound desc = could not find container \"f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676\": container with ID starting with f6d94d83598742e903bdd83f743c0fb4afbf776f191a9665957fb11025792676 not found: ID does not exist" Jul 07 16:24:52.053138 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.053107 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f876dfd96-pdgxf"] Jul 07 16:24:52.056443 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.056418 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f876dfd96-pdgxf"] Jul 07 16:24:52.463118 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:24:52.463087 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1738d6fa-fc1c-4c06-81c5-ad6db3d72022" path="/var/lib/kubelet/pods/1738d6fa-fc1c-4c06-81c5-ad6db3d72022/volumes" Jul 07 16:25:12.462499 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:12.462469 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:12.482184 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:12.482158 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:13.119770 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:13.119739 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:26.302946 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:26.302904 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 16:25:26.303450 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:26.303231 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="alertmanager" containerID="cri-o://c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904" gracePeriod=120 Jul 07 16:25:26.303450 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:26.303266 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy-metric" containerID="cri-o://c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c" gracePeriod=120 Jul 07 16:25:26.303450 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:26.303323 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy-web" containerID="cri-o://4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024" gracePeriod=120 Jul 07 16:25:26.303450 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:26.303353 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy" containerID="cri-o://abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882" gracePeriod=120 Jul 07 16:25:26.303450 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:26.303319 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="prom-label-proxy" containerID="cri-o://a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825" gracePeriod=120 Jul 07 16:25:26.303450 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:26.303387 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="config-reloader" containerID="cri-o://eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a" gracePeriod=120 Jul 07 16:25:27.161122 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.161086 2562 generic.go:356] "Generic (PLEG): container finished" podID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerID="a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825" exitCode=0 Jul 07 16:25:27.161122 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.161110 2562 generic.go:356] "Generic (PLEG): container finished" podID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerID="abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882" exitCode=0 Jul 07 16:25:27.161122 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.161117 2562 generic.go:356] "Generic (PLEG): container finished" podID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerID="eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a" exitCode=0 Jul 07 16:25:27.161122 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.161123 2562 generic.go:356] "Generic (PLEG): container finished" podID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerID="c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904" exitCode=0 Jul 07 16:25:27.161375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.161153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerDied","Data":"a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825"} Jul 07 16:25:27.161375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.161211 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerDied","Data":"abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882"} Jul 07 16:25:27.161375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.161236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerDied","Data":"eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a"} Jul 07 16:25:27.161375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.161261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerDied","Data":"c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904"} Jul 07 16:25:27.554128 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.554097 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:27.634021 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.633982 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-trusted-ca-bundle\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634224 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634034 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-metrics-client-ca\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634224 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634169 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-web-config\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634350 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634226 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634350 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634256 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634350 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634284 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-config-out\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634350 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634320 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-main-tls\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634359 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-config-volume\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634382 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-cluster-tls-config\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634404 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:25:27.634568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634433 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-tls-assets\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634439 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:25:27.634568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634457 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2f4d\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-kube-api-access-j2f4d\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634486 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.634568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634554 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-main-db\") pod \"863c01be-3420-45f5-8e4f-451dbc8677e9\" (UID: \"863c01be-3420-45f5-8e4f-451dbc8677e9\") " Jul 07 16:25:27.635071 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634977 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.635071 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.634995 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/863c01be-3420-45f5-8e4f-451dbc8677e9-metrics-client-ca\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.635617 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.635334 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:25:27.637715 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.637662 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:27.637877 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.637854 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-kube-api-access-j2f4d" (OuterVolumeSpecName: "kube-api-access-j2f4d") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "kube-api-access-j2f4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:25:27.638346 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.638313 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-config-volume" (OuterVolumeSpecName: "config-volume") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:27.638962 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.638938 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:27.639430 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.639397 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:27.639934 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.639913 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:25:27.640045 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.640025 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:27.640781 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.640747 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-config-out" (OuterVolumeSpecName: "config-out") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:25:27.642687 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.642646 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:27.648953 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.648926 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-web-config" (OuterVolumeSpecName: "web-config") pod "863c01be-3420-45f5-8e4f-451dbc8677e9" (UID: "863c01be-3420-45f5-8e4f-451dbc8677e9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:27.735904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735826 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-tls-assets\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.735904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735856 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2f4d\" (UniqueName: \"kubernetes.io/projected/863c01be-3420-45f5-8e4f-451dbc8677e9-kube-api-access-j2f4d\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.735904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735869 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.735904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735878 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-alertmanager-main-db\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.735904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735887 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-web-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.735904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735895 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.735904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735903 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.736205 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735912 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/863c01be-3420-45f5-8e4f-451dbc8677e9-config-out\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.736205 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735921 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-secret-alertmanager-main-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.736205 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735929 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-config-volume\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:27.736205 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:27.735937 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/863c01be-3420-45f5-8e4f-451dbc8677e9-cluster-tls-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:28.168407 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.168370 2562 generic.go:356] "Generic (PLEG): container finished" podID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerID="c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c" exitCode=0 Jul 07 16:25:28.168407 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.168399 2562 generic.go:356] "Generic (PLEG): container finished" podID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerID="4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024" exitCode=0 Jul 07 16:25:28.168674 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.168437 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerDied","Data":"c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c"} Jul 07 16:25:28.168674 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.168446 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.168674 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.168570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerDied","Data":"4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024"} Jul 07 16:25:28.168674 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.168613 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"863c01be-3420-45f5-8e4f-451dbc8677e9","Type":"ContainerDied","Data":"6b6efc9fa6cbcdb30b1dcd86ae3d2cc14a62183da6167dc1f0645cf656a2e3c7"} Jul 07 16:25:28.168674 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.168644 2562 scope.go:117] "RemoveContainer" containerID="a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825" Jul 07 16:25:28.177814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.177793 2562 scope.go:117] "RemoveContainer" containerID="c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c" Jul 07 16:25:28.185192 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.185175 2562 scope.go:117] "RemoveContainer" containerID="abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882" Jul 07 16:25:28.191859 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.191842 2562 scope.go:117] "RemoveContainer" containerID="4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024" Jul 07 16:25:28.198611 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.198586 2562 scope.go:117] "RemoveContainer" containerID="eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a" Jul 07 16:25:28.201271 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.201247 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 16:25:28.207154 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.207136 2562 scope.go:117] "RemoveContainer" containerID="c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904" Jul 07 16:25:28.207683 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.207662 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 16:25:28.215245 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.215224 2562 scope.go:117] "RemoveContainer" containerID="c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549" Jul 07 16:25:28.222254 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.222233 2562 scope.go:117] "RemoveContainer" containerID="a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825" Jul 07 16:25:28.222551 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:28.222529 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825\": container with ID starting with a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825 not found: ID does not exist" containerID="a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825" Jul 07 16:25:28.222614 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.222559 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825"} err="failed to get container status \"a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825\": rpc error: code = NotFound desc = could not find container \"a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825\": container with ID starting with a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825 not found: ID does not exist" Jul 07 16:25:28.222614 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.222577 2562 scope.go:117] "RemoveContainer" containerID="c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c" Jul 07 16:25:28.222838 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:28.222821 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c\": container with ID starting with c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c not found: ID does not exist" containerID="c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c" Jul 07 16:25:28.222892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.222841 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c"} err="failed to get container status \"c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c\": rpc error: code = NotFound desc = could not find container \"c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c\": container with ID starting with c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c not found: ID does not exist" Jul 07 16:25:28.222892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.222855 2562 scope.go:117] "RemoveContainer" containerID="abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882" Jul 07 16:25:28.223065 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:28.223052 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882\": container with ID starting with abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882 not found: ID does not exist" containerID="abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882" Jul 07 16:25:28.223109 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.223070 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882"} err="failed to get container status \"abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882\": rpc error: code = NotFound desc = could not find container \"abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882\": container with ID starting with abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882 not found: ID does not exist" Jul 07 16:25:28.223109 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.223082 2562 scope.go:117] "RemoveContainer" containerID="4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024" Jul 07 16:25:28.223285 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:28.223267 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024\": container with ID starting with 4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024 not found: ID does not exist" containerID="4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024" Jul 07 16:25:28.223320 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.223289 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024"} err="failed to get container status \"4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024\": rpc error: code = NotFound desc = could not find container \"4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024\": container with ID starting with 4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024 not found: ID does not exist" Jul 07 16:25:28.223320 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.223303 2562 scope.go:117] "RemoveContainer" containerID="eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a" Jul 07 16:25:28.223495 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:28.223480 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a\": container with ID starting with eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a not found: ID does not exist" containerID="eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a" Jul 07 16:25:28.223560 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.223498 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a"} err="failed to get container status \"eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a\": rpc error: code = NotFound desc = could not find container \"eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a\": container with ID starting with eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a not found: ID does not exist" Jul 07 16:25:28.223597 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.223562 2562 scope.go:117] "RemoveContainer" containerID="c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904" Jul 07 16:25:28.223783 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:28.223761 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904\": container with ID starting with c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904 not found: ID does not exist" containerID="c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904" Jul 07 16:25:28.223823 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.223793 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904"} err="failed to get container status \"c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904\": rpc error: code = NotFound desc = could not find container \"c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904\": container with ID starting with c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904 not found: ID does not exist" Jul 07 16:25:28.223823 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.223819 2562 scope.go:117] "RemoveContainer" containerID="c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549" Jul 07 16:25:28.224067 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:28.224049 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549\": container with ID starting with c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549 not found: ID does not exist" containerID="c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549" Jul 07 16:25:28.224121 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224073 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549"} err="failed to get container status \"c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549\": rpc error: code = NotFound desc = could not find container \"c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549\": container with ID starting with c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549 not found: ID does not exist" Jul 07 16:25:28.224121 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224089 2562 scope.go:117] "RemoveContainer" containerID="a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825" Jul 07 16:25:28.224327 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224309 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825"} err="failed to get container status \"a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825\": rpc error: code = NotFound desc = could not find container \"a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825\": container with ID starting with a60b78774219d354d647bdd7a1d2f6423c2259b00ce7d7a5fac0251c10d1e825 not found: ID does not exist" Jul 07 16:25:28.224371 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224332 2562 scope.go:117] "RemoveContainer" containerID="c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c" Jul 07 16:25:28.224556 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224538 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c"} err="failed to get container status \"c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c\": rpc error: code = NotFound desc = could not find container \"c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c\": container with ID starting with c993b98c379e93bb6587b1936d280eb718f3f51656fd69460949d6fd95c3d90c not found: ID does not exist" Jul 07 16:25:28.224556 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224556 2562 scope.go:117] "RemoveContainer" containerID="abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882" Jul 07 16:25:28.224778 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224761 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882"} err="failed to get container status \"abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882\": rpc error: code = NotFound desc = could not find container \"abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882\": container with ID starting with abaf7ee705d5b0080b61fb4b2aa964cc4b9715fcb2a9aa47efbc690e79e71882 not found: ID does not exist" Jul 07 16:25:28.224817 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224777 2562 scope.go:117] "RemoveContainer" containerID="4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024" Jul 07 16:25:28.225001 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224974 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024"} err="failed to get container status \"4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024\": rpc error: code = NotFound desc = could not find container \"4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024\": container with ID starting with 4cce02ba3f3ba6abaaa61c5f7158abe30fd54b69ba9a04999520a2f6ce014024 not found: ID does not exist" Jul 07 16:25:28.225001 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.224993 2562 scope.go:117] "RemoveContainer" containerID="eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a" Jul 07 16:25:28.225195 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.225179 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a"} err="failed to get container status \"eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a\": rpc error: code = NotFound desc = could not find container \"eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a\": container with ID starting with eabf2f5023c06c456ad943179841eee811ae46f6db0e010eebfadd849b9e088a not found: ID does not exist" Jul 07 16:25:28.225310 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.225196 2562 scope.go:117] "RemoveContainer" containerID="c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904" Jul 07 16:25:28.225405 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.225385 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904"} err="failed to get container status \"c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904\": rpc error: code = NotFound desc = could not find container \"c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904\": container with ID starting with c24671c8469cde0fa69a675d7f20ff9432b2d12b7fc1bc4243ddc7886a957904 not found: ID does not exist" Jul 07 16:25:28.225443 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.225406 2562 scope.go:117] "RemoveContainer" containerID="c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549" Jul 07 16:25:28.225626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.225593 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549"} err="failed to get container status \"c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549\": rpc error: code = NotFound desc = could not find container \"c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549\": container with ID starting with c2deb85744bb37f93b1d932fb968e16bc0e12ffe2d127c30dfbfaffadbf95549 not found: ID does not exist" Jul 07 16:25:28.246313 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246285 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 16:25:28.246576 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246563 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="alertmanager" Jul 07 16:25:28.246576 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246577 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="alertmanager" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246587 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="init-config-reloader" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246593 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="init-config-reloader" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246600 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246605 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246610 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy-metric" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246615 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy-metric" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246622 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy-web" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246627 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy-web" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246638 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="config-reloader" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246643 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="config-reloader" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246652 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="prom-label-proxy" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246657 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="prom-label-proxy" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246665 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1738d6fa-fc1c-4c06-81c5-ad6db3d72022" containerName="console" Jul 07 16:25:28.246673 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246670 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1738d6fa-fc1c-4c06-81c5-ad6db3d72022" containerName="console" Jul 07 16:25:28.247062 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246708 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="alertmanager" Jul 07 16:25:28.247062 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246714 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="config-reloader" Jul 07 16:25:28.247062 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246720 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="prom-label-proxy" Jul 07 16:25:28.247062 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246726 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy-web" Jul 07 16:25:28.247062 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246731 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy" Jul 07 16:25:28.247062 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246736 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" containerName="kube-rbac-proxy-metric" Jul 07 16:25:28.247062 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.246743 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1738d6fa-fc1c-4c06-81c5-ad6db3d72022" containerName="console" Jul 07 16:25:28.251486 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.251469 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.255626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.255417 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 16:25:28.255626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.255455 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 16:25:28.255626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.255473 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 16:25:28.255626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.255479 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 16:25:28.255626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.255495 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kkdxz\"" Jul 07 16:25:28.255626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.255474 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 16:25:28.255626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.255567 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 16:25:28.255626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.255577 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 16:25:28.256099 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.256066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 16:25:28.260899 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.260878 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 16:25:28.276462 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.276437 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 16:25:28.340534 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z69w\" (UniqueName: \"kubernetes.io/projected/af182342-9f4a-4185-8979-2655600aed67-kube-api-access-4z69w\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.340534 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af182342-9f4a-4185-8979-2655600aed67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.340765 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340572 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.340765 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.340765 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340626 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af182342-9f4a-4185-8979-2655600aed67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.340765 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.340765 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.340765 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-web-config\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.340765 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af182342-9f4a-4185-8979-2655600aed67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.340765 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af182342-9f4a-4185-8979-2655600aed67-config-out\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.341033 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.341033 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-config-volume\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.341033 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.340889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af182342-9f4a-4185-8979-2655600aed67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.441847 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.441743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-config-volume\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.441847 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.441783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af182342-9f4a-4185-8979-2655600aed67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.441847 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.441805 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z69w\" (UniqueName: \"kubernetes.io/projected/af182342-9f4a-4185-8979-2655600aed67-kube-api-access-4z69w\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442163 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.441948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af182342-9f4a-4185-8979-2655600aed67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442163 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.441997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442163 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442163 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af182342-9f4a-4185-8979-2655600aed67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442163 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442260 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af182342-9f4a-4185-8979-2655600aed67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-web-config\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af182342-9f4a-4185-8979-2655600aed67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af182342-9f4a-4185-8979-2655600aed67-config-out\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.442751 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.442682 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af182342-9f4a-4185-8979-2655600aed67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.443851 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.443820 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af182342-9f4a-4185-8979-2655600aed67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.445458 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.445166 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af182342-9f4a-4185-8979-2655600aed67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.445458 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.445204 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-config-volume\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.445458 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.445294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.445458 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.445362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.445458 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.445421 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.445729 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.445484 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.446214 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.446185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.446340 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.446324 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af182342-9f4a-4185-8979-2655600aed67-web-config\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.447047 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.447031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af182342-9f4a-4185-8979-2655600aed67-config-out\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.452993 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.452961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z69w\" (UniqueName: \"kubernetes.io/projected/af182342-9f4a-4185-8979-2655600aed67-kube-api-access-4z69w\") pod \"alertmanager-main-0\" (UID: \"af182342-9f4a-4185-8979-2655600aed67\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.462445 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.462420 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="863c01be-3420-45f5-8e4f-451dbc8677e9" path="/var/lib/kubelet/pods/863c01be-3420-45f5-8e4f-451dbc8677e9/volumes" Jul 07 16:25:28.560764 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.560716 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 16:25:28.707354 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:28.707327 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 16:25:28.709127 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:25:28.709101 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf182342_9f4a_4185_8979_2655600aed67.slice/crio-c123cb7520968023a858690523dbc1ddecf2680f571eaef8e3ea641f05e5cbe7 WatchSource:0}: Error finding container c123cb7520968023a858690523dbc1ddecf2680f571eaef8e3ea641f05e5cbe7: Status 404 returned error can't find the container with id c123cb7520968023a858690523dbc1ddecf2680f571eaef8e3ea641f05e5cbe7 Jul 07 16:25:29.173891 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:29.173853 2562 generic.go:356] "Generic (PLEG): container finished" podID="af182342-9f4a-4185-8979-2655600aed67" containerID="2ffb7c1d5f58a3c0d5e175d1c78b69ee8824f6672d5f5ba0c10e29807f399955" exitCode=0 Jul 07 16:25:29.174088 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:29.173945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af182342-9f4a-4185-8979-2655600aed67","Type":"ContainerDied","Data":"2ffb7c1d5f58a3c0d5e175d1c78b69ee8824f6672d5f5ba0c10e29807f399955"} Jul 07 16:25:29.174088 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:29.174074 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af182342-9f4a-4185-8979-2655600aed67","Type":"ContainerStarted","Data":"c123cb7520968023a858690523dbc1ddecf2680f571eaef8e3ea641f05e5cbe7"} Jul 07 16:25:30.182232 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.182198 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af182342-9f4a-4185-8979-2655600aed67","Type":"ContainerStarted","Data":"9232f68223fa0f29694a658253ecba2d909f18c75d8a708eb19e24f12c0183c1"} Jul 07 16:25:30.182658 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.182265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af182342-9f4a-4185-8979-2655600aed67","Type":"ContainerStarted","Data":"5c177c23c28403b7b32d21a278cbb33b7ae0b590bf43a998dd34d306d2df3286"} Jul 07 16:25:30.182658 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.182291 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af182342-9f4a-4185-8979-2655600aed67","Type":"ContainerStarted","Data":"1900fd7e567a1006b5a33e1a682252bfbc8a651fb0c80e8925de2292dbda0dc3"} Jul 07 16:25:30.182658 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.182315 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af182342-9f4a-4185-8979-2655600aed67","Type":"ContainerStarted","Data":"bab809d5c99106174dfdf3af99961c5189d064f3cd4fca863f64a55981764ebe"} Jul 07 16:25:30.182658 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.182338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af182342-9f4a-4185-8979-2655600aed67","Type":"ContainerStarted","Data":"a595cdbb0c1e23f804f5bbf7aaaad7037bb42b5c70ca97adcb0164e74ee28e68"} Jul 07 16:25:30.182658 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.182360 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af182342-9f4a-4185-8979-2655600aed67","Type":"ContainerStarted","Data":"ea9bd570fc9819e797f43bb3094cc188901cc19a7580c51683e52320dbf8dadd"} Jul 07 16:25:30.216867 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.216794 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.201080164 podStartE2EDuration="2.216768511s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.688347ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:25:30.21359735 +0000 UTC m=+156.322934036" watchObservedRunningTime="2026-07-07 16:25:30.216768511 +0000 UTC m=+156.326105201" Jul 07 16:25:30.519872 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.519780 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:25:30.520275 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.520075 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="prometheus" containerID="cri-o://8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d" gracePeriod=600 Jul 07 16:25:30.520275 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.520090 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy" containerID="cri-o://f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece" gracePeriod=600 Jul 07 16:25:30.520275 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.520252 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy-web" containerID="cri-o://ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b" gracePeriod=600 Jul 07 16:25:30.520275 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.520259 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15" gracePeriod=600 Jul 07 16:25:30.520569 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.520300 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="config-reloader" containerID="cri-o://4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed" gracePeriod=600 Jul 07 16:25:30.520569 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:30.520333 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="thanos-sidecar" containerID="cri-o://5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e" gracePeriod=600 Jul 07 16:25:31.190315 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190278 2562 generic.go:356] "Generic (PLEG): container finished" podID="de58e444-5339-4d04-8083-cadf08c75917" containerID="6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15" exitCode=0 Jul 07 16:25:31.190315 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190301 2562 generic.go:356] "Generic (PLEG): container finished" podID="de58e444-5339-4d04-8083-cadf08c75917" containerID="f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece" exitCode=0 Jul 07 16:25:31.190315 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190309 2562 generic.go:356] "Generic (PLEG): container finished" podID="de58e444-5339-4d04-8083-cadf08c75917" containerID="5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e" exitCode=0 Jul 07 16:25:31.190315 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190314 2562 generic.go:356] "Generic (PLEG): container finished" podID="de58e444-5339-4d04-8083-cadf08c75917" containerID="4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed" exitCode=0 Jul 07 16:25:31.190315 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190319 2562 generic.go:356] "Generic (PLEG): container finished" podID="de58e444-5339-4d04-8083-cadf08c75917" containerID="8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d" exitCode=0 Jul 07 16:25:31.190895 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190352 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerDied","Data":"6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15"} Jul 07 16:25:31.190895 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190437 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerDied","Data":"f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece"} Jul 07 16:25:31.190895 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190484 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerDied","Data":"5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e"} Jul 07 16:25:31.190895 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190543 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerDied","Data":"4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed"} Jul 07 16:25:31.190895 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.190585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerDied","Data":"8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d"} Jul 07 16:25:31.770142 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.770115 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:31.870834 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.870807 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-serving-certs-ca-bundle\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.870988 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.870856 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-grpc-tls\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.870988 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.870881 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-tls-assets\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.870988 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.870901 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-db\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871127 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871104 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-tls\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871192 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871153 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-trusted-ca-bundle\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871248 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871191 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871248 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871218 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-1\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871248 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871243 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-metrics-client-certs\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871402 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871251 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:25:31.871402 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871273 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm28f\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-kube-api-access-dm28f\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871402 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871296 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-web-config\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871402 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871332 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-0\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871402 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871355 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-kubelet-serving-ca-bundle\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871402 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871391 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-config-out\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871745 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871415 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-metrics-client-ca\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871745 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871441 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-kube-rbac-proxy\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871745 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871465 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871745 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871496 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-2\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871745 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871546 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-thanos-prometheus-http-client-file\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.871745 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871573 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-config\") pod \"de58e444-5339-4d04-8083-cadf08c75917\" (UID: \"de58e444-5339-4d04-8083-cadf08c75917\") " Jul 07 16:25:31.872223 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871822 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:25:31.872223 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871841 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.872223 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.871958 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:25:31.872223 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.872210 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:25:31.874571 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.873842 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:25:31.874571 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.874046 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:25:31.874571 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.874305 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:25:31.874571 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.874404 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:31.875035 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.874954 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-config" (OuterVolumeSpecName: "config") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:31.875132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.875111 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:31.875200 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.875147 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:25:31.875368 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.875329 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-kube-api-access-dm28f" (OuterVolumeSpecName: "kube-api-access-dm28f") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "kube-api-access-dm28f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:25:31.875611 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.875568 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:31.875611 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.875589 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:25:31.876499 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.876466 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:31.876680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.876564 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:31.876754 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.876732 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:31.877292 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.877266 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-config-out" (OuterVolumeSpecName: "config-out") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:25:31.877758 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.877740 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:31.886090 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.886064 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-web-config" (OuterVolumeSpecName: "web-config") pod "de58e444-5339-4d04-8083-cadf08c75917" (UID: "de58e444-5339-4d04-8083-cadf08c75917"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:25:31.972318 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972270 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-grpc-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972318 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972310 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-tls-assets\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972318 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972320 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-db\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972318 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972329 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972318 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972339 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972351 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972360 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972370 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-metrics-client-certs\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972379 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm28f\" (UniqueName: \"kubernetes.io/projected/de58e444-5339-4d04-8083-cadf08c75917-kube-api-access-dm28f\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972389 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-web-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972397 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972406 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972414 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de58e444-5339-4d04-8083-cadf08c75917-config-out\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972422 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-configmap-metrics-client-ca\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972430 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-kube-rbac-proxy\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972440 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972448 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/de58e444-5339-4d04-8083-cadf08c75917-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972455 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:31.972688 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:31.972464 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/de58e444-5339-4d04-8083-cadf08c75917-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:25:32.196967 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.196877 2562 generic.go:356] "Generic (PLEG): container finished" podID="de58e444-5339-4d04-8083-cadf08c75917" containerID="ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b" exitCode=0 Jul 07 16:25:32.196967 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.196938 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerDied","Data":"ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b"} Jul 07 16:25:32.196967 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.196949 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.197437 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.197029 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de58e444-5339-4d04-8083-cadf08c75917","Type":"ContainerDied","Data":"7e400a9f44b05a324f91c9a950af54d5c7accd1423a7f2961222680e71bd6de1"} Jul 07 16:25:32.197437 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.197062 2562 scope.go:117] "RemoveContainer" containerID="6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15" Jul 07 16:25:32.204941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.204919 2562 scope.go:117] "RemoveContainer" containerID="f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece" Jul 07 16:25:32.212084 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.212067 2562 scope.go:117] "RemoveContainer" containerID="ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b" Jul 07 16:25:32.219210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.219190 2562 scope.go:117] "RemoveContainer" containerID="5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e" Jul 07 16:25:32.224986 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.224962 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:25:32.226640 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.226621 2562 scope.go:117] "RemoveContainer" containerID="4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed" Jul 07 16:25:32.230682 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.230648 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:25:32.234442 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.234422 2562 scope.go:117] "RemoveContainer" containerID="8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d" Jul 07 16:25:32.242381 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.242361 2562 scope.go:117] "RemoveContainer" containerID="9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35" Jul 07 16:25:32.249747 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.249727 2562 scope.go:117] "RemoveContainer" containerID="6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15" Jul 07 16:25:32.250153 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:32.250124 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15\": container with ID starting with 6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15 not found: ID does not exist" containerID="6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15" Jul 07 16:25:32.250234 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.250161 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15"} err="failed to get container status \"6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15\": rpc error: code = NotFound desc = could not find container \"6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15\": container with ID starting with 6cd92276ab77caa9f47e902482f2b3cc66caabf9e825cef85b976fbe3dbb6e15 not found: ID does not exist" Jul 07 16:25:32.250234 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.250185 2562 scope.go:117] "RemoveContainer" containerID="f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece" Jul 07 16:25:32.250484 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:32.250466 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece\": container with ID starting with f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece not found: ID does not exist" containerID="f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece" Jul 07 16:25:32.250642 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.250492 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece"} err="failed to get container status \"f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece\": rpc error: code = NotFound desc = could not find container \"f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece\": container with ID starting with f68e2fcb9d604bcf5da9c03332757ebd664cf88025eeacda7b239f5a29711ece not found: ID does not exist" Jul 07 16:25:32.250681 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.250646 2562 scope.go:117] "RemoveContainer" containerID="ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b" Jul 07 16:25:32.250903 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:32.250883 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b\": container with ID starting with ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b not found: ID does not exist" containerID="ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b" Jul 07 16:25:32.250961 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.250909 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b"} err="failed to get container status \"ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b\": rpc error: code = NotFound desc = could not find container \"ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b\": container with ID starting with ddeef4a3aad0f03e0795b521b90d6cdc9a161f27fdca0aecdd2e250b08062a2b not found: ID does not exist" Jul 07 16:25:32.250961 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.250926 2562 scope.go:117] "RemoveContainer" containerID="5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e" Jul 07 16:25:32.251186 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:32.251168 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e\": container with ID starting with 5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e not found: ID does not exist" containerID="5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e" Jul 07 16:25:32.251224 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.251193 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e"} err="failed to get container status \"5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e\": rpc error: code = NotFound desc = could not find container \"5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e\": container with ID starting with 5a27025fd9d0fd14f2a9046c17e8d4a584f890f372590774e3a696f12038ac7e not found: ID does not exist" Jul 07 16:25:32.251224 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.251208 2562 scope.go:117] "RemoveContainer" containerID="4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed" Jul 07 16:25:32.251443 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:32.251428 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed\": container with ID starting with 4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed not found: ID does not exist" containerID="4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed" Jul 07 16:25:32.251488 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.251447 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed"} err="failed to get container status \"4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed\": rpc error: code = NotFound desc = could not find container \"4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed\": container with ID starting with 4733fffc2a385ea78f1a5fb1432ff0df60039b502c6830501ed401361c85a2ed not found: ID does not exist" Jul 07 16:25:32.251488 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.251460 2562 scope.go:117] "RemoveContainer" containerID="8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d" Jul 07 16:25:32.251719 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:32.251698 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d\": container with ID starting with 8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d not found: ID does not exist" containerID="8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d" Jul 07 16:25:32.251766 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.251715 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d"} err="failed to get container status \"8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d\": rpc error: code = NotFound desc = could not find container \"8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d\": container with ID starting with 8324cc4f473b2e8a4c5110a2a16eba0445f3559c13818080df85e550701f7e2d not found: ID does not exist" Jul 07 16:25:32.251766 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.251727 2562 scope.go:117] "RemoveContainer" containerID="9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35" Jul 07 16:25:32.251986 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:25:32.251969 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35\": container with ID starting with 9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35 not found: ID does not exist" containerID="9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35" Jul 07 16:25:32.252046 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.251991 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35"} err="failed to get container status \"9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35\": rpc error: code = NotFound desc = could not find container \"9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35\": container with ID starting with 9f9475041c96e5b8c22c73c1f1bdd5b059ed0a1b718543eb2653944a1d67dd35 not found: ID does not exist" Jul 07 16:25:32.260439 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260416 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:25:32.260698 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260685 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="init-config-reloader" Jul 07 16:25:32.260741 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260700 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="init-config-reloader" Jul 07 16:25:32.260741 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260708 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy" Jul 07 16:25:32.260741 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260714 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy" Jul 07 16:25:32.260741 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260721 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="config-reloader" Jul 07 16:25:32.260741 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260727 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="config-reloader" Jul 07 16:25:32.260741 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260736 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy-thanos" Jul 07 16:25:32.260741 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260741 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy-thanos" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260749 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="prometheus" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260754 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="prometheus" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260762 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy-web" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260767 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy-web" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260776 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="thanos-sidecar" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260781 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="thanos-sidecar" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260824 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="config-reloader" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260829 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="thanos-sidecar" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260836 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy-web" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260842 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="prometheus" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260847 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy" Jul 07 16:25:32.260941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.260851 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de58e444-5339-4d04-8083-cadf08c75917" containerName="kube-rbac-proxy-thanos" Jul 07 16:25:32.264146 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.264129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.267796 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.267773 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 16:25:32.268027 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.268008 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 16:25:32.268083 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.268026 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 16:25:32.268124 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.268026 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 16:25:32.269064 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.269034 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 16:25:32.269064 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.269051 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 16:25:32.269064 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.269062 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 16:25:32.269283 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.269067 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 16:25:32.269283 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.269123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 16:25:32.269389 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.269379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cjvjx\"" Jul 07 16:25:32.270016 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.269991 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-glsg9bjj41tq\"" Jul 07 16:25:32.270299 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.270281 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 16:25:32.270997 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.270855 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 16:25:32.271409 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.271395 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 16:25:32.274442 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.274421 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 16:25:32.277417 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.277401 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 16:25:32.284319 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.284292 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:25:32.376120 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376120 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376380 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376380 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376380 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376380 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376380 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-config\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376380 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjttq\" (UniqueName: \"kubernetes.io/projected/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-kube-api-access-fjttq\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.376701 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.377045 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.377045 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.376784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.462635 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.462562 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de58e444-5339-4d04-8083-cadf08c75917" path="/var/lib/kubelet/pods/de58e444-5339-4d04-8083-cadf08c75917/volumes" Jul 07 16:25:32.477806 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.477764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.477806 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.477810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.477965 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.477830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.477965 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.477846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.477965 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.477862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjttq\" (UniqueName: \"kubernetes.io/projected/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-kube-api-access-fjttq\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.477965 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.477879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478176 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478176 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478176 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478176 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478176 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478411 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478411 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478411 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478411 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478411 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478686 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478686 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478476 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478686 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.478686 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.478587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-config\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.481037 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481005 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.481037 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.481286 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.481286 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481212 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.481435 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481304 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.481435 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481321 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.481626 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481489 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.481739 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481713 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.482601 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-config\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.482601 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.481885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.482601 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.482447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.482601 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.482498 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.482954 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.482929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.482954 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.482950 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.483586 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.483562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.483703 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.483687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.484097 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.484078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.484312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.484293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.484373 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.484326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.487684 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.487667 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjttq\" (UniqueName: \"kubernetes.io/projected/92fe7118-78ef-4fd7-9934-9eae19c9d1e2-kube-api-access-fjttq\") pod \"prometheus-k8s-0\" (UID: \"92fe7118-78ef-4fd7-9934-9eae19c9d1e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.574309 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.574266 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:25:32.725189 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:32.725104 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:25:32.728089 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:25:32.728063 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fe7118_78ef_4fd7_9934_9eae19c9d1e2.slice/crio-fbdbd6b8c9311bfd78e997d1ba83fbc5a665cc00d7209ccd243861fdd9616057 WatchSource:0}: Error finding container fbdbd6b8c9311bfd78e997d1ba83fbc5a665cc00d7209ccd243861fdd9616057: Status 404 returned error can't find the container with id fbdbd6b8c9311bfd78e997d1ba83fbc5a665cc00d7209ccd243861fdd9616057 Jul 07 16:25:33.202803 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:33.202769 2562 generic.go:356] "Generic (PLEG): container finished" podID="92fe7118-78ef-4fd7-9934-9eae19c9d1e2" containerID="198fc74f211488c23d7e3f20796e7741460bb7c6f187106919793b877e1b4673" exitCode=0 Jul 07 16:25:33.203278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:33.202857 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92fe7118-78ef-4fd7-9934-9eae19c9d1e2","Type":"ContainerDied","Data":"198fc74f211488c23d7e3f20796e7741460bb7c6f187106919793b877e1b4673"} Jul 07 16:25:33.203278 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:33.202969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92fe7118-78ef-4fd7-9934-9eae19c9d1e2","Type":"ContainerStarted","Data":"fbdbd6b8c9311bfd78e997d1ba83fbc5a665cc00d7209ccd243861fdd9616057"} Jul 07 16:25:34.211246 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:34.211207 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92fe7118-78ef-4fd7-9934-9eae19c9d1e2","Type":"ContainerStarted","Data":"d33d3dc4ef5d5fb82ed8faaeb806cf99a391544de671549cc9203a0ea0bbf488"} Jul 07 16:25:34.211641 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:34.211296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92fe7118-78ef-4fd7-9934-9eae19c9d1e2","Type":"ContainerStarted","Data":"b8afd0761e71e1773908090f0dacce110557f317a4683c6d5c7bb834b283aecc"} Jul 07 16:25:34.211641 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:34.211336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92fe7118-78ef-4fd7-9934-9eae19c9d1e2","Type":"ContainerStarted","Data":"497fdec4d97c6bfe0d7c6024eb2e140bd4886cc7795619a165f320afb7333376"} Jul 07 16:25:34.211641 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:34.211374 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92fe7118-78ef-4fd7-9934-9eae19c9d1e2","Type":"ContainerStarted","Data":"0166f7ac4b06d9a6e6c871e682b41fba59a90fafe629633dfffb9872f4086a3e"} Jul 07 16:25:34.211641 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:34.211418 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92fe7118-78ef-4fd7-9934-9eae19c9d1e2","Type":"ContainerStarted","Data":"ac0ffc7aa0df91b446648a0f15415cc9083fa3fa4143d4417c2494a0e013456f"} Jul 07 16:25:34.211641 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:34.211454 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92fe7118-78ef-4fd7-9934-9eae19c9d1e2","Type":"ContainerStarted","Data":"213cb7e698ef56e5a6686aabd9989773dba119d79d44d5849936d7007a6c24a3"} Jul 07 16:25:34.246352 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:34.246298 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.226937619 podStartE2EDuration="2.246281697s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.344078ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:25:34.244864438 +0000 UTC m=+160.354201134" watchObservedRunningTime="2026-07-07 16:25:34.246281697 +0000 UTC m=+160.355618376" Jul 07 16:25:37.575069 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:25:37.575017 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:26:32.575283 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:26:32.575238 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:26:32.591457 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:26:32.591418 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:26:33.442580 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:26:33.442551 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:27:16.365578 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.365489 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s67l7"] Jul 07 16:27:16.368694 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.368676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-s67l7" Jul 07 16:27:16.371703 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.371681 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 16:27:16.373027 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.373007 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6vvsr\"" Jul 07 16:27:16.373104 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.373010 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 16:27:16.377464 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.377444 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s67l7"] Jul 07 16:27:16.456671 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.456633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hrn8\" (UniqueName: \"kubernetes.io/projected/9f37f4b0-999a-4a85-9265-be402a1dbb43-kube-api-access-9hrn8\") pod \"cert-manager-55b4d954d5-s67l7\" (UID: \"9f37f4b0-999a-4a85-9265-be402a1dbb43\") " pod="cert-manager/cert-manager-55b4d954d5-s67l7" Jul 07 16:27:16.456861 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.456684 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f37f4b0-999a-4a85-9265-be402a1dbb43-bound-sa-token\") pod \"cert-manager-55b4d954d5-s67l7\" (UID: \"9f37f4b0-999a-4a85-9265-be402a1dbb43\") " pod="cert-manager/cert-manager-55b4d954d5-s67l7" Jul 07 16:27:16.557707 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.557669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hrn8\" (UniqueName: \"kubernetes.io/projected/9f37f4b0-999a-4a85-9265-be402a1dbb43-kube-api-access-9hrn8\") pod \"cert-manager-55b4d954d5-s67l7\" (UID: \"9f37f4b0-999a-4a85-9265-be402a1dbb43\") " pod="cert-manager/cert-manager-55b4d954d5-s67l7" Jul 07 16:27:16.557904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.557726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f37f4b0-999a-4a85-9265-be402a1dbb43-bound-sa-token\") pod \"cert-manager-55b4d954d5-s67l7\" (UID: \"9f37f4b0-999a-4a85-9265-be402a1dbb43\") " pod="cert-manager/cert-manager-55b4d954d5-s67l7" Jul 07 16:27:16.567436 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.567397 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f37f4b0-999a-4a85-9265-be402a1dbb43-bound-sa-token\") pod \"cert-manager-55b4d954d5-s67l7\" (UID: \"9f37f4b0-999a-4a85-9265-be402a1dbb43\") " pod="cert-manager/cert-manager-55b4d954d5-s67l7" Jul 07 16:27:16.567576 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.567523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hrn8\" (UniqueName: \"kubernetes.io/projected/9f37f4b0-999a-4a85-9265-be402a1dbb43-kube-api-access-9hrn8\") pod \"cert-manager-55b4d954d5-s67l7\" (UID: \"9f37f4b0-999a-4a85-9265-be402a1dbb43\") " pod="cert-manager/cert-manager-55b4d954d5-s67l7" Jul 07 16:27:16.692944 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.692904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-s67l7" Jul 07 16:27:16.824371 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:16.824323 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s67l7"] Jul 07 16:27:16.827019 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:27:16.826990 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f37f4b0_999a_4a85_9265_be402a1dbb43.slice/crio-26339b394742980e4f774d4bb5eca9b27d0a7b73bf95305881edb369cb868f3e WatchSource:0}: Error finding container 26339b394742980e4f774d4bb5eca9b27d0a7b73bf95305881edb369cb868f3e: Status 404 returned error can't find the container with id 26339b394742980e4f774d4bb5eca9b27d0a7b73bf95305881edb369cb868f3e Jul 07 16:27:17.593904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:17.593862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-s67l7" event={"ID":"9f37f4b0-999a-4a85-9265-be402a1dbb43","Type":"ContainerStarted","Data":"26339b394742980e4f774d4bb5eca9b27d0a7b73bf95305881edb369cb868f3e"} Jul 07 16:27:20.608400 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:20.608351 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-s67l7" event={"ID":"9f37f4b0-999a-4a85-9265-be402a1dbb43","Type":"ContainerStarted","Data":"2db4e93011d8bd9e8d462ef901c2b4bd4be2191744bab0b2afec915f32416191"} Jul 07 16:27:20.626726 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:20.626674 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-s67l7" podStartSLOduration=1.6109560539999999 podStartE2EDuration="4.626659047s" totalImagesPullingTime="3.015702993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:20.62592096 +0000 UTC m=+266.735257644" watchObservedRunningTime="2026-07-07 16:27:20.626659047 +0000 UTC m=+266.735995733" Jul 07 16:27:24.086395 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.086351 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-96844494c-bkblx"] Jul 07 16:27:24.089756 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.089734 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.093419 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.093397 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 16:27:24.094937 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.094918 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 16:27:24.094937 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.094927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 16:27:24.095098 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.094927 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:27:24.095098 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.094980 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h9n57\"" Jul 07 16:27:24.095098 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.095008 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 16:27:24.107432 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.107406 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-96844494c-bkblx"] Jul 07 16:27:24.226362 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.226315 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-cert\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.226570 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.226373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-manager-config\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.226570 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.226452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-metrics-cert\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.226570 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.226470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vqc\" (UniqueName: \"kubernetes.io/projected/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-kube-api-access-s7vqc\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.327850 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.327799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-metrics-cert\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.327967 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.327859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vqc\" (UniqueName: \"kubernetes.io/projected/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-kube-api-access-s7vqc\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.327967 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.327944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-cert\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.328055 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.328004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-manager-config\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.328860 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.328834 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-manager-config\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.330580 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.330526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-cert\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.330580 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.330572 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-metrics-cert\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.346576 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.346499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vqc\" (UniqueName: \"kubernetes.io/projected/69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a-kube-api-access-s7vqc\") pod \"lws-controller-manager-96844494c-bkblx\" (UID: \"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.399343 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.399312 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:24.535968 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.535938 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-96844494c-bkblx"] Jul 07 16:27:24.538895 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:27:24.538866 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ca4cb4_4a43_4ecc_91d6_5bc50cdacf0a.slice/crio-3341725c0300874e0004d47c2ea7fb453f2c8f5e513b044b65a481a20234756a WatchSource:0}: Error finding container 3341725c0300874e0004d47c2ea7fb453f2c8f5e513b044b65a481a20234756a: Status 404 returned error can't find the container with id 3341725c0300874e0004d47c2ea7fb453f2c8f5e513b044b65a481a20234756a Jul 07 16:27:24.623568 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:24.623535 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" event={"ID":"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a","Type":"ContainerStarted","Data":"3341725c0300874e0004d47c2ea7fb453f2c8f5e513b044b65a481a20234756a"} Jul 07 16:27:26.378894 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.378862 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj"] Jul 07 16:27:26.387684 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.387658 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.390683 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.390645 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 16:27:26.390860 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.390751 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 16:27:26.390860 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.390773 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 16:27:26.391127 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.391101 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vkgk9\"" Jul 07 16:27:26.391235 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.391141 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 16:27:26.397777 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.397747 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj"] Jul 07 16:27:26.549308 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.549266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7d79b793-aee8-4a68-97b0-f4bd3954602a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.549479 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.549323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7d79b793-aee8-4a68-97b0-f4bd3954602a-manifests\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.549479 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.549360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d79b793-aee8-4a68-97b0-f4bd3954602a-tmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.549479 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.549446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlv5t\" (UniqueName: \"kubernetes.io/projected/7d79b793-aee8-4a68-97b0-f4bd3954602a-kube-api-access-wlv5t\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.549643 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.549487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d79b793-aee8-4a68-97b0-f4bd3954602a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.650011 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.649937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlv5t\" (UniqueName: \"kubernetes.io/projected/7d79b793-aee8-4a68-97b0-f4bd3954602a-kube-api-access-wlv5t\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.650011 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.649992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d79b793-aee8-4a68-97b0-f4bd3954602a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.650226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.650031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7d79b793-aee8-4a68-97b0-f4bd3954602a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.650226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.650056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7d79b793-aee8-4a68-97b0-f4bd3954602a-manifests\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.650226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.650077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d79b793-aee8-4a68-97b0-f4bd3954602a-tmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.650519 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.650480 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7d79b793-aee8-4a68-97b0-f4bd3954602a-manifests\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.652578 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.652552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d79b793-aee8-4a68-97b0-f4bd3954602a-tmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.652900 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.652876 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d79b793-aee8-4a68-97b0-f4bd3954602a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.652977 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.652897 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7d79b793-aee8-4a68-97b0-f4bd3954602a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.668477 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.668450 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlv5t\" (UniqueName: \"kubernetes.io/projected/7d79b793-aee8-4a68-97b0-f4bd3954602a-kube-api-access-wlv5t\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-g56gj\" (UID: \"7d79b793-aee8-4a68-97b0-f4bd3954602a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:26.700838 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:26.700807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:27.135114 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:27.135089 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj"] Jul 07 16:27:27.136373 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:27:27.136342 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d79b793_aee8_4a68_97b0_f4bd3954602a.slice/crio-7aab0d39f88684bd195ccdefece57135cd7bab4db900c0bdb826da7ca9ee11e5 WatchSource:0}: Error finding container 7aab0d39f88684bd195ccdefece57135cd7bab4db900c0bdb826da7ca9ee11e5: Status 404 returned error can't find the container with id 7aab0d39f88684bd195ccdefece57135cd7bab4db900c0bdb826da7ca9ee11e5 Jul 07 16:27:27.640316 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:27.640274 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" event={"ID":"7d79b793-aee8-4a68-97b0-f4bd3954602a","Type":"ContainerStarted","Data":"7aab0d39f88684bd195ccdefece57135cd7bab4db900c0bdb826da7ca9ee11e5"} Jul 07 16:27:27.642600 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:27.642564 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" event={"ID":"69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a","Type":"ContainerStarted","Data":"da389ffa3b8dc7896f059519d831f5803425ac3bf8503668e9db16b90f97f231"} Jul 07 16:27:27.642848 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:27.642804 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:27.669631 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:27.669574 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" podStartSLOduration=1.167070333 podStartE2EDuration="3.669557923s" totalImagesPullingTime="2.50248759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:27.668707412 +0000 UTC m=+273.778044098" watchObservedRunningTime="2026-07-07 16:27:27.669557923 +0000 UTC m=+273.778894607" Jul 07 16:27:30.656497 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:30.656461 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" event={"ID":"7d79b793-aee8-4a68-97b0-f4bd3954602a","Type":"ContainerStarted","Data":"ef929b857445209ffad286b36745fe48e284954d0bfe5584b6953cc926fff8b0"} Jul 07 16:27:31.663773 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:31.663737 2562 generic.go:356] "Generic (PLEG): container finished" podID="7d79b793-aee8-4a68-97b0-f4bd3954602a" containerID="ef929b857445209ffad286b36745fe48e284954d0bfe5584b6953cc926fff8b0" exitCode=0 Jul 07 16:27:31.664119 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:31.663817 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" event={"ID":"7d79b793-aee8-4a68-97b0-f4bd3954602a","Type":"ContainerDied","Data":"ef929b857445209ffad286b36745fe48e284954d0bfe5584b6953cc926fff8b0"} Jul 07 16:27:32.669984 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:32.669951 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" event={"ID":"7d79b793-aee8-4a68-97b0-f4bd3954602a","Type":"ContainerStarted","Data":"75e53294919b16339d0bd05172fe42a50ff39be31a69a4d993814f74687cc9c1"} Jul 07 16:27:32.670379 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:32.670118 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:32.698452 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:32.697563 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" podStartSLOduration=2.432945343 podStartE2EDuration="6.697541747s" totalImagesPullingTime="3.188178579s" totalInitContainerRuntime="1.076417825s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:32.696917664 +0000 UTC m=+278.806254351" watchObservedRunningTime="2026-07-07 16:27:32.697541747 +0000 UTC m=+278.806878432" Jul 07 16:27:38.649590 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:38.649557 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-96844494c-bkblx" Jul 07 16:27:43.676630 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:43.676592 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-g56gj" Jul 07 16:27:54.268386 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:54.268356 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbfrs_df53ac47-e829-4404-83cf-2d5db8a8398a/ovn-acl-logging/0.log" Jul 07 16:27:54.272602 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:54.272579 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbfrs_df53ac47-e829-4404-83cf-2d5db8a8398a/ovn-acl-logging/0.log" Jul 07 16:27:54.274731 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:54.274709 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 16:27:59.273676 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.273635 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh"] Jul 07 16:27:59.275647 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.275630 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.278817 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.278790 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 16:27:59.278958 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.278790 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 16:27:59.278958 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.278908 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 16:27:59.280111 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.280092 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mcqpd\"" Jul 07 16:27:59.280217 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.280094 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 16:27:59.287336 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.287316 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh"] Jul 07 16:27:59.333038 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.333004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b632a92e-a07e-4fd0-a547-7eb2c999393c-tls-certs\") pod \"kube-auth-proxy-7c9bdf7f84-vbwfh\" (UID: \"b632a92e-a07e-4fd0-a547-7eb2c999393c\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.333188 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.333042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b632a92e-a07e-4fd0-a547-7eb2c999393c-tmp\") pod \"kube-auth-proxy-7c9bdf7f84-vbwfh\" (UID: \"b632a92e-a07e-4fd0-a547-7eb2c999393c\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.333188 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.333166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgs67\" (UniqueName: \"kubernetes.io/projected/b632a92e-a07e-4fd0-a547-7eb2c999393c-kube-api-access-jgs67\") pod \"kube-auth-proxy-7c9bdf7f84-vbwfh\" (UID: \"b632a92e-a07e-4fd0-a547-7eb2c999393c\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.434581 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.434546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgs67\" (UniqueName: \"kubernetes.io/projected/b632a92e-a07e-4fd0-a547-7eb2c999393c-kube-api-access-jgs67\") pod \"kube-auth-proxy-7c9bdf7f84-vbwfh\" (UID: \"b632a92e-a07e-4fd0-a547-7eb2c999393c\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.434790 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.434617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b632a92e-a07e-4fd0-a547-7eb2c999393c-tls-certs\") pod \"kube-auth-proxy-7c9bdf7f84-vbwfh\" (UID: \"b632a92e-a07e-4fd0-a547-7eb2c999393c\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.434790 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.434772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b632a92e-a07e-4fd0-a547-7eb2c999393c-tmp\") pod \"kube-auth-proxy-7c9bdf7f84-vbwfh\" (UID: \"b632a92e-a07e-4fd0-a547-7eb2c999393c\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.437285 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.437226 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b632a92e-a07e-4fd0-a547-7eb2c999393c-tmp\") pod \"kube-auth-proxy-7c9bdf7f84-vbwfh\" (UID: \"b632a92e-a07e-4fd0-a547-7eb2c999393c\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.437637 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.437612 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b632a92e-a07e-4fd0-a547-7eb2c999393c-tls-certs\") pod \"kube-auth-proxy-7c9bdf7f84-vbwfh\" (UID: \"b632a92e-a07e-4fd0-a547-7eb2c999393c\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.458371 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.458346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgs67\" (UniqueName: \"kubernetes.io/projected/b632a92e-a07e-4fd0-a547-7eb2c999393c-kube-api-access-jgs67\") pod \"kube-auth-proxy-7c9bdf7f84-vbwfh\" (UID: \"b632a92e-a07e-4fd0-a547-7eb2c999393c\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.585135 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.585047 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" Jul 07 16:27:59.755307 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.755272 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh"] Jul 07 16:27:59.759296 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:27:59.759267 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb632a92e_a07e_4fd0_a547_7eb2c999393c.slice/crio-fdfc3443fcb8b7aa961dbc8af28866211aeb7650702f4e5268546b2c5f98b16c WatchSource:0}: Error finding container fdfc3443fcb8b7aa961dbc8af28866211aeb7650702f4e5268546b2c5f98b16c: Status 404 returned error can't find the container with id fdfc3443fcb8b7aa961dbc8af28866211aeb7650702f4e5268546b2c5f98b16c Jul 07 16:27:59.761127 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.761112 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:27:59.772112 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:27:59.772084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" event={"ID":"b632a92e-a07e-4fd0-a547-7eb2c999393c","Type":"ContainerStarted","Data":"fdfc3443fcb8b7aa961dbc8af28866211aeb7650702f4e5268546b2c5f98b16c"} Jul 07 16:28:03.792004 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:03.791951 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" event={"ID":"b632a92e-a07e-4fd0-a547-7eb2c999393c","Type":"ContainerStarted","Data":"a996e7e8296b0425fc0d2d1432df1dc1a24ecdc600b56d636d86f6a78e0764ce"} Jul 07 16:28:03.814866 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:03.814815 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-vbwfh" podStartSLOduration=1.46611705 podStartE2EDuration="4.814800273s" totalImagesPullingTime="3.348683223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:03.812910955 +0000 UTC m=+309.922247642" watchObservedRunningTime="2026-07-07 16:28:03.814800273 +0000 UTC m=+309.924136983" Jul 07 16:28:10.713763 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.713725 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d4s84"] Jul 07 16:28:10.716013 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.715996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:28:10.720412 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.720394 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 16:28:10.720850 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.720834 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sg8b4\"" Jul 07 16:28:10.745859 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.745834 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d4s84"] Jul 07 16:28:10.848140 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.848107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22be50dd-1406-4f43-aaee-b4f8ab01e504-cert\") pod \"kserve-controller-manager-d6f4b65b8-d4s84\" (UID: \"22be50dd-1406-4f43-aaee-b4f8ab01e504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:28:10.848323 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.848188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-656k5\" (UniqueName: \"kubernetes.io/projected/22be50dd-1406-4f43-aaee-b4f8ab01e504-kube-api-access-656k5\") pod \"kserve-controller-manager-d6f4b65b8-d4s84\" (UID: \"22be50dd-1406-4f43-aaee-b4f8ab01e504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:28:10.949600 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.949564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-656k5\" (UniqueName: \"kubernetes.io/projected/22be50dd-1406-4f43-aaee-b4f8ab01e504-kube-api-access-656k5\") pod \"kserve-controller-manager-d6f4b65b8-d4s84\" (UID: \"22be50dd-1406-4f43-aaee-b4f8ab01e504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:28:10.949767 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.949617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22be50dd-1406-4f43-aaee-b4f8ab01e504-cert\") pod \"kserve-controller-manager-d6f4b65b8-d4s84\" (UID: \"22be50dd-1406-4f43-aaee-b4f8ab01e504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:28:10.952234 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.952210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22be50dd-1406-4f43-aaee-b4f8ab01e504-cert\") pod \"kserve-controller-manager-d6f4b65b8-d4s84\" (UID: \"22be50dd-1406-4f43-aaee-b4f8ab01e504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:28:10.968016 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:10.967946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-656k5\" (UniqueName: \"kubernetes.io/projected/22be50dd-1406-4f43-aaee-b4f8ab01e504-kube-api-access-656k5\") pod \"kserve-controller-manager-d6f4b65b8-d4s84\" (UID: \"22be50dd-1406-4f43-aaee-b4f8ab01e504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:28:11.026876 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:11.026848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:28:11.181261 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:11.181228 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d4s84"] Jul 07 16:28:11.184188 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:28:11.184162 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22be50dd_1406_4f43_aaee_b4f8ab01e504.slice/crio-ad9a41f2c7ec9cb04df6e3317fd8ed5efdbfb37737a137485c4a1fa6a510e810 WatchSource:0}: Error finding container ad9a41f2c7ec9cb04df6e3317fd8ed5efdbfb37737a137485c4a1fa6a510e810: Status 404 returned error can't find the container with id ad9a41f2c7ec9cb04df6e3317fd8ed5efdbfb37737a137485c4a1fa6a510e810 Jul 07 16:28:11.825019 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:11.824983 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" event={"ID":"22be50dd-1406-4f43-aaee-b4f8ab01e504","Type":"ContainerStarted","Data":"ad9a41f2c7ec9cb04df6e3317fd8ed5efdbfb37737a137485c4a1fa6a510e810"} Jul 07 16:28:14.838483 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:14.838450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" event={"ID":"22be50dd-1406-4f43-aaee-b4f8ab01e504","Type":"ContainerStarted","Data":"9e9ff65b557cca41cc98fb435b3cf3500bc8a00b35343411b16c07b866a87c2f"} Jul 07 16:28:14.838909 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:14.838659 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:28:14.867337 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:14.867283 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" podStartSLOduration=1.780893602 podStartE2EDuration="4.867268226s" totalImagesPullingTime="3.086374624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:14.866619006 +0000 UTC m=+320.975955694" watchObservedRunningTime="2026-07-07 16:28:14.867268226 +0000 UTC m=+320.976604911" Jul 07 16:28:45.847669 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:28:45.847584 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d4s84" Jul 07 16:29:51.658477 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.658441 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h"] Jul 07 16:29:51.661750 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.661730 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.665629 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.665605 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 16:29:51.665768 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.665728 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 16:29:51.665918 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.665899 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 16:29:51.666702 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.666684 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 16:29:51.667029 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.667011 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-clfdp\"" Jul 07 16:29:51.672918 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.672891 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h"] Jul 07 16:29:51.827799 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.827755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/684e7593-1539-4506-bfa8-7bde32b3c06c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fs54h\" (UID: \"684e7593-1539-4506-bfa8-7bde32b3c06c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.827970 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.827820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf75m\" (UniqueName: \"kubernetes.io/projected/684e7593-1539-4506-bfa8-7bde32b3c06c-kube-api-access-zf75m\") pod \"kuadrant-console-plugin-66b5774985-fs54h\" (UID: \"684e7593-1539-4506-bfa8-7bde32b3c06c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.827970 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.827854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/684e7593-1539-4506-bfa8-7bde32b3c06c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fs54h\" (UID: \"684e7593-1539-4506-bfa8-7bde32b3c06c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.928809 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.928709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/684e7593-1539-4506-bfa8-7bde32b3c06c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fs54h\" (UID: \"684e7593-1539-4506-bfa8-7bde32b3c06c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.928809 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.928804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf75m\" (UniqueName: \"kubernetes.io/projected/684e7593-1539-4506-bfa8-7bde32b3c06c-kube-api-access-zf75m\") pod \"kuadrant-console-plugin-66b5774985-fs54h\" (UID: \"684e7593-1539-4506-bfa8-7bde32b3c06c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.929043 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.928845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/684e7593-1539-4506-bfa8-7bde32b3c06c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fs54h\" (UID: \"684e7593-1539-4506-bfa8-7bde32b3c06c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.929495 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.929476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/684e7593-1539-4506-bfa8-7bde32b3c06c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fs54h\" (UID: \"684e7593-1539-4506-bfa8-7bde32b3c06c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.931310 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.931286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/684e7593-1539-4506-bfa8-7bde32b3c06c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fs54h\" (UID: \"684e7593-1539-4506-bfa8-7bde32b3c06c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.937732 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.937709 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf75m\" (UniqueName: \"kubernetes.io/projected/684e7593-1539-4506-bfa8-7bde32b3c06c-kube-api-access-zf75m\") pod \"kuadrant-console-plugin-66b5774985-fs54h\" (UID: \"684e7593-1539-4506-bfa8-7bde32b3c06c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:51.970694 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:51.970650 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" Jul 07 16:29:52.141463 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:52.141421 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h"] Jul 07 16:29:52.144314 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:29:52.144271 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod684e7593_1539_4506_bfa8_7bde32b3c06c.slice/crio-85d47fc34b9291c57471114044632cd16c83a1bcb6bbc18fb0e72cf54714a390 WatchSource:0}: Error finding container 85d47fc34b9291c57471114044632cd16c83a1bcb6bbc18fb0e72cf54714a390: Status 404 returned error can't find the container with id 85d47fc34b9291c57471114044632cd16c83a1bcb6bbc18fb0e72cf54714a390 Jul 07 16:29:52.249128 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:29:52.249042 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" event={"ID":"684e7593-1539-4506-bfa8-7bde32b3c06c","Type":"ContainerStarted","Data":"85d47fc34b9291c57471114044632cd16c83a1bcb6bbc18fb0e72cf54714a390"} Jul 07 16:30:16.369920 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:16.369883 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" event={"ID":"684e7593-1539-4506-bfa8-7bde32b3c06c","Type":"ContainerStarted","Data":"d96b5847172455115cef66a0ddb7b0c624bffc92633be486e981f36e826975f2"} Jul 07 16:30:16.395892 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:16.395839 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fs54h" podStartSLOduration=1.317415544 podStartE2EDuration="25.395823215s" totalImagesPullingTime="24.078407671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:16.393767106 +0000 UTC m=+442.503103788" watchObservedRunningTime="2026-07-07 16:30:16.395823215 +0000 UTC m=+442.505159899" Jul 07 16:30:41.701940 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.701899 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-r52tx"] Jul 07 16:30:41.712266 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.712241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r52tx" Jul 07 16:30:41.715423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.715399 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2lthb\"" Jul 07 16:30:41.718274 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.718244 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r52tx"] Jul 07 16:30:41.785836 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.785795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwsss\" (UniqueName: \"kubernetes.io/projected/ab41c8b2-72a2-4b87-bc35-2392bf3726de-kube-api-access-jwsss\") pod \"authorino-58cd955675-r52tx\" (UID: \"ab41c8b2-72a2-4b87-bc35-2392bf3726de\") " pod="kuadrant-system/authorino-58cd955675-r52tx" Jul 07 16:30:41.886302 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.886264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwsss\" (UniqueName: \"kubernetes.io/projected/ab41c8b2-72a2-4b87-bc35-2392bf3726de-kube-api-access-jwsss\") pod \"authorino-58cd955675-r52tx\" (UID: \"ab41c8b2-72a2-4b87-bc35-2392bf3726de\") " pod="kuadrant-system/authorino-58cd955675-r52tx" Jul 07 16:30:41.897041 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.897009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwsss\" (UniqueName: \"kubernetes.io/projected/ab41c8b2-72a2-4b87-bc35-2392bf3726de-kube-api-access-jwsss\") pod \"authorino-58cd955675-r52tx\" (UID: \"ab41c8b2-72a2-4b87-bc35-2392bf3726de\") " pod="kuadrant-system/authorino-58cd955675-r52tx" Jul 07 16:30:41.938802 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.938768 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9hvl"] Jul 07 16:30:41.942178 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.942153 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b9hvl" Jul 07 16:30:41.957217 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.957155 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9hvl"] Jul 07 16:30:41.987185 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:41.987153 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2d8s\" (UniqueName: \"kubernetes.io/projected/b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2-kube-api-access-w2d8s\") pod \"authorino-75d556bd77-b9hvl\" (UID: \"b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2\") " pod="kuadrant-system/authorino-75d556bd77-b9hvl" Jul 07 16:30:42.022096 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:42.022068 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r52tx" Jul 07 16:30:42.088697 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:42.088660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2d8s\" (UniqueName: \"kubernetes.io/projected/b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2-kube-api-access-w2d8s\") pod \"authorino-75d556bd77-b9hvl\" (UID: \"b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2\") " pod="kuadrant-system/authorino-75d556bd77-b9hvl" Jul 07 16:30:42.097961 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:42.097936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2d8s\" (UniqueName: \"kubernetes.io/projected/b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2-kube-api-access-w2d8s\") pod \"authorino-75d556bd77-b9hvl\" (UID: \"b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2\") " pod="kuadrant-system/authorino-75d556bd77-b9hvl" Jul 07 16:30:42.159684 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:42.159649 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r52tx"] Jul 07 16:30:42.163858 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:30:42.163831 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab41c8b2_72a2_4b87_bc35_2392bf3726de.slice/crio-77db1c2dc320e9a26a73109ad76a43885b9b8d6aa598ad4cf2d940bafcaba097 WatchSource:0}: Error finding container 77db1c2dc320e9a26a73109ad76a43885b9b8d6aa598ad4cf2d940bafcaba097: Status 404 returned error can't find the container with id 77db1c2dc320e9a26a73109ad76a43885b9b8d6aa598ad4cf2d940bafcaba097 Jul 07 16:30:42.251552 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:42.251446 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b9hvl" Jul 07 16:30:42.385207 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:42.385180 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9hvl"] Jul 07 16:30:42.387186 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:30:42.387158 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6733c94_28e4_4c9d_b5cd_7b92ff1e0da2.slice/crio-a503ef9c1460017500c10e1125f891b03b9973456925aa9367fd232e822e40f5 WatchSource:0}: Error finding container a503ef9c1460017500c10e1125f891b03b9973456925aa9367fd232e822e40f5: Status 404 returned error can't find the container with id a503ef9c1460017500c10e1125f891b03b9973456925aa9367fd232e822e40f5 Jul 07 16:30:42.480729 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:42.480692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r52tx" event={"ID":"ab41c8b2-72a2-4b87-bc35-2392bf3726de","Type":"ContainerStarted","Data":"77db1c2dc320e9a26a73109ad76a43885b9b8d6aa598ad4cf2d940bafcaba097"} Jul 07 16:30:42.481939 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:42.481915 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b9hvl" event={"ID":"b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2","Type":"ContainerStarted","Data":"a503ef9c1460017500c10e1125f891b03b9973456925aa9367fd232e822e40f5"} Jul 07 16:30:47.508819 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:47.508775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b9hvl" event={"ID":"b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2","Type":"ContainerStarted","Data":"5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f"} Jul 07 16:30:47.510183 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:47.510159 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r52tx" event={"ID":"ab41c8b2-72a2-4b87-bc35-2392bf3726de","Type":"ContainerStarted","Data":"3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035"} Jul 07 16:30:47.532816 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:47.532761 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-b9hvl" podStartSLOduration=2.428358182 podStartE2EDuration="6.532745466s" totalImagesPullingTime="4.104387284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:47.53183224 +0000 UTC m=+473.641168925" watchObservedRunningTime="2026-07-07 16:30:47.532745466 +0000 UTC m=+473.642082417" Jul 07 16:30:47.559816 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:47.559762 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-r52tx" podStartSLOduration=2.2431627929999998 podStartE2EDuration="6.559745591s" totalImagesPullingTime="4.316582798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:47.558489902 +0000 UTC m=+473.667826589" watchObservedRunningTime="2026-07-07 16:30:47.559745591 +0000 UTC m=+473.669082276" Jul 07 16:30:47.566113 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:47.566086 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r52tx"] Jul 07 16:30:49.518074 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:49.518039 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-r52tx" podUID="ab41c8b2-72a2-4b87-bc35-2392bf3726de" containerName="authorino" containerID="cri-o://3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035" gracePeriod=30 Jul 07 16:30:49.762421 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:49.762397 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r52tx" Jul 07 16:30:49.856937 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:49.856841 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwsss\" (UniqueName: \"kubernetes.io/projected/ab41c8b2-72a2-4b87-bc35-2392bf3726de-kube-api-access-jwsss\") pod \"ab41c8b2-72a2-4b87-bc35-2392bf3726de\" (UID: \"ab41c8b2-72a2-4b87-bc35-2392bf3726de\") " Jul 07 16:30:49.859208 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:49.859172 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab41c8b2-72a2-4b87-bc35-2392bf3726de-kube-api-access-jwsss" (OuterVolumeSpecName: "kube-api-access-jwsss") pod "ab41c8b2-72a2-4b87-bc35-2392bf3726de" (UID: "ab41c8b2-72a2-4b87-bc35-2392bf3726de"). InnerVolumeSpecName "kube-api-access-jwsss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:30:49.958113 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:49.958079 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwsss\" (UniqueName: \"kubernetes.io/projected/ab41c8b2-72a2-4b87-bc35-2392bf3726de-kube-api-access-jwsss\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:30:50.523233 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:50.523202 2562 generic.go:356] "Generic (PLEG): container finished" podID="ab41c8b2-72a2-4b87-bc35-2392bf3726de" containerID="3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035" exitCode=0 Jul 07 16:30:50.523680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:50.523250 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r52tx" Jul 07 16:30:50.523680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:50.523255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r52tx" event={"ID":"ab41c8b2-72a2-4b87-bc35-2392bf3726de","Type":"ContainerDied","Data":"3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035"} Jul 07 16:30:50.523680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:50.523356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r52tx" event={"ID":"ab41c8b2-72a2-4b87-bc35-2392bf3726de","Type":"ContainerDied","Data":"77db1c2dc320e9a26a73109ad76a43885b9b8d6aa598ad4cf2d940bafcaba097"} Jul 07 16:30:50.523680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:50.523373 2562 scope.go:117] "RemoveContainer" containerID="3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035" Jul 07 16:30:50.531376 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:50.531357 2562 scope.go:117] "RemoveContainer" containerID="3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035" Jul 07 16:30:50.531749 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:30:50.531721 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035\": container with ID starting with 3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035 not found: ID does not exist" containerID="3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035" Jul 07 16:30:50.531805 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:50.531762 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035"} err="failed to get container status \"3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035\": rpc error: code = NotFound desc = could not find container \"3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035\": container with ID starting with 3aae577c28f6245a75f510f10517c4e25faefb7acc191ac3824775c5e3c04035 not found: ID does not exist" Jul 07 16:30:50.541784 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:50.541763 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r52tx"] Jul 07 16:30:50.546401 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:50.546382 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-r52tx"] Jul 07 16:30:52.463589 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:30:52.463554 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab41c8b2-72a2-4b87-bc35-2392bf3726de" path="/var/lib/kubelet/pods/ab41c8b2-72a2-4b87-bc35-2392bf3726de/volumes" Jul 07 16:31:41.780603 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.780563 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 07 16:31:41.781091 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.780872 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab41c8b2-72a2-4b87-bc35-2392bf3726de" containerName="authorino" Jul 07 16:31:41.781091 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.780882 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab41c8b2-72a2-4b87-bc35-2392bf3726de" containerName="authorino" Jul 07 16:31:41.781091 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.780954 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab41c8b2-72a2-4b87-bc35-2392bf3726de" containerName="authorino" Jul 07 16:31:41.785091 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.785072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 07 16:31:41.788396 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.788367 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 07 16:31:41.788563 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.788376 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 07 16:31:41.788563 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.788415 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-n7twb\"" Jul 07 16:31:41.789726 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.789704 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 07 16:31:41.796382 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.796356 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 07 16:31:41.920872 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:41.920836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t499\" (UniqueName: \"kubernetes.io/projected/cb4dd63d-ea65-4c26-9ceb-04275d247c8e-kube-api-access-4t499\") pod \"maas-keycloak-0\" (UID: \"cb4dd63d-ea65-4c26-9ceb-04275d247c8e\") " pod="keycloak-system/maas-keycloak-0" Jul 07 16:31:42.022210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:42.022157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t499\" (UniqueName: \"kubernetes.io/projected/cb4dd63d-ea65-4c26-9ceb-04275d247c8e-kube-api-access-4t499\") pod \"maas-keycloak-0\" (UID: \"cb4dd63d-ea65-4c26-9ceb-04275d247c8e\") " pod="keycloak-system/maas-keycloak-0" Jul 07 16:31:42.033228 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:42.033158 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t499\" (UniqueName: \"kubernetes.io/projected/cb4dd63d-ea65-4c26-9ceb-04275d247c8e-kube-api-access-4t499\") pod \"maas-keycloak-0\" (UID: \"cb4dd63d-ea65-4c26-9ceb-04275d247c8e\") " pod="keycloak-system/maas-keycloak-0" Jul 07 16:31:42.094736 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:42.094697 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 07 16:31:42.244809 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:42.244780 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 07 16:31:42.246151 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:31:42.246126 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4dd63d_ea65_4c26_9ceb_04275d247c8e.slice/crio-5d898f3871ef66c0628f506c23eaf6c688acd9737b41fe9ddaf250c59a3e1960 WatchSource:0}: Error finding container 5d898f3871ef66c0628f506c23eaf6c688acd9737b41fe9ddaf250c59a3e1960: Status 404 returned error can't find the container with id 5d898f3871ef66c0628f506c23eaf6c688acd9737b41fe9ddaf250c59a3e1960 Jul 07 16:31:42.754195 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:42.754141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb4dd63d-ea65-4c26-9ceb-04275d247c8e","Type":"ContainerStarted","Data":"5d898f3871ef66c0628f506c23eaf6c688acd9737b41fe9ddaf250c59a3e1960"} Jul 07 16:31:49.790350 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:49.790268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb4dd63d-ea65-4c26-9ceb-04275d247c8e","Type":"ContainerStarted","Data":"63bc299b655d7adecf67cd72046ee7021ae5e6e7c5b6be9561963e851e727d20"} Jul 07 16:31:49.828661 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:49.828584 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6489649819999999 podStartE2EDuration="8.82856091s" totalImagesPullingTime="7.179595928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:31:49.827113687 +0000 UTC m=+535.936450384" watchObservedRunningTime="2026-07-07 16:31:49.82856091 +0000 UTC m=+535.937897595" Jul 07 16:31:50.095396 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:50.095290 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 07 16:31:50.096922 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:50.096887 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:31:51.095414 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:51.095350 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:31:52.095805 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:52.095762 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 07 16:31:52.096415 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:52.096179 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:31:53.095797 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:53.095742 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:31:54.096006 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:54.095960 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:31:55.095180 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:55.095131 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:31:56.096114 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:56.096056 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:31:57.095970 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:57.095911 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:31:58.095871 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:58.095822 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:31:59.096050 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:31:59.096001 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:32:00.095325 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:00.095276 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:32:01.095549 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:01.095490 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:32:02.095979 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:02.095912 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jul 07 16:32:03.223149 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:03.223109 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 07 16:32:03.240279 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:03.240213 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 16:32:13.230824 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:13.230770 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 07 16:32:14.220131 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.220093 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44snh"] Jul 07 16:32:14.226978 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.226956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-44snh" Jul 07 16:32:14.244486 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.244459 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44snh"] Jul 07 16:32:14.336424 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.336386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwjvg\" (UniqueName: \"kubernetes.io/projected/0cf48f19-7578-4a1f-bcfb-622d0705a97a-kube-api-access-cwjvg\") pod \"authorino-5d4b67c446-44snh\" (UID: \"0cf48f19-7578-4a1f-bcfb-622d0705a97a\") " pod="kuadrant-system/authorino-5d4b67c446-44snh" Jul 07 16:32:14.437477 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.437426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwjvg\" (UniqueName: \"kubernetes.io/projected/0cf48f19-7578-4a1f-bcfb-622d0705a97a-kube-api-access-cwjvg\") pod \"authorino-5d4b67c446-44snh\" (UID: \"0cf48f19-7578-4a1f-bcfb-622d0705a97a\") " pod="kuadrant-system/authorino-5d4b67c446-44snh" Jul 07 16:32:14.447836 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.447804 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwjvg\" (UniqueName: \"kubernetes.io/projected/0cf48f19-7578-4a1f-bcfb-622d0705a97a-kube-api-access-cwjvg\") pod \"authorino-5d4b67c446-44snh\" (UID: \"0cf48f19-7578-4a1f-bcfb-622d0705a97a\") " pod="kuadrant-system/authorino-5d4b67c446-44snh" Jul 07 16:32:14.478122 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.478048 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44snh"] Jul 07 16:32:14.478295 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.478284 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-44snh" Jul 07 16:32:14.516035 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.515997 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5686467f94-dvsxs"] Jul 07 16:32:14.518549 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.518498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5686467f94-dvsxs" Jul 07 16:32:14.530819 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.530770 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5686467f94-dvsxs"] Jul 07 16:32:14.616952 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.616890 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44snh"] Jul 07 16:32:14.619780 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:32:14.619752 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cf48f19_7578_4a1f_bcfb_622d0705a97a.slice/crio-82a30516476ad8f756cb385117c07fb13276242234e63bb92866a9347b5fd273 WatchSource:0}: Error finding container 82a30516476ad8f756cb385117c07fb13276242234e63bb92866a9347b5fd273: Status 404 returned error can't find the container with id 82a30516476ad8f756cb385117c07fb13276242234e63bb92866a9347b5fd273 Jul 07 16:32:14.638617 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.638591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgsbv\" (UniqueName: \"kubernetes.io/projected/cb4f9f56-664c-48f9-94cb-f73f9682dd6e-kube-api-access-jgsbv\") pod \"authorino-5686467f94-dvsxs\" (UID: \"cb4f9f56-664c-48f9-94cb-f73f9682dd6e\") " pod="kuadrant-system/authorino-5686467f94-dvsxs" Jul 07 16:32:14.690843 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.690812 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5686467f94-dvsxs"] Jul 07 16:32:14.691091 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:32:14.691072 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jgsbv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5686467f94-dvsxs" podUID="cb4f9f56-664c-48f9-94cb-f73f9682dd6e" Jul 07 16:32:14.739067 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.738992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgsbv\" (UniqueName: \"kubernetes.io/projected/cb4f9f56-664c-48f9-94cb-f73f9682dd6e-kube-api-access-jgsbv\") pod \"authorino-5686467f94-dvsxs\" (UID: \"cb4f9f56-664c-48f9-94cb-f73f9682dd6e\") " pod="kuadrant-system/authorino-5686467f94-dvsxs" Jul 07 16:32:14.739450 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.739430 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6876f6777d-wpsqc"] Jul 07 16:32:14.741845 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.741829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:32:14.745587 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.745562 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 16:32:14.751734 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.751715 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgsbv\" (UniqueName: \"kubernetes.io/projected/cb4f9f56-664c-48f9-94cb-f73f9682dd6e-kube-api-access-jgsbv\") pod \"authorino-5686467f94-dvsxs\" (UID: \"cb4f9f56-664c-48f9-94cb-f73f9682dd6e\") " pod="kuadrant-system/authorino-5686467f94-dvsxs" Jul 07 16:32:14.758389 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.758361 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6876f6777d-wpsqc"] Jul 07 16:32:14.840087 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.840052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82cf539f-383e-495c-ac9b-c8a9d5045399-tls-cert\") pod \"authorino-6876f6777d-wpsqc\" (UID: \"82cf539f-383e-495c-ac9b-c8a9d5045399\") " pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:32:14.840272 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.840120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd5vl\" (UniqueName: \"kubernetes.io/projected/82cf539f-383e-495c-ac9b-c8a9d5045399-kube-api-access-xd5vl\") pod \"authorino-6876f6777d-wpsqc\" (UID: \"82cf539f-383e-495c-ac9b-c8a9d5045399\") " pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:32:14.941394 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.941355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd5vl\" (UniqueName: \"kubernetes.io/projected/82cf539f-383e-495c-ac9b-c8a9d5045399-kube-api-access-xd5vl\") pod \"authorino-6876f6777d-wpsqc\" (UID: \"82cf539f-383e-495c-ac9b-c8a9d5045399\") " pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:32:14.941636 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.941409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82cf539f-383e-495c-ac9b-c8a9d5045399-tls-cert\") pod \"authorino-6876f6777d-wpsqc\" (UID: \"82cf539f-383e-495c-ac9b-c8a9d5045399\") " pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:32:14.943965 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.943944 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82cf539f-383e-495c-ac9b-c8a9d5045399-tls-cert\") pod \"authorino-6876f6777d-wpsqc\" (UID: \"82cf539f-383e-495c-ac9b-c8a9d5045399\") " pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:32:14.949006 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.948977 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-44snh" event={"ID":"0cf48f19-7578-4a1f-bcfb-622d0705a97a","Type":"ContainerStarted","Data":"82a30516476ad8f756cb385117c07fb13276242234e63bb92866a9347b5fd273"} Jul 07 16:32:14.949006 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.949001 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5686467f94-dvsxs" Jul 07 16:32:14.951283 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.951267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd5vl\" (UniqueName: \"kubernetes.io/projected/82cf539f-383e-495c-ac9b-c8a9d5045399-kube-api-access-xd5vl\") pod \"authorino-6876f6777d-wpsqc\" (UID: \"82cf539f-383e-495c-ac9b-c8a9d5045399\") " pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:32:14.955376 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:14.955360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5686467f94-dvsxs" Jul 07 16:32:15.042540 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.042489 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgsbv\" (UniqueName: \"kubernetes.io/projected/cb4f9f56-664c-48f9-94cb-f73f9682dd6e-kube-api-access-jgsbv\") pod \"cb4f9f56-664c-48f9-94cb-f73f9682dd6e\" (UID: \"cb4f9f56-664c-48f9-94cb-f73f9682dd6e\") " Jul 07 16:32:15.044496 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.044471 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4f9f56-664c-48f9-94cb-f73f9682dd6e-kube-api-access-jgsbv" (OuterVolumeSpecName: "kube-api-access-jgsbv") pod "cb4f9f56-664c-48f9-94cb-f73f9682dd6e" (UID: "cb4f9f56-664c-48f9-94cb-f73f9682dd6e"). InnerVolumeSpecName "kube-api-access-jgsbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:32:15.050825 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.050805 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:32:15.144614 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.143541 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgsbv\" (UniqueName: \"kubernetes.io/projected/cb4f9f56-664c-48f9-94cb-f73f9682dd6e-kube-api-access-jgsbv\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:32:15.213110 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.213086 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6876f6777d-wpsqc"] Jul 07 16:32:15.215231 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:32:15.215196 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82cf539f_383e_495c_ac9b_c8a9d5045399.slice/crio-cdffebaea0c9a855909fffa19ac67bac1d4e75554df6146b3e5f577af5026048 WatchSource:0}: Error finding container cdffebaea0c9a855909fffa19ac67bac1d4e75554df6146b3e5f577af5026048: Status 404 returned error can't find the container with id cdffebaea0c9a855909fffa19ac67bac1d4e75554df6146b3e5f577af5026048 Jul 07 16:32:15.957743 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.957713 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-44snh" event={"ID":"0cf48f19-7578-4a1f-bcfb-622d0705a97a","Type":"ContainerStarted","Data":"c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d"} Jul 07 16:32:15.958213 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.957746 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-44snh" podUID="0cf48f19-7578-4a1f-bcfb-622d0705a97a" containerName="authorino" containerID="cri-o://c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d" gracePeriod=30 Jul 07 16:32:15.959311 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.959279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6876f6777d-wpsqc" event={"ID":"82cf539f-383e-495c-ac9b-c8a9d5045399","Type":"ContainerStarted","Data":"8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047"} Jul 07 16:32:15.959311 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.959314 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6876f6777d-wpsqc" event={"ID":"82cf539f-383e-495c-ac9b-c8a9d5045399","Type":"ContainerStarted","Data":"cdffebaea0c9a855909fffa19ac67bac1d4e75554df6146b3e5f577af5026048"} Jul 07 16:32:15.959485 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.959343 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5686467f94-dvsxs" Jul 07 16:32:15.986843 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:15.986797 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-44snh" podStartSLOduration=1.6178570730000001 podStartE2EDuration="1.986780212s" totalImagesPullingTime="368.923139ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:32:15.98527163 +0000 UTC m=+562.094608315" watchObservedRunningTime="2026-07-07 16:32:15.986780212 +0000 UTC m=+562.096116896" Jul 07 16:32:16.018473 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.018415 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6876f6777d-wpsqc" podStartSLOduration=1.6607763979999999 podStartE2EDuration="2.018398764s" totalImagesPullingTime="357.622366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:32:16.017122317 +0000 UTC m=+562.126459004" watchObservedRunningTime="2026-07-07 16:32:16.018398764 +0000 UTC m=+562.127735449" Jul 07 16:32:16.052539 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.052470 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9hvl"] Jul 07 16:32:16.052724 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.052676 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-b9hvl" podUID="b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2" containerName="authorino" containerID="cri-o://5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f" gracePeriod=30 Jul 07 16:32:16.076038 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.076002 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5686467f94-dvsxs"] Jul 07 16:32:16.081088 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.081056 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5686467f94-dvsxs"] Jul 07 16:32:16.300156 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.300130 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-44snh" Jul 07 16:32:16.308459 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.308436 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b9hvl" Jul 07 16:32:16.354787 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.354729 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwjvg\" (UniqueName: \"kubernetes.io/projected/0cf48f19-7578-4a1f-bcfb-622d0705a97a-kube-api-access-cwjvg\") pod \"0cf48f19-7578-4a1f-bcfb-622d0705a97a\" (UID: \"0cf48f19-7578-4a1f-bcfb-622d0705a97a\") " Jul 07 16:32:16.354965 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.354836 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2d8s\" (UniqueName: \"kubernetes.io/projected/b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2-kube-api-access-w2d8s\") pod \"b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2\" (UID: \"b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2\") " Jul 07 16:32:16.357024 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.356992 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cf48f19-7578-4a1f-bcfb-622d0705a97a-kube-api-access-cwjvg" (OuterVolumeSpecName: "kube-api-access-cwjvg") pod "0cf48f19-7578-4a1f-bcfb-622d0705a97a" (UID: "0cf48f19-7578-4a1f-bcfb-622d0705a97a"). InnerVolumeSpecName "kube-api-access-cwjvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:32:16.357130 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.357048 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2-kube-api-access-w2d8s" (OuterVolumeSpecName: "kube-api-access-w2d8s") pod "b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2" (UID: "b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2"). InnerVolumeSpecName "kube-api-access-w2d8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:32:16.455685 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.455656 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwjvg\" (UniqueName: \"kubernetes.io/projected/0cf48f19-7578-4a1f-bcfb-622d0705a97a-kube-api-access-cwjvg\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:32:16.455685 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.455685 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2d8s\" (UniqueName: \"kubernetes.io/projected/b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2-kube-api-access-w2d8s\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:32:16.463090 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.463065 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb4f9f56-664c-48f9-94cb-f73f9682dd6e" path="/var/lib/kubelet/pods/cb4f9f56-664c-48f9-94cb-f73f9682dd6e/volumes" Jul 07 16:32:16.964623 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.964592 2562 generic.go:356] "Generic (PLEG): container finished" podID="0cf48f19-7578-4a1f-bcfb-622d0705a97a" containerID="c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d" exitCode=0 Jul 07 16:32:16.965063 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.964641 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-44snh" Jul 07 16:32:16.965063 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.964692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-44snh" event={"ID":"0cf48f19-7578-4a1f-bcfb-622d0705a97a","Type":"ContainerDied","Data":"c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d"} Jul 07 16:32:16.965063 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.964740 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-44snh" event={"ID":"0cf48f19-7578-4a1f-bcfb-622d0705a97a","Type":"ContainerDied","Data":"82a30516476ad8f756cb385117c07fb13276242234e63bb92866a9347b5fd273"} Jul 07 16:32:16.965063 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.964761 2562 scope.go:117] "RemoveContainer" containerID="c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d" Jul 07 16:32:16.966057 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.966031 2562 generic.go:356] "Generic (PLEG): container finished" podID="b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2" containerID="5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f" exitCode=0 Jul 07 16:32:16.966169 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.966073 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b9hvl" Jul 07 16:32:16.966169 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.966119 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b9hvl" event={"ID":"b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2","Type":"ContainerDied","Data":"5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f"} Jul 07 16:32:16.966276 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.966159 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b9hvl" event={"ID":"b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2","Type":"ContainerDied","Data":"a503ef9c1460017500c10e1125f891b03b9973456925aa9367fd232e822e40f5"} Jul 07 16:32:16.973008 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.972994 2562 scope.go:117] "RemoveContainer" containerID="c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d" Jul 07 16:32:16.973258 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:32:16.973243 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d\": container with ID starting with c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d not found: ID does not exist" containerID="c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d" Jul 07 16:32:16.973302 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.973264 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d"} err="failed to get container status \"c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d\": rpc error: code = NotFound desc = could not find container \"c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d\": container with ID starting with c20276500006c908ac94a6054f0dfaa7eec824900a2288f5a8c21914c383c52d not found: ID does not exist" Jul 07 16:32:16.973302 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.973280 2562 scope.go:117] "RemoveContainer" containerID="5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f" Jul 07 16:32:16.980286 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.980272 2562 scope.go:117] "RemoveContainer" containerID="5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f" Jul 07 16:32:16.980635 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:32:16.980615 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f\": container with ID starting with 5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f not found: ID does not exist" containerID="5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f" Jul 07 16:32:16.980707 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.980645 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f"} err="failed to get container status \"5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f\": rpc error: code = NotFound desc = could not find container \"5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f\": container with ID starting with 5d3581b1decac980da4dcd176d2e6edfd782af4a2aacc561812e3de534dd715f not found: ID does not exist" Jul 07 16:32:16.999591 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:16.999560 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44snh"] Jul 07 16:32:17.002409 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:17.002384 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44snh"] Jul 07 16:32:17.020369 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:17.020346 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9hvl"] Jul 07 16:32:17.032548 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:17.032522 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9hvl"] Jul 07 16:32:18.463661 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:18.463627 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cf48f19-7578-4a1f-bcfb-622d0705a97a" path="/var/lib/kubelet/pods/0cf48f19-7578-4a1f-bcfb-622d0705a97a/volumes" Jul 07 16:32:18.464156 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:18.464104 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2" path="/var/lib/kubelet/pods/b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2/volumes" Jul 07 16:32:20.642132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.642094 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-565ddf645f-v9wzf"] Jul 07 16:32:20.642623 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.642569 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cf48f19-7578-4a1f-bcfb-622d0705a97a" containerName="authorino" Jul 07 16:32:20.642623 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.642586 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cf48f19-7578-4a1f-bcfb-622d0705a97a" containerName="authorino" Jul 07 16:32:20.642623 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.642621 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2" containerName="authorino" Jul 07 16:32:20.642782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.642629 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2" containerName="authorino" Jul 07 16:32:20.642782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.642717 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6733c94-28e4-4c9d-b5cd-7b92ff1e0da2" containerName="authorino" Jul 07 16:32:20.642782 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.642732 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cf48f19-7578-4a1f-bcfb-622d0705a97a" containerName="authorino" Jul 07 16:32:20.646940 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.646915 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:20.649975 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.649953 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 16:32:20.650106 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.649961 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 16:32:20.650106 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.650015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-64hbj\"" Jul 07 16:32:20.657905 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.657874 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-565ddf645f-v9wzf"] Jul 07 16:32:20.696941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.696910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d718d89-7194-46f4-8f2f-dfffa8daef17-webhook-cert\") pod \"maas-controller-565ddf645f-v9wzf\" (UID: \"7d718d89-7194-46f4-8f2f-dfffa8daef17\") " pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:20.697084 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.696966 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rhkw\" (UniqueName: \"kubernetes.io/projected/7d718d89-7194-46f4-8f2f-dfffa8daef17-kube-api-access-4rhkw\") pod \"maas-controller-565ddf645f-v9wzf\" (UID: \"7d718d89-7194-46f4-8f2f-dfffa8daef17\") " pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:20.797584 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.797549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d718d89-7194-46f4-8f2f-dfffa8daef17-webhook-cert\") pod \"maas-controller-565ddf645f-v9wzf\" (UID: \"7d718d89-7194-46f4-8f2f-dfffa8daef17\") " pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:20.797751 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.797609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rhkw\" (UniqueName: \"kubernetes.io/projected/7d718d89-7194-46f4-8f2f-dfffa8daef17-kube-api-access-4rhkw\") pod \"maas-controller-565ddf645f-v9wzf\" (UID: \"7d718d89-7194-46f4-8f2f-dfffa8daef17\") " pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:20.800085 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.800057 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d718d89-7194-46f4-8f2f-dfffa8daef17-webhook-cert\") pod \"maas-controller-565ddf645f-v9wzf\" (UID: \"7d718d89-7194-46f4-8f2f-dfffa8daef17\") " pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:20.818164 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.818135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rhkw\" (UniqueName: \"kubernetes.io/projected/7d718d89-7194-46f4-8f2f-dfffa8daef17-kube-api-access-4rhkw\") pod \"maas-controller-565ddf645f-v9wzf\" (UID: \"7d718d89-7194-46f4-8f2f-dfffa8daef17\") " pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:20.852111 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.852070 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-555fff8886-6d2lw"] Jul 07 16:32:20.855588 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.855568 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:20.872647 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.872616 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-555fff8886-6d2lw"] Jul 07 16:32:20.958085 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.957995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:20.998493 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.998456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjd54\" (UniqueName: \"kubernetes.io/projected/9063e193-1ae2-4d8e-a93d-4c43036f3ae5-kube-api-access-zjd54\") pod \"maas-controller-555fff8886-6d2lw\" (UID: \"9063e193-1ae2-4d8e-a93d-4c43036f3ae5\") " pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:20.998662 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:20.998607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9063e193-1ae2-4d8e-a93d-4c43036f3ae5-webhook-cert\") pod \"maas-controller-555fff8886-6d2lw\" (UID: \"9063e193-1ae2-4d8e-a93d-4c43036f3ae5\") " pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:21.096678 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:21.096570 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-565ddf645f-v9wzf"] Jul 07 16:32:21.099429 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:21.099398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9063e193-1ae2-4d8e-a93d-4c43036f3ae5-webhook-cert\") pod \"maas-controller-555fff8886-6d2lw\" (UID: \"9063e193-1ae2-4d8e-a93d-4c43036f3ae5\") " pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:21.099594 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:21.099473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjd54\" (UniqueName: \"kubernetes.io/projected/9063e193-1ae2-4d8e-a93d-4c43036f3ae5-kube-api-access-zjd54\") pod \"maas-controller-555fff8886-6d2lw\" (UID: \"9063e193-1ae2-4d8e-a93d-4c43036f3ae5\") " pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:21.099660 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:32:21.099603 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d718d89_7194_46f4_8f2f_dfffa8daef17.slice/crio-e672c74f78525b3e4d943fe0bb75836b797e8ccb3f8b4bdfc7aab661aada3638 WatchSource:0}: Error finding container e672c74f78525b3e4d943fe0bb75836b797e8ccb3f8b4bdfc7aab661aada3638: Status 404 returned error can't find the container with id e672c74f78525b3e4d943fe0bb75836b797e8ccb3f8b4bdfc7aab661aada3638 Jul 07 16:32:21.102192 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:21.102171 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9063e193-1ae2-4d8e-a93d-4c43036f3ae5-webhook-cert\") pod \"maas-controller-555fff8886-6d2lw\" (UID: \"9063e193-1ae2-4d8e-a93d-4c43036f3ae5\") " pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:21.107982 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:21.107955 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjd54\" (UniqueName: \"kubernetes.io/projected/9063e193-1ae2-4d8e-a93d-4c43036f3ae5-kube-api-access-zjd54\") pod \"maas-controller-555fff8886-6d2lw\" (UID: \"9063e193-1ae2-4d8e-a93d-4c43036f3ae5\") " pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:21.166625 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:21.166590 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:21.306001 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:21.305962 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-555fff8886-6d2lw"] Jul 07 16:32:21.307846 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:32:21.307821 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9063e193_1ae2_4d8e_a93d_4c43036f3ae5.slice/crio-7bf043c5abb8d7473d6106a1dd77d5ba2cc7ba8241a13a3823cbb4e6f8040d90 WatchSource:0}: Error finding container 7bf043c5abb8d7473d6106a1dd77d5ba2cc7ba8241a13a3823cbb4e6f8040d90: Status 404 returned error can't find the container with id 7bf043c5abb8d7473d6106a1dd77d5ba2cc7ba8241a13a3823cbb4e6f8040d90 Jul 07 16:32:21.993835 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:21.993795 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-555fff8886-6d2lw" event={"ID":"9063e193-1ae2-4d8e-a93d-4c43036f3ae5","Type":"ContainerStarted","Data":"7bf043c5abb8d7473d6106a1dd77d5ba2cc7ba8241a13a3823cbb4e6f8040d90"} Jul 07 16:32:21.995401 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:21.995366 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-565ddf645f-v9wzf" event={"ID":"7d718d89-7194-46f4-8f2f-dfffa8daef17","Type":"ContainerStarted","Data":"e672c74f78525b3e4d943fe0bb75836b797e8ccb3f8b4bdfc7aab661aada3638"} Jul 07 16:32:24.007661 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:24.007620 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-565ddf645f-v9wzf" event={"ID":"7d718d89-7194-46f4-8f2f-dfffa8daef17","Type":"ContainerStarted","Data":"6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662"} Jul 07 16:32:24.008158 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:24.007788 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:24.009274 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:24.009242 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-555fff8886-6d2lw" event={"ID":"9063e193-1ae2-4d8e-a93d-4c43036f3ae5","Type":"ContainerStarted","Data":"2d3a68a844047ebe6d4057a5446c0ecfdb230c7acb209101fe158c7c978ff9e3"} Jul 07 16:32:24.009422 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:24.009297 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:24.033147 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:24.033097 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-565ddf645f-v9wzf" podStartSLOduration=1.555908596 podStartE2EDuration="4.03308075s" totalImagesPullingTime="2.477172154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:32:24.03077464 +0000 UTC m=+570.140111329" watchObservedRunningTime="2026-07-07 16:32:24.03308075 +0000 UTC m=+570.142417435" Jul 07 16:32:24.054726 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:24.054676 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-555fff8886-6d2lw" podStartSLOduration=1.7956855699999998 podStartE2EDuration="4.054661441s" totalImagesPullingTime="2.258975871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:32:24.054494443 +0000 UTC m=+570.163831129" watchObservedRunningTime="2026-07-07 16:32:24.054661441 +0000 UTC m=+570.163998126" Jul 07 16:32:35.020964 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.020926 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-555fff8886-6d2lw" Jul 07 16:32:35.021395 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.021016 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:35.072881 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.072847 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-565ddf645f-v9wzf"] Jul 07 16:32:35.073082 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.073056 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-565ddf645f-v9wzf" podUID="7d718d89-7194-46f4-8f2f-dfffa8daef17" containerName="manager" containerID="cri-o://6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662" gracePeriod=30 Jul 07 16:32:35.318206 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.318179 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:35.427627 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.427594 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rhkw\" (UniqueName: \"kubernetes.io/projected/7d718d89-7194-46f4-8f2f-dfffa8daef17-kube-api-access-4rhkw\") pod \"7d718d89-7194-46f4-8f2f-dfffa8daef17\" (UID: \"7d718d89-7194-46f4-8f2f-dfffa8daef17\") " Jul 07 16:32:35.427828 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.427680 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d718d89-7194-46f4-8f2f-dfffa8daef17-webhook-cert\") pod \"7d718d89-7194-46f4-8f2f-dfffa8daef17\" (UID: \"7d718d89-7194-46f4-8f2f-dfffa8daef17\") " Jul 07 16:32:35.429936 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.429904 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d718d89-7194-46f4-8f2f-dfffa8daef17-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7d718d89-7194-46f4-8f2f-dfffa8daef17" (UID: "7d718d89-7194-46f4-8f2f-dfffa8daef17"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:32:35.430064 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.430002 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d718d89-7194-46f4-8f2f-dfffa8daef17-kube-api-access-4rhkw" (OuterVolumeSpecName: "kube-api-access-4rhkw") pod "7d718d89-7194-46f4-8f2f-dfffa8daef17" (UID: "7d718d89-7194-46f4-8f2f-dfffa8daef17"). InnerVolumeSpecName "kube-api-access-4rhkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:32:35.528979 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.528935 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d718d89-7194-46f4-8f2f-dfffa8daef17-webhook-cert\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:32:35.528979 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:35.528971 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rhkw\" (UniqueName: \"kubernetes.io/projected/7d718d89-7194-46f4-8f2f-dfffa8daef17-kube-api-access-4rhkw\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:32:36.064390 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.064351 2562 generic.go:356] "Generic (PLEG): container finished" podID="7d718d89-7194-46f4-8f2f-dfffa8daef17" containerID="6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662" exitCode=0 Jul 07 16:32:36.064849 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.064397 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-565ddf645f-v9wzf" Jul 07 16:32:36.064849 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.064433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-565ddf645f-v9wzf" event={"ID":"7d718d89-7194-46f4-8f2f-dfffa8daef17","Type":"ContainerDied","Data":"6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662"} Jul 07 16:32:36.064849 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.064483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-565ddf645f-v9wzf" event={"ID":"7d718d89-7194-46f4-8f2f-dfffa8daef17","Type":"ContainerDied","Data":"e672c74f78525b3e4d943fe0bb75836b797e8ccb3f8b4bdfc7aab661aada3638"} Jul 07 16:32:36.064849 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.064521 2562 scope.go:117] "RemoveContainer" containerID="6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662" Jul 07 16:32:36.074230 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.074042 2562 scope.go:117] "RemoveContainer" containerID="6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662" Jul 07 16:32:36.074316 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:32:36.074298 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662\": container with ID starting with 6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662 not found: ID does not exist" containerID="6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662" Jul 07 16:32:36.074364 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.074325 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662"} err="failed to get container status \"6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662\": rpc error: code = NotFound desc = could not find container \"6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662\": container with ID starting with 6b7f522c1c51e6970259e0fe133126e7b54b6019577e72aa4c73952bea9c0662 not found: ID does not exist" Jul 07 16:32:36.086805 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.086780 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-565ddf645f-v9wzf"] Jul 07 16:32:36.089858 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.089831 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-565ddf645f-v9wzf"] Jul 07 16:32:36.463066 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:36.463034 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d718d89-7194-46f4-8f2f-dfffa8daef17" path="/var/lib/kubelet/pods/7d718d89-7194-46f4-8f2f-dfffa8daef17/volumes" Jul 07 16:32:54.302468 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:54.302438 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbfrs_df53ac47-e829-4404-83cf-2d5db8a8398a/ovn-acl-logging/0.log" Jul 07 16:32:54.305157 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:54.305136 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbfrs_df53ac47-e829-4404-83cf-2d5db8a8398a/ovn-acl-logging/0.log" Jul 07 16:32:56.032950 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.032914 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6fcd7ccfb-k9kcr"] Jul 07 16:32:56.033330 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.033232 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d718d89-7194-46f4-8f2f-dfffa8daef17" containerName="manager" Jul 07 16:32:56.033330 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.033243 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d718d89-7194-46f4-8f2f-dfffa8daef17" containerName="manager" Jul 07 16:32:56.033330 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.033308 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d718d89-7194-46f4-8f2f-dfffa8daef17" containerName="manager" Jul 07 16:32:56.037396 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.037379 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.040341 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.040314 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 07 16:32:56.040471 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.040365 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lgph8\"" Jul 07 16:32:56.047264 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.047231 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6fcd7ccfb-k9kcr"] Jul 07 16:32:56.116150 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.116121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7phtx\" (UniqueName: \"kubernetes.io/projected/52b1e667-567b-435a-a719-9362352facc4-kube-api-access-7phtx\") pod \"maas-api-6fcd7ccfb-k9kcr\" (UID: \"52b1e667-567b-435a-a719-9362352facc4\") " pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.116312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.116161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52b1e667-567b-435a-a719-9362352facc4-maas-api-tls\") pod \"maas-api-6fcd7ccfb-k9kcr\" (UID: \"52b1e667-567b-435a-a719-9362352facc4\") " pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.116312 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.116194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b1e667-567b-435a-a719-9362352facc4-openshift-service-ca\") pod \"maas-api-6fcd7ccfb-k9kcr\" (UID: \"52b1e667-567b-435a-a719-9362352facc4\") " pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.217392 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.217355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7phtx\" (UniqueName: \"kubernetes.io/projected/52b1e667-567b-435a-a719-9362352facc4-kube-api-access-7phtx\") pod \"maas-api-6fcd7ccfb-k9kcr\" (UID: \"52b1e667-567b-435a-a719-9362352facc4\") " pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.217593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.217408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52b1e667-567b-435a-a719-9362352facc4-maas-api-tls\") pod \"maas-api-6fcd7ccfb-k9kcr\" (UID: \"52b1e667-567b-435a-a719-9362352facc4\") " pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.217593 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.217455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b1e667-567b-435a-a719-9362352facc4-openshift-service-ca\") pod \"maas-api-6fcd7ccfb-k9kcr\" (UID: \"52b1e667-567b-435a-a719-9362352facc4\") " pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.218276 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.218204 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b1e667-567b-435a-a719-9362352facc4-openshift-service-ca\") pod \"maas-api-6fcd7ccfb-k9kcr\" (UID: \"52b1e667-567b-435a-a719-9362352facc4\") " pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.220089 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.220066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52b1e667-567b-435a-a719-9362352facc4-maas-api-tls\") pod \"maas-api-6fcd7ccfb-k9kcr\" (UID: \"52b1e667-567b-435a-a719-9362352facc4\") " pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.227320 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.227294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7phtx\" (UniqueName: \"kubernetes.io/projected/52b1e667-567b-435a-a719-9362352facc4-kube-api-access-7phtx\") pod \"maas-api-6fcd7ccfb-k9kcr\" (UID: \"52b1e667-567b-435a-a719-9362352facc4\") " pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.348358 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.348271 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:56.432435 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.432408 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-5grkc"] Jul 07 16:32:56.436940 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.436916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:32:56.440842 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.440787 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fhj9z\"" Jul 07 16:32:56.440961 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.440937 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 16:32:56.448080 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.448058 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-5grkc"] Jul 07 16:32:56.496170 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.496146 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6fcd7ccfb-k9kcr"] Jul 07 16:32:56.498247 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:32:56.498217 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b1e667_567b_435a_a719_9362352facc4.slice/crio-6629524ba254547145250cb557215b46be2cf2d24e2c0fa70f808d2a60d3389e WatchSource:0}: Error finding container 6629524ba254547145250cb557215b46be2cf2d24e2c0fa70f808d2a60d3389e: Status 404 returned error can't find the container with id 6629524ba254547145250cb557215b46be2cf2d24e2c0fa70f808d2a60d3389e Jul 07 16:32:56.521486 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.521452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp4pv\" (UniqueName: \"kubernetes.io/projected/96f25c6a-41f8-4ea2-8f2a-253288b5fadf-kube-api-access-kp4pv\") pod \"payload-processing-7bbcb654f4-5grkc\" (UID: \"96f25c6a-41f8-4ea2-8f2a-253288b5fadf\") " pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:32:56.521652 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.521523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f25c6a-41f8-4ea2-8f2a-253288b5fadf-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-5grkc\" (UID: \"96f25c6a-41f8-4ea2-8f2a-253288b5fadf\") " pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:32:56.628649 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.623246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp4pv\" (UniqueName: \"kubernetes.io/projected/96f25c6a-41f8-4ea2-8f2a-253288b5fadf-kube-api-access-kp4pv\") pod \"payload-processing-7bbcb654f4-5grkc\" (UID: \"96f25c6a-41f8-4ea2-8f2a-253288b5fadf\") " pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:32:56.628649 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.623321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f25c6a-41f8-4ea2-8f2a-253288b5fadf-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-5grkc\" (UID: \"96f25c6a-41f8-4ea2-8f2a-253288b5fadf\") " pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:32:56.628649 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.624398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f25c6a-41f8-4ea2-8f2a-253288b5fadf-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-5grkc\" (UID: \"96f25c6a-41f8-4ea2-8f2a-253288b5fadf\") " pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:32:56.633997 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.633970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp4pv\" (UniqueName: \"kubernetes.io/projected/96f25c6a-41f8-4ea2-8f2a-253288b5fadf-kube-api-access-kp4pv\") pod \"payload-processing-7bbcb654f4-5grkc\" (UID: \"96f25c6a-41f8-4ea2-8f2a-253288b5fadf\") " pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:32:56.749794 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.749756 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:32:56.889036 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:56.888912 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-5grkc"] Jul 07 16:32:56.891170 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:32:56.891140 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f25c6a_41f8_4ea2_8f2a_253288b5fadf.slice/crio-fffdfd5030f20f0f7e7fffbb7557199c31f894e5e8f75915fbab25b8a51454ad WatchSource:0}: Error finding container fffdfd5030f20f0f7e7fffbb7557199c31f894e5e8f75915fbab25b8a51454ad: Status 404 returned error can't find the container with id fffdfd5030f20f0f7e7fffbb7557199c31f894e5e8f75915fbab25b8a51454ad Jul 07 16:32:57.159237 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:57.159147 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" event={"ID":"52b1e667-567b-435a-a719-9362352facc4","Type":"ContainerStarted","Data":"6629524ba254547145250cb557215b46be2cf2d24e2c0fa70f808d2a60d3389e"} Jul 07 16:32:57.160295 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:57.160258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" event={"ID":"96f25c6a-41f8-4ea2-8f2a-253288b5fadf","Type":"ContainerStarted","Data":"fffdfd5030f20f0f7e7fffbb7557199c31f894e5e8f75915fbab25b8a51454ad"} Jul 07 16:32:59.171357 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:59.171320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" event={"ID":"52b1e667-567b-435a-a719-9362352facc4","Type":"ContainerStarted","Data":"0f30f2644822108d2aa91797c798c58db936182e3672957200b209f786e6d9fc"} Jul 07 16:32:59.171766 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:59.171432 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:32:59.195310 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:32:59.195263 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" podStartSLOduration=1.171012484 podStartE2EDuration="3.195247412s" totalImagesPullingTime="2.024234928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:32:59.193358058 +0000 UTC m=+605.302694744" watchObservedRunningTime="2026-07-07 16:32:59.195247412 +0000 UTC m=+605.304584097" Jul 07 16:33:01.182279 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:01.182244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" event={"ID":"96f25c6a-41f8-4ea2-8f2a-253288b5fadf","Type":"ContainerStarted","Data":"5c5ac89088d47a4f631a864e25a67e10e81a024302e837c4c020b7fb80129602"} Jul 07 16:33:01.182705 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:01.182405 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:33:01.205482 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:01.205423 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" podStartSLOduration=0.992862623 podStartE2EDuration="5.205400861s" totalImagesPullingTime="4.212538238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:33:01.203621221 +0000 UTC m=+607.312957918" watchObservedRunningTime="2026-07-07 16:33:01.205400861 +0000 UTC m=+607.314737546" Jul 07 16:33:05.182180 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:05.182143 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:33:07.252961 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:07.252919 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 07 16:33:07.253405 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:07.253188 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" containerID="cri-o://63bc299b655d7adecf67cd72046ee7021ae5e6e7c5b6be9561963e851e727d20" gracePeriod=30 Jul 07 16:33:09.222968 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:09.222938 2562 generic.go:356] "Generic (PLEG): container finished" podID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerID="63bc299b655d7adecf67cd72046ee7021ae5e6e7c5b6be9561963e851e727d20" exitCode=143 Jul 07 16:33:09.223375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:09.222986 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb4dd63d-ea65-4c26-9ceb-04275d247c8e","Type":"ContainerDied","Data":"63bc299b655d7adecf67cd72046ee7021ae5e6e7c5b6be9561963e851e727d20"} Jul 07 16:33:09.296160 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:09.296134 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:09.449539 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:09.449421 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t499\" (UniqueName: \"kubernetes.io/projected/cb4dd63d-ea65-4c26-9ceb-04275d247c8e-kube-api-access-4t499\") pod \"cb4dd63d-ea65-4c26-9ceb-04275d247c8e\" (UID: \"cb4dd63d-ea65-4c26-9ceb-04275d247c8e\") " Jul 07 16:33:09.451891 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:09.451864 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4dd63d-ea65-4c26-9ceb-04275d247c8e-kube-api-access-4t499" (OuterVolumeSpecName: "kube-api-access-4t499") pod "cb4dd63d-ea65-4c26-9ceb-04275d247c8e" (UID: "cb4dd63d-ea65-4c26-9ceb-04275d247c8e"). InnerVolumeSpecName "kube-api-access-4t499". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:33:09.550480 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:09.550443 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t499\" (UniqueName: \"kubernetes.io/projected/cb4dd63d-ea65-4c26-9ceb-04275d247c8e-kube-api-access-4t499\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:33:10.229143 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.229110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb4dd63d-ea65-4c26-9ceb-04275d247c8e","Type":"ContainerDied","Data":"5d898f3871ef66c0628f506c23eaf6c688acd9737b41fe9ddaf250c59a3e1960"} Jul 07 16:33:10.229143 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.229133 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:10.229638 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.229173 2562 scope.go:117] "RemoveContainer" containerID="63bc299b655d7adecf67cd72046ee7021ae5e6e7c5b6be9561963e851e727d20" Jul 07 16:33:10.250711 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.250682 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 07 16:33:10.253941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.253918 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 07 16:33:10.277047 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.277024 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 07 16:33:10.277348 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.277336 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" Jul 07 16:33:10.277385 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.277349 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" Jul 07 16:33:10.277428 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.277420 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" containerName="keycloak" Jul 07 16:33:10.281669 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.281653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:10.284622 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.284595 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 07 16:33:10.284712 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.284645 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 07 16:33:10.284712 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.284656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 07 16:33:10.284712 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.284681 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-n7twb\"" Jul 07 16:33:10.284841 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.284819 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 07 16:33:10.290448 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.290426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 07 16:33:10.357195 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.357157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d69p\" (UniqueName: \"kubernetes.io/projected/dc4d7363-3626-4927-9dbc-4b1e6074d0c4-kube-api-access-4d69p\") pod \"maas-keycloak-0\" (UID: \"dc4d7363-3626-4927-9dbc-4b1e6074d0c4\") " pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:10.357377 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.357243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dc4d7363-3626-4927-9dbc-4b1e6074d0c4-test-realms\") pod \"maas-keycloak-0\" (UID: \"dc4d7363-3626-4927-9dbc-4b1e6074d0c4\") " pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:10.458583 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.458540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d69p\" (UniqueName: \"kubernetes.io/projected/dc4d7363-3626-4927-9dbc-4b1e6074d0c4-kube-api-access-4d69p\") pod \"maas-keycloak-0\" (UID: \"dc4d7363-3626-4927-9dbc-4b1e6074d0c4\") " pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:10.458746 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.458638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dc4d7363-3626-4927-9dbc-4b1e6074d0c4-test-realms\") pod \"maas-keycloak-0\" (UID: \"dc4d7363-3626-4927-9dbc-4b1e6074d0c4\") " pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:10.459292 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.459275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dc4d7363-3626-4927-9dbc-4b1e6074d0c4-test-realms\") pod \"maas-keycloak-0\" (UID: \"dc4d7363-3626-4927-9dbc-4b1e6074d0c4\") " pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:10.464114 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.464089 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb4dd63d-ea65-4c26-9ceb-04275d247c8e" path="/var/lib/kubelet/pods/cb4dd63d-ea65-4c26-9ceb-04275d247c8e/volumes" Jul 07 16:33:10.468821 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.468790 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d69p\" (UniqueName: \"kubernetes.io/projected/dc4d7363-3626-4927-9dbc-4b1e6074d0c4-kube-api-access-4d69p\") pod \"maas-keycloak-0\" (UID: \"dc4d7363-3626-4927-9dbc-4b1e6074d0c4\") " pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:10.592016 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.591932 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:10.728604 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.728578 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 07 16:33:10.730487 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:33:10.730455 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4d7363_3626_4927_9dbc_4b1e6074d0c4.slice/crio-c925831d7027a1fa08700b93ae1e5fac67e04a740c93eeed416527f4fe1b75f9 WatchSource:0}: Error finding container c925831d7027a1fa08700b93ae1e5fac67e04a740c93eeed416527f4fe1b75f9: Status 404 returned error can't find the container with id c925831d7027a1fa08700b93ae1e5fac67e04a740c93eeed416527f4fe1b75f9 Jul 07 16:33:10.732003 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:10.731980 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:33:11.236680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:11.236644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dc4d7363-3626-4927-9dbc-4b1e6074d0c4","Type":"ContainerStarted","Data":"c925831d7027a1fa08700b93ae1e5fac67e04a740c93eeed416527f4fe1b75f9"} Jul 07 16:33:12.190225 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:12.190163 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-5grkc" Jul 07 16:33:12.242941 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:12.242895 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dc4d7363-3626-4927-9dbc-4b1e6074d0c4","Type":"ContainerStarted","Data":"79003e9125a3c37a29ca3460ba94c52ee72aa060200a57e25b21ea9c7fefb4ff"} Jul 07 16:33:12.266919 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:12.266858 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6452409989999999 podStartE2EDuration="2.266839402s" totalImagesPullingTime="621.598403ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:33:12.265058115 +0000 UTC m=+618.374395013" watchObservedRunningTime="2026-07-07 16:33:12.266839402 +0000 UTC m=+618.376176086" Jul 07 16:33:12.593390 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:12.593260 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:12.594635 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:12.594601 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:13.592423 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:13.592375 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:14.593073 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:14.593025 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:15.592935 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:15.592886 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:16.593270 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:16.593224 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:17.593869 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:17.593404 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:18.593017 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:18.592965 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:19.593196 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:19.593145 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:20.592322 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:20.592278 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:20.592785 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:20.592617 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:21.593136 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:21.593077 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:22.593003 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:22.592950 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:23.592990 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:23.592941 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:24.592414 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:24.592368 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jul 07 16:33:25.721182 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:25.721129 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:25.741245 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:25.741188 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dc4d7363-3626-4927-9dbc-4b1e6074d0c4" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 16:33:35.729223 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:35.729185 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 07 16:33:46.475403 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.475373 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85b4c4cc9b-8hng8"] Jul 07 16:33:46.479817 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.479796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.482766 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.482746 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 07 16:33:46.487482 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.487459 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85b4c4cc9b-8hng8"] Jul 07 16:33:46.607645 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.607598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-oidc-ca\") pod \"authorino-85b4c4cc9b-8hng8\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.607645 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.607644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zkw7\" (UniqueName: \"kubernetes.io/projected/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-kube-api-access-6zkw7\") pod \"authorino-85b4c4cc9b-8hng8\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.607900 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.607766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-tls-cert\") pod \"authorino-85b4c4cc9b-8hng8\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.708375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.708344 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-oidc-ca\") pod \"authorino-85b4c4cc9b-8hng8\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.708375 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.708379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zkw7\" (UniqueName: \"kubernetes.io/projected/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-kube-api-access-6zkw7\") pod \"authorino-85b4c4cc9b-8hng8\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.708648 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.708431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-tls-cert\") pod \"authorino-85b4c4cc9b-8hng8\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.709016 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.708989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-oidc-ca\") pod \"authorino-85b4c4cc9b-8hng8\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.710983 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.710962 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-tls-cert\") pod \"authorino-85b4c4cc9b-8hng8\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.717336 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.717298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zkw7\" (UniqueName: \"kubernetes.io/projected/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-kube-api-access-6zkw7\") pod \"authorino-85b4c4cc9b-8hng8\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.789475 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.789387 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:33:46.922584 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:46.922495 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85b4c4cc9b-8hng8"] Jul 07 16:33:46.924987 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:33:46.924952 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8ed1d72_6261_4054_9c3a_f0765e4ee67e.slice/crio-83f69ad2402197e3a7cada09b86eb9d56619ab5b69ac3608764ca079188828f2 WatchSource:0}: Error finding container 83f69ad2402197e3a7cada09b86eb9d56619ab5b69ac3608764ca079188828f2: Status 404 returned error can't find the container with id 83f69ad2402197e3a7cada09b86eb9d56619ab5b69ac3608764ca079188828f2 Jul 07 16:33:47.440135 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.440096 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" event={"ID":"b8ed1d72-6261-4054-9c3a-f0765e4ee67e","Type":"ContainerStarted","Data":"20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d"} Jul 07 16:33:47.440314 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.440148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" event={"ID":"b8ed1d72-6261-4054-9c3a-f0765e4ee67e","Type":"ContainerStarted","Data":"83f69ad2402197e3a7cada09b86eb9d56619ab5b69ac3608764ca079188828f2"} Jul 07 16:33:47.459762 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.459710 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" podStartSLOduration=1.046252332 podStartE2EDuration="1.459693982s" totalImagesPullingTime="413.44165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:33:47.458736055 +0000 UTC m=+653.568072739" watchObservedRunningTime="2026-07-07 16:33:47.459693982 +0000 UTC m=+653.569030666" Jul 07 16:33:47.498296 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.498233 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6876f6777d-wpsqc"] Jul 07 16:33:47.498821 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.498542 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6876f6777d-wpsqc" podUID="82cf539f-383e-495c-ac9b-c8a9d5045399" containerName="authorino" containerID="cri-o://8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047" gracePeriod=30 Jul 07 16:33:47.756373 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.756345 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:33:47.820124 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.820092 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82cf539f-383e-495c-ac9b-c8a9d5045399-tls-cert\") pod \"82cf539f-383e-495c-ac9b-c8a9d5045399\" (UID: \"82cf539f-383e-495c-ac9b-c8a9d5045399\") " Jul 07 16:33:47.820285 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.820164 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd5vl\" (UniqueName: \"kubernetes.io/projected/82cf539f-383e-495c-ac9b-c8a9d5045399-kube-api-access-xd5vl\") pod \"82cf539f-383e-495c-ac9b-c8a9d5045399\" (UID: \"82cf539f-383e-495c-ac9b-c8a9d5045399\") " Jul 07 16:33:47.822256 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.822221 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82cf539f-383e-495c-ac9b-c8a9d5045399-kube-api-access-xd5vl" (OuterVolumeSpecName: "kube-api-access-xd5vl") pod "82cf539f-383e-495c-ac9b-c8a9d5045399" (UID: "82cf539f-383e-495c-ac9b-c8a9d5045399"). InnerVolumeSpecName "kube-api-access-xd5vl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:33:47.830142 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.830107 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82cf539f-383e-495c-ac9b-c8a9d5045399-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "82cf539f-383e-495c-ac9b-c8a9d5045399" (UID: "82cf539f-383e-495c-ac9b-c8a9d5045399"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:33:47.921769 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.921730 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82cf539f-383e-495c-ac9b-c8a9d5045399-tls-cert\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:33:47.921769 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:47.921762 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd5vl\" (UniqueName: \"kubernetes.io/projected/82cf539f-383e-495c-ac9b-c8a9d5045399-kube-api-access-xd5vl\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:33:48.446202 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:48.446171 2562 generic.go:356] "Generic (PLEG): container finished" podID="82cf539f-383e-495c-ac9b-c8a9d5045399" containerID="8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047" exitCode=0 Jul 07 16:33:48.446397 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:48.446210 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6876f6777d-wpsqc" Jul 07 16:33:48.446397 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:48.446253 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6876f6777d-wpsqc" event={"ID":"82cf539f-383e-495c-ac9b-c8a9d5045399","Type":"ContainerDied","Data":"8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047"} Jul 07 16:33:48.446397 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:48.446301 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6876f6777d-wpsqc" event={"ID":"82cf539f-383e-495c-ac9b-c8a9d5045399","Type":"ContainerDied","Data":"cdffebaea0c9a855909fffa19ac67bac1d4e75554df6146b3e5f577af5026048"} Jul 07 16:33:48.446397 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:48.446325 2562 scope.go:117] "RemoveContainer" containerID="8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047" Jul 07 16:33:48.454857 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:48.454840 2562 scope.go:117] "RemoveContainer" containerID="8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047" Jul 07 16:33:48.455114 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:33:48.455098 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047\": container with ID starting with 8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047 not found: ID does not exist" containerID="8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047" Jul 07 16:33:48.455156 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:48.455123 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047"} err="failed to get container status \"8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047\": rpc error: code = NotFound desc = could not find container \"8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047\": container with ID starting with 8dc24a57d93318f7a16a2efd2c93e9be62b1b42b3d66bf2ed2dda45bffeb6047 not found: ID does not exist" Jul 07 16:33:48.489528 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:48.489482 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6876f6777d-wpsqc"] Jul 07 16:33:48.492094 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:48.492071 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6876f6777d-wpsqc"] Jul 07 16:33:50.462619 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:33:50.462583 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82cf539f-383e-495c-ac9b-c8a9d5045399" path="/var/lib/kubelet/pods/82cf539f-383e-495c-ac9b-c8a9d5045399/volumes" Jul 07 16:34:04.973333 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.973290 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v"] Jul 07 16:34:04.973809 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.973674 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cf539f-383e-495c-ac9b-c8a9d5045399" containerName="authorino" Jul 07 16:34:04.973809 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.973687 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cf539f-383e-495c-ac9b-c8a9d5045399" containerName="authorino" Jul 07 16:34:04.973809 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.973742 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="82cf539f-383e-495c-ac9b-c8a9d5045399" containerName="authorino" Jul 07 16:34:04.976304 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.976282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:04.979325 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.979301 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bkj8k\"" Jul 07 16:34:04.980810 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.980789 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 16:34:04.980944 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.980847 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 16:34:04.980944 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.980848 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 16:34:04.992040 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:04.992011 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v"] Jul 07 16:34:05.084380 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.084344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2g9p\" (UniqueName: \"kubernetes.io/projected/eab0016b-aa7f-40d1-8692-0eb3effa3df8-kube-api-access-w2g9p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.084380 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.084389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.084692 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.084427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.084692 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.084529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.084692 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.084574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.084692 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.084616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eab0016b-aa7f-40d1-8692-0eb3effa3df8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.185175 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.185135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2g9p\" (UniqueName: \"kubernetes.io/projected/eab0016b-aa7f-40d1-8692-0eb3effa3df8-kube-api-access-w2g9p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.185361 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.185186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.185361 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.185228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.185361 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.185275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.185361 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.185314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.185361 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.185349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eab0016b-aa7f-40d1-8692-0eb3effa3df8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.185680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.185656 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.185745 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.185692 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.185745 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.185723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.187843 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.187812 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eab0016b-aa7f-40d1-8692-0eb3effa3df8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.188130 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.188111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eab0016b-aa7f-40d1-8692-0eb3effa3df8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.194823 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.194802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2g9p\" (UniqueName: \"kubernetes.io/projected/eab0016b-aa7f-40d1-8692-0eb3effa3df8-kube-api-access-w2g9p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdd6v\" (UID: \"eab0016b-aa7f-40d1-8692-0eb3effa3df8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.288195 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.288105 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:05.438339 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.438308 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v"] Jul 07 16:34:05.441411 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:34:05.441381 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab0016b_aa7f_40d1_8692_0eb3effa3df8.slice/crio-c38154d60bed19214eab998cb57b436db991c25290ee34f5bac93a8d04de2a9f WatchSource:0}: Error finding container c38154d60bed19214eab998cb57b436db991c25290ee34f5bac93a8d04de2a9f: Status 404 returned error can't find the container with id c38154d60bed19214eab998cb57b436db991c25290ee34f5bac93a8d04de2a9f Jul 07 16:34:05.531111 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:05.531074 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" event={"ID":"eab0016b-aa7f-40d1-8692-0eb3effa3df8","Type":"ContainerStarted","Data":"c38154d60bed19214eab998cb57b436db991c25290ee34f5bac93a8d04de2a9f"} Jul 07 16:34:07.546948 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:07.546911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" event={"ID":"eab0016b-aa7f-40d1-8692-0eb3effa3df8","Type":"ContainerStarted","Data":"484fdaecb1ee0842f0727cdd04bec3394cdf9bb719b98fcfbc173127433ae01c"} Jul 07 16:34:07.575055 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:07.575000 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" podStartSLOduration=2.424639882 podStartE2EDuration="3.574980475s" totalImagesPullingTime="1.150340593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:34:07.574879359 +0000 UTC m=+673.684216045" watchObservedRunningTime="2026-07-07 16:34:07.574980475 +0000 UTC m=+673.684317159" Jul 07 16:34:14.472979 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.472937 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9p759"] Jul 07 16:34:14.476165 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.476145 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.479257 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.479229 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 16:34:14.488493 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.488463 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9p759"] Jul 07 16:34:14.579317 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.579280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b78d6\" (UniqueName: \"kubernetes.io/projected/7bcf276a-8527-4b1a-a121-317095e2950d-kube-api-access-b78d6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.579485 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.579326 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.579485 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.579354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.579485 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.579444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.579625 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.579485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bcf276a-8527-4b1a-a121-317095e2950d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.579625 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.579536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.680449 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.680396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b78d6\" (UniqueName: \"kubernetes.io/projected/7bcf276a-8527-4b1a-a121-317095e2950d-kube-api-access-b78d6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.680449 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.680457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.680700 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.680486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.680700 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.680577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.680700 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.680599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bcf276a-8527-4b1a-a121-317095e2950d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.680700 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.680626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.680986 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.680946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.681087 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.680986 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.681087 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.680962 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.682979 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.682958 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bcf276a-8527-4b1a-a121-317095e2950d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.683130 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.683111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bcf276a-8527-4b1a-a121-317095e2950d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.690458 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.690431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b78d6\" (UniqueName: \"kubernetes.io/projected/7bcf276a-8527-4b1a-a121-317095e2950d-kube-api-access-b78d6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9p759\" (UID: \"7bcf276a-8527-4b1a-a121-317095e2950d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.787315 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.787224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:14.925135 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:14.925110 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9p759"] Jul 07 16:34:14.927124 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:34:14.927096 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bcf276a_8527_4b1a_a121_317095e2950d.slice/crio-361afd1f4f86672ef3637e0a4c22cc597a9e21220ff0c09c7f41216e475cae9c WatchSource:0}: Error finding container 361afd1f4f86672ef3637e0a4c22cc597a9e21220ff0c09c7f41216e475cae9c: Status 404 returned error can't find the container with id 361afd1f4f86672ef3637e0a4c22cc597a9e21220ff0c09c7f41216e475cae9c Jul 07 16:34:15.288833 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:15.288796 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:15.289021 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:15.288857 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:15.301364 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:15.301329 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:15.584117 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:15.584085 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" event={"ID":"7bcf276a-8527-4b1a-a121-317095e2950d","Type":"ContainerStarted","Data":"4fb3404d0780fe46da9f917c9f4e952e42f714b03a68d6ef0d67b92c9e9f17e6"} Jul 07 16:34:15.584648 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:15.584134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" event={"ID":"7bcf276a-8527-4b1a-a121-317095e2950d","Type":"ContainerStarted","Data":"361afd1f4f86672ef3637e0a4c22cc597a9e21220ff0c09c7f41216e475cae9c"} Jul 07 16:34:15.597119 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:15.597091 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdd6v" Jul 07 16:34:15.607756 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:15.607707 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" podStartSLOduration=1.4415642499999999 podStartE2EDuration="1.607691717s" totalImagesPullingTime="166.127467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:34:15.606563699 +0000 UTC m=+681.715900388" watchObservedRunningTime="2026-07-07 16:34:15.607691717 +0000 UTC m=+681.717028457" Jul 07 16:34:20.878473 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.878434 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq"] Jul 07 16:34:20.881035 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.881015 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:20.884265 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.884240 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 07 16:34:20.892046 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.892015 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq"] Jul 07 16:34:20.941953 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.941912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2acdf587-f97b-4c0b-a080-a55ba21edbb8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:20.942148 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.941976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:20.942148 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.942013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:20.942148 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.942046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:20.942148 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.942062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:20.942148 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:20.942089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg25j\" (UniqueName: \"kubernetes.io/projected/2acdf587-f97b-4c0b-a080-a55ba21edbb8-kube-api-access-tg25j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.043264 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.043224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.043463 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.043304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.043463 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.043367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.043463 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.043393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.043463 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.043438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg25j\" (UniqueName: \"kubernetes.io/projected/2acdf587-f97b-4c0b-a080-a55ba21edbb8-kube-api-access-tg25j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.043680 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.043483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2acdf587-f97b-4c0b-a080-a55ba21edbb8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.043751 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.043733 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.044266 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.044242 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.044643 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.044265 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.046235 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.046209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2acdf587-f97b-4c0b-a080-a55ba21edbb8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.046577 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.046457 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2acdf587-f97b-4c0b-a080-a55ba21edbb8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.053224 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.053193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg25j\" (UniqueName: \"kubernetes.io/projected/2acdf587-f97b-4c0b-a080-a55ba21edbb8-kube-api-access-tg25j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq\" (UID: \"2acdf587-f97b-4c0b-a080-a55ba21edbb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.193357 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.193270 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:21.331945 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.331919 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq"] Jul 07 16:34:21.334000 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:34:21.333976 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2acdf587_f97b_4c0b_a080_a55ba21edbb8.slice/crio-0f42ec3e0d97117fa107f3d12726a1c8bb3a62ae0a8a94cb15fc404eec944438 WatchSource:0}: Error finding container 0f42ec3e0d97117fa107f3d12726a1c8bb3a62ae0a8a94cb15fc404eec944438: Status 404 returned error can't find the container with id 0f42ec3e0d97117fa107f3d12726a1c8bb3a62ae0a8a94cb15fc404eec944438 Jul 07 16:34:21.611902 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:21.611871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" event={"ID":"2acdf587-f97b-4c0b-a080-a55ba21edbb8","Type":"ContainerStarted","Data":"0f42ec3e0d97117fa107f3d12726a1c8bb3a62ae0a8a94cb15fc404eec944438"} Jul 07 16:34:22.618407 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:22.618358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" event={"ID":"2acdf587-f97b-4c0b-a080-a55ba21edbb8","Type":"ContainerStarted","Data":"be2c788fce084fe9eb80f3335d66a41b03899803544b7aaa1d02668288aa077f"} Jul 07 16:34:22.657557 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:22.657480 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" podStartSLOduration=2.421127675 podStartE2EDuration="2.657465489s" totalImagesPullingTime="236.337814ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:34:22.655541708 +0000 UTC m=+688.764878383" watchObservedRunningTime="2026-07-07 16:34:22.657465489 +0000 UTC m=+688.766802174" Jul 07 16:34:24.788398 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:24.788354 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:24.788813 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:24.788493 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:24.801143 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:24.801111 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:25.646526 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:25.646486 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9p759" Jul 07 16:34:31.194351 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:31.194315 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:31.194825 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:31.194388 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:31.206956 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:31.206924 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:34:31.672530 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:34:31.672479 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq" Jul 07 16:35:28.498904 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.498870 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86794f9db5-mhzrv"] Jul 07 16:35:28.502354 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.502333 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.517640 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.517613 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86794f9db5-mhzrv"] Jul 07 16:35:28.560030 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.559999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6a56d0d6-4a5c-4150-8624-c4ea5e7fab27-oidc-ca\") pod \"authorino-86794f9db5-mhzrv\" (UID: \"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27\") " pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.560179 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.560058 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a56d0d6-4a5c-4150-8624-c4ea5e7fab27-tls-cert\") pod \"authorino-86794f9db5-mhzrv\" (UID: \"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27\") " pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.560179 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.560119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbb69\" (UniqueName: \"kubernetes.io/projected/6a56d0d6-4a5c-4150-8624-c4ea5e7fab27-kube-api-access-lbb69\") pod \"authorino-86794f9db5-mhzrv\" (UID: \"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27\") " pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.661154 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.661116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a56d0d6-4a5c-4150-8624-c4ea5e7fab27-tls-cert\") pod \"authorino-86794f9db5-mhzrv\" (UID: \"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27\") " pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.661355 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.661175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb69\" (UniqueName: \"kubernetes.io/projected/6a56d0d6-4a5c-4150-8624-c4ea5e7fab27-kube-api-access-lbb69\") pod \"authorino-86794f9db5-mhzrv\" (UID: \"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27\") " pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.661355 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.661246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6a56d0d6-4a5c-4150-8624-c4ea5e7fab27-oidc-ca\") pod \"authorino-86794f9db5-mhzrv\" (UID: \"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27\") " pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.661967 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.661941 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6a56d0d6-4a5c-4150-8624-c4ea5e7fab27-oidc-ca\") pod \"authorino-86794f9db5-mhzrv\" (UID: \"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27\") " pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.663649 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.663631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a56d0d6-4a5c-4150-8624-c4ea5e7fab27-tls-cert\") pod \"authorino-86794f9db5-mhzrv\" (UID: \"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27\") " pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.674876 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.674853 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbb69\" (UniqueName: \"kubernetes.io/projected/6a56d0d6-4a5c-4150-8624-c4ea5e7fab27-kube-api-access-lbb69\") pod \"authorino-86794f9db5-mhzrv\" (UID: \"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27\") " pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.811090 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.811006 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86794f9db5-mhzrv" Jul 07 16:35:28.944285 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:28.944264 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86794f9db5-mhzrv"] Jul 07 16:35:28.946242 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:35:28.946216 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a56d0d6_4a5c_4150_8624_c4ea5e7fab27.slice/crio-faf53f9a0c72d4fbd58c2c4c324a601f183e5508deef78e21fc3824e07c0ef74 WatchSource:0}: Error finding container faf53f9a0c72d4fbd58c2c4c324a601f183e5508deef78e21fc3824e07c0ef74: Status 404 returned error can't find the container with id faf53f9a0c72d4fbd58c2c4c324a601f183e5508deef78e21fc3824e07c0ef74 Jul 07 16:35:29.938917 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:29.938867 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86794f9db5-mhzrv" event={"ID":"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27","Type":"ContainerStarted","Data":"9a88cb2b15880f7507aac03a20d0317b555e40f1993bc2e490a7113dc2e2ed38"} Jul 07 16:35:29.938917 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:29.938917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86794f9db5-mhzrv" event={"ID":"6a56d0d6-4a5c-4150-8624-c4ea5e7fab27","Type":"ContainerStarted","Data":"faf53f9a0c72d4fbd58c2c4c324a601f183e5508deef78e21fc3824e07c0ef74"} Jul 07 16:35:29.980098 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:29.980051 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86794f9db5-mhzrv" podStartSLOduration=1.51992159 podStartE2EDuration="1.980033605s" totalImagesPullingTime="460.112015ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:29.977298272 +0000 UTC m=+756.086634958" watchObservedRunningTime="2026-07-07 16:35:29.980033605 +0000 UTC m=+756.089370290" Jul 07 16:35:30.048470 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.048425 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85b4c4cc9b-8hng8"] Jul 07 16:35:30.048750 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.048717 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" podUID="b8ed1d72-6261-4054-9c3a-f0765e4ee67e" containerName="authorino" containerID="cri-o://20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d" gracePeriod=30 Jul 07 16:35:30.309929 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.309901 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:35:30.376315 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.376279 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zkw7\" (UniqueName: \"kubernetes.io/projected/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-kube-api-access-6zkw7\") pod \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " Jul 07 16:35:30.376551 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.376371 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-oidc-ca\") pod \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " Jul 07 16:35:30.376551 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.376394 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-tls-cert\") pod \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\" (UID: \"b8ed1d72-6261-4054-9c3a-f0765e4ee67e\") " Jul 07 16:35:30.379243 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.379192 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-kube-api-access-6zkw7" (OuterVolumeSpecName: "kube-api-access-6zkw7") pod "b8ed1d72-6261-4054-9c3a-f0765e4ee67e" (UID: "b8ed1d72-6261-4054-9c3a-f0765e4ee67e"). InnerVolumeSpecName "kube-api-access-6zkw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:35:30.382486 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.382453 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "b8ed1d72-6261-4054-9c3a-f0765e4ee67e" (UID: "b8ed1d72-6261-4054-9c3a-f0765e4ee67e"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:35:30.389668 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.389640 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b8ed1d72-6261-4054-9c3a-f0765e4ee67e" (UID: "b8ed1d72-6261-4054-9c3a-f0765e4ee67e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:35:30.477226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.477193 2562 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-oidc-ca\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:35:30.477226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.477222 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-tls-cert\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:35:30.477410 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.477236 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zkw7\" (UniqueName: \"kubernetes.io/projected/b8ed1d72-6261-4054-9c3a-f0765e4ee67e-kube-api-access-6zkw7\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\"" Jul 07 16:35:30.947609 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.947568 2562 generic.go:356] "Generic (PLEG): container finished" podID="b8ed1d72-6261-4054-9c3a-f0765e4ee67e" containerID="20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d" exitCode=0 Jul 07 16:35:30.948092 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.947626 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" Jul 07 16:35:30.948092 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.947651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" event={"ID":"b8ed1d72-6261-4054-9c3a-f0765e4ee67e","Type":"ContainerDied","Data":"20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d"} Jul 07 16:35:30.948092 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.947701 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85b4c4cc9b-8hng8" event={"ID":"b8ed1d72-6261-4054-9c3a-f0765e4ee67e","Type":"ContainerDied","Data":"83f69ad2402197e3a7cada09b86eb9d56619ab5b69ac3608764ca079188828f2"} Jul 07 16:35:30.948092 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.947721 2562 scope.go:117] "RemoveContainer" containerID="20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d" Jul 07 16:35:30.960324 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.960301 2562 scope.go:117] "RemoveContainer" containerID="20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d" Jul 07 16:35:30.961032 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:35:30.961000 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d\": container with ID starting with 20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d not found: ID does not exist" containerID="20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d" Jul 07 16:35:30.961162 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.961042 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d"} err="failed to get container status \"20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d\": rpc error: code = NotFound desc = could not find container \"20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d\": container with ID starting with 20e898cdcc48c8a69022bea4a477d38f6ae23073317f727e38515071e63f870d not found: ID does not exist" Jul 07 16:35:30.969364 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.969330 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85b4c4cc9b-8hng8"] Jul 07 16:35:30.974226 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:30.974196 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85b4c4cc9b-8hng8"] Jul 07 16:35:32.463991 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:32.463959 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ed1d72-6261-4054-9c3a-f0765e4ee67e" path="/var/lib/kubelet/pods/b8ed1d72-6261-4054-9c3a-f0765e4ee67e/volumes" Jul 07 16:35:51.049063 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:51.048968 2562 generic.go:356] "Generic (PLEG): container finished" podID="52b1e667-567b-435a-a719-9362352facc4" containerID="0f30f2644822108d2aa91797c798c58db936182e3672957200b209f786e6d9fc" exitCode=137 Jul 07 16:35:51.049063 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:51.049043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" event={"ID":"52b1e667-567b-435a-a719-9362352facc4","Type":"ContainerDied","Data":"0f30f2644822108d2aa91797c798c58db936182e3672957200b209f786e6d9fc"} Jul 07 16:35:51.049664 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:51.049540 2562 scope.go:117] "RemoveContainer" containerID="0f30f2644822108d2aa91797c798c58db936182e3672957200b209f786e6d9fc" Jul 07 16:35:52.055665 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:52.055577 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" event={"ID":"52b1e667-567b-435a-a719-9362352facc4","Type":"ContainerStarted","Data":"c3b183c299afca8e3c8d4ee2010964bf112aa8cc3407102ffb87bb9d4567433a"} Jul 07 16:35:52.056019 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:52.055779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:35:58.065025 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:35:58.064995 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:36:39.279290 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:39.279257 2562 generic.go:356] "Generic (PLEG): container finished" podID="52b1e667-567b-435a-a719-9362352facc4" containerID="c3b183c299afca8e3c8d4ee2010964bf112aa8cc3407102ffb87bb9d4567433a" exitCode=137 Jul 07 16:36:39.279775 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:39.279319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" event={"ID":"52b1e667-567b-435a-a719-9362352facc4","Type":"ContainerDied","Data":"c3b183c299afca8e3c8d4ee2010964bf112aa8cc3407102ffb87bb9d4567433a"} Jul 07 16:36:39.279775 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:39.279365 2562 scope.go:117] "RemoveContainer" containerID="0f30f2644822108d2aa91797c798c58db936182e3672957200b209f786e6d9fc" Jul 07 16:36:39.279775 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:39.279692 2562 scope.go:117] "RemoveContainer" containerID="c3b183c299afca8e3c8d4ee2010964bf112aa8cc3407102ffb87bb9d4567433a" Jul 07 16:36:39.279942 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:36:39.279923 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-6fcd7ccfb-k9kcr_opendatahub(52b1e667-567b-435a-a719-9362352facc4)\"" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" podUID="52b1e667-567b-435a-a719-9362352facc4" Jul 07 16:36:39.340359 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:39.340327 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86794f9db5-mhzrv_6a56d0d6-4a5c-4150-8624-c4ea5e7fab27/authorino/0.log" Jul 07 16:36:43.061071 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:43.061027 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:36:43.061483 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:43.061425 2562 scope.go:117] "RemoveContainer" containerID="c3b183c299afca8e3c8d4ee2010964bf112aa8cc3407102ffb87bb9d4567433a" Jul 07 16:36:43.061644 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:36:43.061623 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-6fcd7ccfb-k9kcr_opendatahub(52b1e667-567b-435a-a719-9362352facc4)\"" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" podUID="52b1e667-567b-435a-a719-9362352facc4" Jul 07 16:36:44.440903 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:44.440874 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d4s84_22be50dd-1406-4f43-aaee-b4f8ab01e504/manager/0.log" Jul 07 16:36:44.718356 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:44.718258 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6fcd7ccfb-k9kcr_52b1e667-567b-435a-a719-9362352facc4/maas-api/1.log" Jul 07 16:36:44.846866 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:44.846834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-555fff8886-6d2lw_9063e193-1ae2-4d8e-a93d-4c43036f3ae5/manager/0.log" Jul 07 16:36:45.427071 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:45.427039 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-g56gj_7d79b793-aee8-4a68-97b0-f4bd3954602a/copy-manifests/0.log" Jul 07 16:36:45.440897 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:45.440869 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-g56gj_7d79b793-aee8-4a68-97b0-f4bd3954602a/manager/0.log" Jul 07 16:36:46.349181 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:46.349148 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:36:46.349566 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:46.349553 2562 scope.go:117] "RemoveContainer" containerID="c3b183c299afca8e3c8d4ee2010964bf112aa8cc3407102ffb87bb9d4567433a" Jul 07 16:36:46.349769 ip-10-0-136-66 kubenswrapper[2562]: E0707 16:36:46.349749 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-6fcd7ccfb-k9kcr_opendatahub(52b1e667-567b-435a-a719-9362352facc4)\"" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" podUID="52b1e667-567b-435a-a719-9362352facc4" Jul 07 16:36:47.189071 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:47.189036 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86794f9db5-mhzrv_6a56d0d6-4a5c-4150-8624-c4ea5e7fab27/authorino/0.log" Jul 07 16:36:47.589036 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:47.588966 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fs54h_684e7593-1539-4506-bfa8-7bde32b3c06c/kuadrant-console-plugin/0.log" Jul 07 16:36:48.879113 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:48.879082 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c9bdf7f84-vbwfh_b632a92e-a07e-4fd0-a547-7eb2c999393c/kube-auth-proxy/0.log" Jul 07 16:36:49.245855 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:49.245782 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-5grkc_96f25c6a-41f8-4ea2-8f2a-253288b5fadf/payload-processing/0.log" Jul 07 16:36:49.893460 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:49.893431 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qdd6v_eab0016b-aa7f-40d1-8692-0eb3effa3df8/main/0.log" Jul 07 16:36:50.023352 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:50.023319 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9p759_7bcf276a-8527-4b1a-a121-317095e2950d/main/0.log" Jul 07 16:36:50.166746 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:50.166660 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8fgpq_2acdf587-f97b-4c0b-a080-a55ba21edbb8/main/0.log" Jul 07 16:36:58.209646 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:58.209610 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dlvbc_9c1363b6-9067-4e74-b135-c8eb7e04b5c3/global-pull-secret-syncer/0.log" Jul 07 16:36:58.338351 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:58.338317 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fgwb9_8b1e4307-5b1e-415f-a948-910797770d3e/konnectivity-agent/0.log" Jul 07 16:36:58.433038 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:36:58.433011 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-66.ec2.internal_062671a5da55ed99bbda883c048796b7/haproxy/0.log" Jul 07 16:37:01.457775 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:01.457742 2562 scope.go:117] "RemoveContainer" containerID="c3b183c299afca8e3c8d4ee2010964bf112aa8cc3407102ffb87bb9d4567433a" Jul 07 16:37:02.392834 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:02.392803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" event={"ID":"52b1e667-567b-435a-a719-9362352facc4","Type":"ContainerStarted","Data":"04a7646a89e32775ccdd657d31ee6566e5a86f63efe42d3aee63a95b9e3839e2"} Jul 07 16:37:02.393045 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:02.393026 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:37:03.090446 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:03.090412 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86794f9db5-mhzrv_6a56d0d6-4a5c-4150-8624-c4ea5e7fab27/authorino/0.log" Jul 07 16:37:03.285140 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:03.285068 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fs54h_684e7593-1539-4506-bfa8-7bde32b3c06c/kuadrant-console-plugin/0.log" Jul 07 16:37:05.347260 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:05.347223 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af182342-9f4a-4185-8979-2655600aed67/alertmanager/0.log" Jul 07 16:37:05.388814 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:05.388786 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af182342-9f4a-4185-8979-2655600aed67/config-reloader/0.log" Jul 07 16:37:05.430307 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:05.430219 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af182342-9f4a-4185-8979-2655600aed67/kube-rbac-proxy-web/0.log" Jul 07 16:37:05.464172 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:05.464117 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af182342-9f4a-4185-8979-2655600aed67/kube-rbac-proxy/0.log" Jul 07 16:37:05.507852 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:05.507827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af182342-9f4a-4185-8979-2655600aed67/kube-rbac-proxy-metric/0.log" Jul 07 16:37:05.553210 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:05.553184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af182342-9f4a-4185-8979-2655600aed67/prom-label-proxy/0.log" Jul 07 16:37:05.621132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:05.621098 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af182342-9f4a-4185-8979-2655600aed67/init-config-reloader/0.log" Jul 07 16:37:05.832577 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:05.832472 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-798f978477-m92mg_1ad917a8-de69-4508-b3be-ac7602852cdb/metrics-server/0.log" Jul 07 16:37:06.138183 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.138151 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w4hdv_4a407fe7-76bc-4743-8cde-091e1ed8350b/node-exporter/0.log" Jul 07 16:37:06.170029 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.170009 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w4hdv_4a407fe7-76bc-4743-8cde-091e1ed8350b/kube-rbac-proxy/0.log" Jul 07 16:37:06.209218 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.209188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w4hdv_4a407fe7-76bc-4743-8cde-091e1ed8350b/init-textfile/0.log" Jul 07 16:37:06.384241 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.384189 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92fe7118-78ef-4fd7-9934-9eae19c9d1e2/prometheus/0.log" Jul 07 16:37:06.431449 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.431363 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92fe7118-78ef-4fd7-9934-9eae19c9d1e2/config-reloader/0.log" Jul 07 16:37:06.459982 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.459955 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92fe7118-78ef-4fd7-9934-9eae19c9d1e2/thanos-sidecar/0.log" Jul 07 16:37:06.487132 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.487102 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92fe7118-78ef-4fd7-9934-9eae19c9d1e2/kube-rbac-proxy-web/0.log" Jul 07 16:37:06.523072 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.523040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92fe7118-78ef-4fd7-9934-9eae19c9d1e2/kube-rbac-proxy/0.log" Jul 07 16:37:06.551140 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.551114 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92fe7118-78ef-4fd7-9934-9eae19c9d1e2/kube-rbac-proxy-thanos/0.log" Jul 07 16:37:06.577486 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.577452 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92fe7118-78ef-4fd7-9934-9eae19c9d1e2/init-config-reloader/0.log" Jul 07 16:37:06.690491 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.690418 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-cglxh_1991102c-2793-4ae4-bc2c-b9beada8dcd4/prometheus-operator-admission-webhook/0.log" Jul 07 16:37:06.731696 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.731668 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9bbc96f79-bn4kj_3d631939-f628-4e41-90ac-96b85d4b0e53/telemeter-client/0.log" Jul 07 16:37:06.757863 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.757838 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9bbc96f79-bn4kj_3d631939-f628-4e41-90ac-96b85d4b0e53/reload/0.log" Jul 07 16:37:06.785472 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:06.785443 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9bbc96f79-bn4kj_3d631939-f628-4e41-90ac-96b85d4b0e53/kube-rbac-proxy/0.log" Jul 07 16:37:07.821787 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.821757 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d"] Jul 07 16:37:07.822185 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.822168 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ed1d72-6261-4054-9c3a-f0765e4ee67e" containerName="authorino" Jul 07 16:37:07.822185 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.822182 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ed1d72-6261-4054-9c3a-f0765e4ee67e" containerName="authorino" Jul 07 16:37:07.822270 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.822258 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ed1d72-6261-4054-9c3a-f0765e4ee67e" containerName="authorino" Jul 07 16:37:07.825695 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.825673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.829192 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.829167 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6vzc\"/\"kube-root-ca.crt\"" Jul 07 16:37:07.829342 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.829327 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6vzc\"/\"openshift-service-ca.crt\"" Jul 07 16:37:07.830462 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.830442 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6vzc\"/\"default-dockercfg-pzc5s\"" Jul 07 16:37:07.839085 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.839056 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d"] Jul 07 16:37:07.883947 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.883913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-lib-modules\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.884129 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.883968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqmx7\" (UniqueName: \"kubernetes.io/projected/69d86b87-23dd-4e2d-a569-2c99f56480bf-kube-api-access-lqmx7\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.884129 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.884014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-podres\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.884129 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.884073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-sys\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.884129 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.884090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-proc\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.984830 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.984787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-lib-modules\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.985013 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.984844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqmx7\" (UniqueName: \"kubernetes.io/projected/69d86b87-23dd-4e2d-a569-2c99f56480bf-kube-api-access-lqmx7\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.985013 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.984956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-podres\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.985013 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.984972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-lib-modules\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.985134 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.985064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-podres\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.985134 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.985062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-sys\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.985134 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.985094 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-sys\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.985134 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.985099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-proc\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.985261 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.985152 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69d86b87-23dd-4e2d-a569-2c99f56480bf-proc\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:07.999682 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:07.999653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqmx7\" (UniqueName: \"kubernetes.io/projected/69d86b87-23dd-4e2d-a569-2c99f56480bf-kube-api-access-lqmx7\") pod \"perf-node-gather-daemonset-n5s6d\" (UID: \"69d86b87-23dd-4e2d-a569-2c99f56480bf\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:08.136795 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:08.136768 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:08.402176 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:08.402088 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6fcd7ccfb-k9kcr" Jul 07 16:37:08.492173 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:08.492151 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d"] Jul 07 16:37:08.494009 ip-10-0-136-66 kubenswrapper[2562]: W0707 16:37:08.493982 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69d86b87_23dd_4e2d_a569_2c99f56480bf.slice/crio-9abaa5ac510c730fac98663ce577bff67059140b6aa2c60002b6732e3d3b5d5b WatchSource:0}: Error finding container 9abaa5ac510c730fac98663ce577bff67059140b6aa2c60002b6732e3d3b5d5b: Status 404 returned error can't find the container with id 9abaa5ac510c730fac98663ce577bff67059140b6aa2c60002b6732e3d3b5d5b Jul 07 16:37:09.428797 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:09.428757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" event={"ID":"69d86b87-23dd-4e2d-a569-2c99f56480bf","Type":"ContainerStarted","Data":"a9c9f9f03f0097061febe1ebec201ac363872d5a8fd9208fd0f3522e50c10f02"} Jul 07 16:37:09.429224 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:09.428815 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" event={"ID":"69d86b87-23dd-4e2d-a569-2c99f56480bf","Type":"ContainerStarted","Data":"9abaa5ac510c730fac98663ce577bff67059140b6aa2c60002b6732e3d3b5d5b"} Jul 07 16:37:09.429224 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:09.428911 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:09.457823 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:09.457773 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" podStartSLOduration=2.457755895 podStartE2EDuration="2.457755895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:37:09.455915974 +0000 UTC m=+855.565252652" watchObservedRunningTime="2026-07-07 16:37:09.457755895 +0000 UTC m=+855.567092580" Jul 07 16:37:11.416120 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:11.416087 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g5lrf_1b8924b6-4453-40c2-b0a5-6e90f14c141f/dns/0.log" Jul 07 16:37:11.445058 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:11.445030 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g5lrf_1b8924b6-4453-40c2-b0a5-6e90f14c141f/kube-rbac-proxy/0.log" Jul 07 16:37:11.645088 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:11.645059 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dsnpp_d1ee3b92-41a3-45c2-9e87-f1c5847d5cd4/dns-node-resolver/0.log" Jul 07 16:37:12.231713 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:12.231681 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64dbd44b55-nxqct_62d13e68-15fc-4316-8f80-cee20130c5f4/registry/0.log" Jul 07 16:37:12.274938 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:12.274907 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4tsqd_00a7e93d-aa93-43ec-b668-9ad7eb86de77/node-ca/0.log" Jul 07 16:37:13.583805 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:13.583779 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c9bdf7f84-vbwfh_b632a92e-a07e-4fd0-a547-7eb2c999393c/kube-auth-proxy/0.log" Jul 07 16:37:13.848841 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:13.848763 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-5grkc_96f25c6a-41f8-4ea2-8f2a-253288b5fadf/payload-processing/0.log" Jul 07 16:37:14.613011 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:14.612986 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ntf68_69d16ee8-8778-4379-a3da-58056f769428/serve-healthcheck-canary/0.log" Jul 07 16:37:15.286860 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:15.286831 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhnl6_be2adfac-cdee-4756-9c15-1069a6bd3b15/kube-rbac-proxy/0.log" Jul 07 16:37:15.328776 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:15.328747 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhnl6_be2adfac-cdee-4756-9c15-1069a6bd3b15/exporter/0.log" Jul 07 16:37:15.365003 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:15.364953 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhnl6_be2adfac-cdee-4756-9c15-1069a6bd3b15/extractor/0.log" Jul 07 16:37:15.444345 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:15.444319 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-n5s6d" Jul 07 16:37:18.158722 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:18.158697 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d4s84_22be50dd-1406-4f43-aaee-b4f8ab01e504/manager/0.log" Jul 07 16:37:18.233786 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:18.233759 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6fcd7ccfb-k9kcr_52b1e667-567b-435a-a719-9362352facc4/maas-api/2.log" Jul 07 16:37:18.244602 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:18.244563 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6fcd7ccfb-k9kcr_52b1e667-567b-435a-a719-9362352facc4/maas-api/1.log" Jul 07 16:37:18.279645 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:18.279611 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-555fff8886-6d2lw_9063e193-1ae2-4d8e-a93d-4c43036f3ae5/manager/0.log" Jul 07 16:37:18.494010 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:18.493975 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-g56gj_7d79b793-aee8-4a68-97b0-f4bd3954602a/manager/0.log" Jul 07 16:37:18.514440 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:18.514408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-g56gj_7d79b793-aee8-4a68-97b0-f4bd3954602a/copy-manifests/0.log" Jul 07 16:37:18.611260 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:18.611230 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c9bdf7f84-vbwfh_b632a92e-a07e-4fd0-a547-7eb2c999393c/kube-auth-proxy/0.log" Jul 07 16:37:18.857343 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:18.857254 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-5grkc_96f25c6a-41f8-4ea2-8f2a-253288b5fadf/payload-processing/0.log" Jul 07 16:37:20.073685 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:20.073657 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c9bdf7f84-vbwfh_b632a92e-a07e-4fd0-a547-7eb2c999393c/kube-auth-proxy/0.log" Jul 07 16:37:20.154869 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:20.154819 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-96844494c-bkblx_69ca4cb4-4a43-4ecc-91d6-5bc50cdacf0a/manager/0.log" Jul 07 16:37:20.310128 ip-10-0-136-66 kubenswrapper[2562]: I0707 16:37:20.310089 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-5grkc_96f25c6a-41f8-4ea2-8f2a-253288b5fadf/payload-processing/0.log"