Jun 12 19:08:50.053253 ip-10-0-133-180 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 19:08:50.053270 ip-10-0-133-180 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 19:08:50.053280 ip-10-0-133-180 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 19:08:50.053648 ip-10-0-133-180 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 19:09:00.188554 ip-10-0-133-180 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 19:09:00.188571 ip-10-0-133-180 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f52cdf66f3d7464c974147e87f73074f -- Jun 12 19:11:27.222253 ip-10-0-133-180 systemd[1]: Starting Kubernetes Kubelet... Jun 12 19:11:27.610217 ip-10-0-133-180 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 19:11:27.610217 ip-10-0-133-180 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 19:11:27.610217 ip-10-0-133-180 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 19:11:27.610217 ip-10-0-133-180 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 19:11:27.610217 ip-10-0-133-180 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 19:11:27.612568 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.612462 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 19:11:27.618388 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618360 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:27.618388 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618382 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:27.618388 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618387 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:27.618388 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618390 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:27.618388 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618395 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:27.618388 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618398 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618402 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618406 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618410 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618415 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618418 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618423 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618427 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618431 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618434 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618438 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618444 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618449 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618454 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618458 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618461 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618474 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618478 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618482 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:27.618738 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618486 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618490 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618494 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618497 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618501 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618505 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618509 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618513 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618517 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618521 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618525 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618529 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618533 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618537 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618541 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618546 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618552 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618557 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618561 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618565 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:27.619527 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618570 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618576 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618580 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618584 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618589 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618594 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618598 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618603 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618607 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618611 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618616 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618620 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618625 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618629 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618634 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618638 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618643 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618647 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618651 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618656 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:27.620438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618660 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618664 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618668 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618673 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618679 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618683 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618688 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618694 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618698 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618703 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618711 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618717 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618723 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618728 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618732 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618736 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618740 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618744 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618749 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:27.621269 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618753 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618758 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618764 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618770 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618776 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618781 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618785 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618790 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618794 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618799 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618803 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618808 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618813 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618817 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618821 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.618826 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620049 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620060 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620065 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:27.622078 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620069 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620074 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620079 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620083 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620087 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620092 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620096 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620100 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620104 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620109 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620114 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620119 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620124 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620129 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620133 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620138 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620142 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620146 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620151 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620156 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:27.622859 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620160 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620164 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620168 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620173 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620177 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620181 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620185 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620189 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620196 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620202 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620211 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620216 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620220 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620226 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620231 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620236 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620242 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620246 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620251 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:27.623557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620255 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620259 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620264 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620268 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620272 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620277 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620281 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620285 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620290 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620294 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620298 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620302 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620307 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620313 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620318 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620322 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620326 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620330 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620335 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620339 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:27.624066 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620344 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620348 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620352 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620358 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620363 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620367 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620371 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620375 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620379 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620385 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620392 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620396 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620400 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620404 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620408 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620413 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620417 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620421 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620425 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:27.624582 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620430 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620434 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620441 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620447 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620452 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620456 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620462 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620467 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620472 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620476 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620480 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620485 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620489 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620494 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620498 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620502 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620508 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.620513 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621183 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621192 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:27.625069 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621197 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621202 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621206 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621211 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621215 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621219 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621223 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621229 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621236 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621241 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621246 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621250 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621254 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621258 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621262 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621268 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621273 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621278 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621284 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621288 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:27.625559 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621293 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621297 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621301 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621307 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621312 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621317 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621321 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621326 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621330 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621334 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621347 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621352 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621356 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621360 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621365 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621370 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621374 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621378 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621382 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621386 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:27.626072 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621390 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621395 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621399 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621404 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621408 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621413 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621417 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621421 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621425 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621429 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621433 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621438 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621443 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621447 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621451 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621456 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621460 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621465 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621469 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:27.626557 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621476 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621481 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621486 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621491 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621496 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621501 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621506 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621511 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621516 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621520 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621525 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621529 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621534 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621538 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621543 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621549 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621553 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621558 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621562 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621567 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:27.627035 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621571 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621575 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621580 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621584 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621588 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621593 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621597 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621601 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621606 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621611 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621615 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621620 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621624 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621629 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621633 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621637 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621641 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.621645 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621754 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621766 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 19:11:27.627518 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621774 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621781 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621788 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621793 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621800 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621808 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621813 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621818 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621824 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621829 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621834 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621839 2560 flags.go:64] FLAG: --cgroup-root="" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621843 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621852 2560 flags.go:64] FLAG: --client-ca-file="" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621857 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.621861 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622014 2560 flags.go:64] FLAG: --cluster-domain="" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622021 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622028 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622034 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622042 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622050 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622056 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 19:11:27.628038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622062 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622596 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622606 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622614 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622620 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622627 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622635 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622644 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622650 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622661 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622666 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622673 2560 flags.go:64] FLAG: --enable-server="true" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622678 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622690 2560 flags.go:64] FLAG: --event-burst="100" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622696 2560 flags.go:64] FLAG: --event-qps="50" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622703 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622709 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622714 2560 flags.go:64] FLAG: --eviction-hard="" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622727 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622732 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622737 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622743 2560 flags.go:64] FLAG: --eviction-soft="" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622749 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622754 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622759 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 19:11:27.628592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622764 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622775 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622781 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622786 2560 flags.go:64] FLAG: --feature-gates="" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622793 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622798 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622806 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622812 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622818 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622828 2560 flags.go:64] FLAG: --help="false" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622833 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622839 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622844 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622850 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622856 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622862 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622868 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622873 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622884 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622889 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622895 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622900 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622905 2560 flags.go:64] FLAG: --kube-reserved="" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622911 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 19:11:27.629237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622939 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622946 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622951 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622960 2560 flags.go:64] FLAG: --lock-file="" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622965 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622970 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622975 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622984 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622989 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622994 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.622999 2560 flags.go:64] FLAG: --logging-format="text" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623008 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623014 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623019 2560 flags.go:64] FLAG: --manifest-url="" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623024 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623035 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623041 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623048 2560 flags.go:64] FLAG: --max-pods="110" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623054 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623064 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623069 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623074 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623080 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623085 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623090 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 19:11:27.629826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623103 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623114 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623119 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623124 2560 flags.go:64] FLAG: --pod-cidr="" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623129 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623138 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623143 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623150 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623155 2560 flags.go:64] FLAG: --port="10250" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623160 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623170 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07d727357d4321e34" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623176 2560 flags.go:64] FLAG: --qos-reserved="" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623181 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623227 2560 flags.go:64] FLAG: --register-node="true" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623240 2560 flags.go:64] FLAG: --register-with-taints="" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623247 2560 flags.go:64] FLAG: --registry-burst="10" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623253 2560 flags.go:64] FLAG: --registry-qps="5" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623258 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623264 2560 flags.go:64] FLAG: --reserved-memory="" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623270 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623276 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623286 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623291 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623297 2560 flags.go:64] FLAG: --runonce="false" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623301 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 19:11:27.630464 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623307 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623312 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623317 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623322 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623358 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623377 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623381 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623494 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623505 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623509 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623512 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623516 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623519 2560 flags.go:64] FLAG: --system-cgroups="" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623522 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623532 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623539 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623542 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623547 2560 flags.go:64] FLAG: --tls-min-version="" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623550 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623554 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623558 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623561 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623564 2560 flags.go:64] FLAG: --v="2" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623569 2560 flags.go:64] FLAG: --version="false" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623573 2560 flags.go:64] FLAG: --vmodule="" Jun 12 19:11:27.631092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623578 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.623581 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623709 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623713 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623716 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623719 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623722 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623725 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623727 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623730 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623732 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623735 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623738 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623740 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623743 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623745 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623748 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623751 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623754 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623757 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623760 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:27.631714 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623763 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623765 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623768 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623771 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623773 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623776 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623779 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623781 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623784 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623786 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623789 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623791 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623794 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623796 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623800 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623804 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623807 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623810 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623812 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:27.632267 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623815 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623817 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623820 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623823 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623826 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623829 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623832 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623835 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623837 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623840 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623843 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623846 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623849 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623851 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623854 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623856 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623859 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623862 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623865 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623867 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:27.632752 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623870 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623872 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623875 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623878 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623880 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623883 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623885 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623888 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623891 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623893 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623896 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623898 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623901 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623905 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623909 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623913 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623933 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623936 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623939 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:27.633297 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623942 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623945 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623948 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623951 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623954 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623959 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623961 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623964 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623967 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623969 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623972 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623974 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623978 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623982 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623985 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623988 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623990 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623993 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623996 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:27.633802 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.623999 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.624002 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.624004 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.624582 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.631572 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.631595 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.632377 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.632385 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632453 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632458 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632462 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632465 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632468 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632471 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632474 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:27.634335 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632477 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632479 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632482 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632484 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632487 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632489 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632492 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632495 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632497 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632500 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632504 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632508 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632511 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632514 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632517 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632519 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632522 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632525 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632528 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:27.634708 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632530 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632533 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632536 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632541 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632543 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632546 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632549 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632552 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632554 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632556 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632559 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632561 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632564 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632567 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632569 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632572 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632574 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632576 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632580 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:27.635208 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632584 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632587 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632591 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632593 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632596 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632598 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632601 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632603 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632606 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632609 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632611 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632614 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632617 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632619 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632622 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632624 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632628 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632632 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632635 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632638 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:27.635688 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632641 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632643 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632645 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632649 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632651 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632655 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632659 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632662 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632665 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632668 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632671 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632673 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632676 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632679 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632681 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632684 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632686 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632689 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632692 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632695 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:27.636194 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632715 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632719 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632722 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632725 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632728 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632731 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632734 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632737 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632740 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632743 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632747 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632750 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632753 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632755 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.632761 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 19:11:27.636674 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632879 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632884 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632886 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632889 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632892 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632895 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632898 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632900 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632903 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632906 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632908 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632911 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632929 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632932 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632935 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632938 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632940 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632943 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632946 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632949 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:27.637275 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632952 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632954 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632957 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632961 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632965 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632968 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632971 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632975 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632978 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632981 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632983 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632986 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632989 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632991 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632995 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.632999 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633001 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633005 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633007 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:27.637779 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633010 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633013 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633015 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633018 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633020 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633023 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633025 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633028 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633030 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633033 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633036 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633038 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633041 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633043 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633046 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633048 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633051 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633053 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633056 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633058 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:27.638260 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633061 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633064 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633067 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633070 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633073 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633077 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633079 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633082 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633085 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633088 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633091 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633093 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633096 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633098 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633101 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633103 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633106 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633108 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633110 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:27.638747 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633113 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633116 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633118 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633121 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633124 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633126 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633128 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633131 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633133 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633136 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633138 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633141 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633144 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633146 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633149 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633151 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633154 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633157 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633160 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633162 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:27.639225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:27.633165 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:27.639715 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.633170 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 19:11:27.639715 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.633316 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 19:11:27.639715 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.635357 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 19:11:27.639715 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.636765 2560 server.go:1019] "Starting client certificate rotation" Jun 12 19:11:27.639715 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.636869 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 19:11:27.639715 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.636909 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 19:11:27.640043 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.640022 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 19:11:27.643677 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.643658 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 19:11:27.657628 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.656876 2560 log.go:25] "Validated CRI v1 runtime API" Jun 12 19:11:27.660633 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.660609 2560 log.go:25] "Validated CRI v1 image API" Jun 12 19:11:27.664331 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.664310 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 19:11:27.666714 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.666694 2560 fs.go:135] Filesystem UUIDs: map[3787be58-9650-4fe0-8d0a-b1a95f16b973:/dev/nvme0n1p4 74fe9eb2-3e80-40c5-a6d7-8b44896cf323:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 12 19:11:27.666785 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.666714 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 19:11:27.671713 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.671593 2560 manager.go:216] Machine: {Timestamp:2026-06-12 19:11:27.670552412 +0000 UTC m=+0.327591543 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108232 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f80cfa7e71444531339e3108d9b8d SystemUUID:ec2f80cf-a7e7-1444-5313-39e3108d9b8d BootID:f52cdf66-f3d7-464c-9741-47e87f73074f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f9:b2:4d:1a:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f9:b2:4d:1a:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:84:9b:01:70:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 19:11:27.671713 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.671704 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 19:11:27.671854 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.671842 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 19:11:27.672811 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.672778 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 19:11:27.672974 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.672818 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-180.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 19:11:27.673470 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.673460 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 19:11:27.673504 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.673473 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 19:11:27.673504 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.673481 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 19:11:27.674170 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.674159 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 19:11:27.675287 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.675268 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 19:11:27.675334 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.675289 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 19:11:27.677808 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.677795 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 12 19:11:27.677957 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.677947 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 19:11:27.677995 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.677979 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 12 19:11:27.677995 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.677991 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 19:11:27.678051 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.678007 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 19:11:27.678051 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.678017 2560 kubelet.go:398] "Adding apiserver pod source" Jun 12 19:11:27.678051 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.678026 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 19:11:27.685646 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.678405 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 19:11:27.685646 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.678610 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 19:11:27.685646 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.680595 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 19:11:27.686632 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.686616 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 19:11:27.686693 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.686648 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 19:11:27.686844 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.686833 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 19:11:27.686889 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.686850 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 19:11:27.686889 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.686857 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 19:11:27.686889 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.686862 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 19:11:27.686889 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.686870 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 19:11:27.686889 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.686877 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 19:11:27.687357 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.687346 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 19:11:27.687391 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.687357 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 19:11:27.687391 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.687364 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 19:11:27.687391 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.687369 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 19:11:27.687391 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.687379 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 19:11:27.687391 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.687387 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 19:11:27.688572 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.688556 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 19:11:27.688633 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.688576 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 19:11:27.688633 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.688572 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 19:11:27.688633 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.688571 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 19:11:27.696500 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.696477 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-180.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 19:11:27.696704 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.696691 2560 server.go:1268] "Started kubelet" Jun 12 19:11:27.696770 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.696742 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 19:11:27.696860 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.696803 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 19:11:27.696981 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.696960 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 19:11:27.701114 ip-10-0-133-180 systemd[1]: Started Kubernetes Kubelet. Jun 12 19:11:27.701276 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.701237 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 19:11:27.702723 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.702698 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 12 19:11:27.703136 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.703112 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 19:11:27.707416 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.706572 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-180.ec2.internal.18b86b2b9d96018b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-180.ec2.internal,UID:ip-10-0-133-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-180.ec2.internal,},FirstTimestamp:2026-06-12 19:11:27.696650635 +0000 UTC m=+0.353689767,LastTimestamp:2026-06-12 19:11:27.696650635 +0000 UTC m=+0.353689767,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-180.ec2.internal,}" Jun 12 19:11:27.707763 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.707746 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 19:11:27.707854 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.707752 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 19:11:27.707908 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.707857 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:27.708292 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.708276 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 19:11:27.708401 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.708280 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 19:11:27.708476 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.708434 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 19:11:27.708593 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.708581 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 12 19:11:27.708593 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.708593 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 12 19:11:27.708698 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.708681 2560 factory.go:55] Registering systemd factory Jun 12 19:11:27.708740 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.708699 2560 factory.go:223] Registration of the systemd container factory successfully Jun 12 19:11:27.709180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.709165 2560 factory.go:153] Registering CRI-O factory Jun 12 19:11:27.709180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.709180 2560 factory.go:223] Registration of the crio container factory successfully Jun 12 19:11:27.709320 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.709236 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 19:11:27.709320 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.709264 2560 factory.go:103] Registering Raw factory Jun 12 19:11:27.709320 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.709279 2560 manager.go:1196] Started watching for new ooms in manager Jun 12 19:11:27.709662 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.709645 2560 manager.go:349] Starting recovery of all containers Jun 12 19:11:27.710962 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.710909 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 19:11:27.711065 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.711040 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 19:11:27.718478 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.718453 2560 manager.go:354] Recovery completed Jun 12 19:11:27.722695 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.722680 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:27.724704 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.724671 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:27.724792 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.724720 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:27.724792 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.724731 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:27.725313 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.725296 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 19:11:27.725313 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.725309 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 19:11:27.725458 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.725341 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 12 19:11:27.725458 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.725312 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:27.726215 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.726196 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:27.726266 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.726230 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:27.726475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.726448 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:27.726664 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.726645 2560 policy_none.go:49] "None policy: Start" Jun 12 19:11:27.726809 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.726794 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 19:11:27.726879 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.726823 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 19:11:27.727440 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.727413 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r6nnb" Jun 12 19:11:27.727553 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.727460 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-180.ec2.internal.18b86b2b9f42153c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-180.ec2.internal,UID:ip-10-0-133-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-180.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-180.ec2.internal,},FirstTimestamp:2026-06-12 19:11:27.724705084 +0000 UTC m=+0.381744219,LastTimestamp:2026-06-12 19:11:27.724705084 +0000 UTC m=+0.381744219,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-180.ec2.internal,}" Jun 12 19:11:27.728745 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.728731 2560 policy_none.go:47] "Start" Jun 12 19:11:27.735713 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.735692 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r6nnb" Jun 12 19:11:27.736893 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.736824 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-180.ec2.internal.18b86b2b9f42685d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-180.ec2.internal,UID:ip-10-0-133-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-180.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-180.ec2.internal,},FirstTimestamp:2026-06-12 19:11:27.724726365 +0000 UTC m=+0.381765495,LastTimestamp:2026-06-12 19:11:27.724726365 +0000 UTC m=+0.381765495,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-180.ec2.internal,}" Jun 12 19:11:27.774594 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.774558 2560 manager.go:337] "Starting Device Plugin manager" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.774615 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.774626 2560 server.go:87] "Starting device plugin registration server" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.774986 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.774999 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.775134 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.775206 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.775216 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.775829 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.775887 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.780128 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.781466 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.781495 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.781514 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.781544 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 19:11:27.790773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.785976 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:27.875835 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.875751 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:27.877006 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.876986 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:27.877089 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.877018 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:27.877089 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.877034 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:27.877089 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.877061 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.882082 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.882062 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal"] Jun 12 19:11:27.882135 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.882127 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:27.883449 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.883434 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:27.883509 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.883463 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:27.883509 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.883473 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:27.885655 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.885643 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:27.885769 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.885754 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.885802 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.885785 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:27.886198 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.886169 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.886198 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.886195 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-180.ec2.internal\": node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:27.886355 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.886340 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:27.886390 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.886375 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:27.886390 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.886385 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:27.886448 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.886342 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:27.886448 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.886443 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:27.886504 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.886453 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:27.888502 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.888488 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.888570 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.888516 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:27.889191 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.889175 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:27.889278 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.889206 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:27.889278 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.889216 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:27.909655 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.909628 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72039ea588cd1aa514ff0bb34342eaf5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal\" (UID: \"72039ea588cd1aa514ff0bb34342eaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.909770 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.909655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72039ea588cd1aa514ff0bb34342eaf5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal\" (UID: \"72039ea588cd1aa514ff0bb34342eaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.909770 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:27.909674 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45c7ccf2d22eca00a3939e23b3e78371-config\") pod \"kube-apiserver-proxy-ip-10-0-133-180.ec2.internal\" (UID: \"45c7ccf2d22eca00a3939e23b3e78371\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.909770 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.909725 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-180.ec2.internal\" not found" node="ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.914169 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.914151 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-180.ec2.internal\" not found" node="ip-10-0-133-180.ec2.internal" Jun 12 19:11:27.928240 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:27.928213 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:28.010368 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.010333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72039ea588cd1aa514ff0bb34342eaf5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal\" (UID: \"72039ea588cd1aa514ff0bb34342eaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.010368 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.010366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45c7ccf2d22eca00a3939e23b3e78371-config\") pod \"kube-apiserver-proxy-ip-10-0-133-180.ec2.internal\" (UID: \"45c7ccf2d22eca00a3939e23b3e78371\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.010496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.010383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72039ea588cd1aa514ff0bb34342eaf5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal\" (UID: \"72039ea588cd1aa514ff0bb34342eaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.010496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.010423 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72039ea588cd1aa514ff0bb34342eaf5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal\" (UID: \"72039ea588cd1aa514ff0bb34342eaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.010496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.010457 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72039ea588cd1aa514ff0bb34342eaf5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal\" (UID: \"72039ea588cd1aa514ff0bb34342eaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.010496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.010457 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45c7ccf2d22eca00a3939e23b3e78371-config\") pod \"kube-apiserver-proxy-ip-10-0-133-180.ec2.internal\" (UID: \"45c7ccf2d22eca00a3939e23b3e78371\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.028315 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:28.028287 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:28.129326 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:28.129236 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:28.211900 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.211874 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.219029 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.219008 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.229735 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:28.229713 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:28.330258 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:28.330214 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:28.430845 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:28.430757 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:28.531360 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:28.531319 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:28.597610 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.597582 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:28.631995 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:28.631963 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-180.ec2.internal\" not found" Jun 12 19:11:28.636141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.636114 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 19:11:28.636295 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.636274 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 19:11:28.636355 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.636293 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 19:11:28.712209 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.711119 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:28.739740 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.739690 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 19:06:27 +0000 UTC" deadline="2028-03-09 14:32:48.106908534 +0000 UTC" Jun 12 19:11:28.739740 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.739724 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15259h21m19.367188032s" Jun 12 19:11:28.740897 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:28.740859 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72039ea588cd1aa514ff0bb34342eaf5.slice/crio-2d7645a4b3816b23381a92478ec1361174cd131dfb2dc654e524ebbd90a92c5b WatchSource:0}: Error finding container 2d7645a4b3816b23381a92478ec1361174cd131dfb2dc654e524ebbd90a92c5b: Status 404 returned error can't find the container with id 2d7645a4b3816b23381a92478ec1361174cd131dfb2dc654e524ebbd90a92c5b Jun 12 19:11:28.741180 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:28.741160 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c7ccf2d22eca00a3939e23b3e78371.slice/crio-c1ea71837e0f073602ea7abb6659bf9b41260fa0dd0e1f924cb2b7023992e136 WatchSource:0}: Error finding container c1ea71837e0f073602ea7abb6659bf9b41260fa0dd0e1f924cb2b7023992e136: Status 404 returned error can't find the container with id c1ea71837e0f073602ea7abb6659bf9b41260fa0dd0e1f924cb2b7023992e136 Jun 12 19:11:28.746855 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.746840 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:11:28.785684 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.785630 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" event={"ID":"72039ea588cd1aa514ff0bb34342eaf5","Type":"ContainerStarted","Data":"2d7645a4b3816b23381a92478ec1361174cd131dfb2dc654e524ebbd90a92c5b"} Jun 12 19:11:28.786745 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.786718 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal" event={"ID":"45c7ccf2d22eca00a3939e23b3e78371","Type":"ContainerStarted","Data":"c1ea71837e0f073602ea7abb6659bf9b41260fa0dd0e1f924cb2b7023992e136"} Jun 12 19:11:28.808950 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.808901 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.828747 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.828714 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 19:11:28.829690 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.829674 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal" Jun 12 19:11:28.839005 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:28.838979 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 19:11:29.123415 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.123326 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:29.679503 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.679472 2560 apiserver.go:52] "Watching apiserver" Jun 12 19:11:29.689738 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.689699 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 19:11:29.690107 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.690082 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zs6dg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9","openshift-cluster-node-tuning-operator/tuned-z78v6","openshift-dns/node-resolver-x68ms","openshift-image-registry/node-ca-mg6nm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal","openshift-multus/multus-additional-cni-plugins-5l6mv","openshift-multus/network-metrics-daemon-vqt4b","kube-system/konnectivity-agent-rq288","kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal","openshift-multus/multus-959z2","openshift-network-diagnostics/network-check-target-bn8xv","openshift-network-operator/iptables-alerter-wh4vj","openshift-ovn-kubernetes/ovnkube-node-mvrvx"] Jun 12 19:11:29.692592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.692568 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:29.692711 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.692658 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:29.694898 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.694871 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.697248 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.697224 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.699144 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.699091 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 19:11:29.699555 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.699537 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.700812 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.700515 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 19:11:29.700812 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.700523 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bxrpm\"" Jun 12 19:11:29.700812 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.700524 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 19:11:29.700812 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.700596 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 19:11:29.700812 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.700722 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 19:11:29.700812 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.700743 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 19:11:29.700812 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.700755 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 19:11:29.701148 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.700854 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 19:11:29.701148 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.701039 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 19:11:29.701148 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.701071 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kb4wk\"" Jun 12 19:11:29.701291 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.701228 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 19:11:29.701375 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.701356 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 19:11:29.701944 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.701911 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.702677 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.702366 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xnljs\"" Jun 12 19:11:29.702677 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.702537 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 19:11:29.702677 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.702542 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 19:11:29.704667 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.704646 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 19:11:29.705172 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.705156 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:29.705277 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.705232 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 19:11:29.705277 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.705224 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:29.705501 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.705486 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 19:11:29.708579 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.706081 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qzmg9\"" Jun 12 19:11:29.708579 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.708561 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 19:11:29.709177 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.709143 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.711695 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.711674 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:11:29.711911 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.711892 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:29.712082 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.711689 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 19:11:29.712240 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.711745 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7fgx2\"" Jun 12 19:11:29.714221 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.714202 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 19:11:29.714421 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.714277 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-959z2" Jun 12 19:11:29.715049 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.715030 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-64qrj\"" Jun 12 19:11:29.715195 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.715121 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 19:11:29.716614 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.716594 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:29.716720 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.716663 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:29.717254 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.717237 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 19:11:29.717352 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.717242 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m5tvl\"" Jun 12 19:11:29.719190 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.719171 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:29.720083 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfj9b\" (UniqueName: \"kubernetes.io/projected/9a4c6057-9698-4300-ae96-f738a41bd82e-kube-api-access-pfj9b\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.720175 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720101 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77048b64-4fc6-4841-a6f5-602cee883b68-serviceca\") pod \"node-ca-mg6nm\" (UID: \"77048b64-4fc6-4841-a6f5-602cee883b68\") " pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.720175 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-kubernetes\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.720175 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-systemd\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.720175 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-slash\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.720356 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720193 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.720356 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-system-cni-dir\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.720356 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720241 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f73e27a5-19e3-45f5-9fee-718113ba39f3-tmp-dir\") pod \"node-resolver-x68ms\" (UID: \"f73e27a5-19e3-45f5-9fee-718113ba39f3\") " pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.720356 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720270 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-sysctl-conf\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.720356 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-lib-modules\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.720356 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720316 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbvhh\" (UniqueName: \"kubernetes.io/projected/ecf413ba-720d-4080-a1b6-81aa7448185b-kube-api-access-fbvhh\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.720356 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-var-lib-openvswitch\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720372 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-run-openvswitch\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720389 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-run-ovn\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720403 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-cni-bin\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-tuned\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720445 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-cni-netd\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720467 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a4c6057-9698-4300-ae96-f738a41bd82e-ovnkube-script-lib\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-cnibin\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720546 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-os-release\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720567 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9de2fd1-5260-48d1-8fa3-a71229c218fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9de2fd1-5260-48d1-8fa3-a71229c218fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77048b64-4fc6-4841-a6f5-602cee883b68-host\") pod \"node-ca-mg6nm\" (UID: \"77048b64-4fc6-4841-a6f5-602cee883b68\") " pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-modprobe-d\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-run\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-var-lib-kubelet\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.720775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720673 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-run-netns\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720694 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9de2fd1-5260-48d1-8fa3-a71229c218fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720709 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slp49\" (UniqueName: \"kubernetes.io/projected/a9de2fd1-5260-48d1-8fa3-a71229c218fd-kube-api-access-slp49\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zv5v\" (UniqueName: \"kubernetes.io/projected/3f558a51-da97-4815-815b-f1d519167f3f-kube-api-access-6zv5v\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720802 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/576a70c6-3818-4726-b649-dbe1059ef0eb-dbus\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-sys\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720834 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-host\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720848 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-run-systemd\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720863 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a4c6057-9698-4300-ae96-f738a41bd82e-ovnkube-config\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktrdv\" (UniqueName: \"kubernetes.io/projected/f73e27a5-19e3-45f5-9fee-718113ba39f3-kube-api-access-ktrdv\") pod \"node-resolver-x68ms\" (UID: \"f73e27a5-19e3-45f5-9fee-718113ba39f3\") " pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8dvb\" (UniqueName: \"kubernetes.io/projected/77048b64-4fc6-4841-a6f5-602cee883b68-kube-api-access-n8dvb\") pod \"node-ca-mg6nm\" (UID: \"77048b64-4fc6-4841-a6f5-602cee883b68\") " pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.720964 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-systemd-units\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721078 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-log-socket\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721089 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 19:11:29.721439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf413ba-720d-4080-a1b6-81aa7448185b-tmp\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-etc-openvswitch\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-node-log\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a4c6057-9698-4300-ae96-f738a41bd82e-ovn-node-metrics-cert\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f73e27a5-19e3-45f5-9fee-718113ba39f3-hosts-file\") pod \"node-resolver-x68ms\" (UID: \"f73e27a5-19e3-45f5-9fee-718113ba39f3\") " pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721309 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/576a70c6-3818-4726-b649-dbe1059ef0eb-kubelet-config\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721343 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-sysconfig\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-sysctl-d\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-kubelet\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a4c6057-9698-4300-ae96-f738a41bd82e-env-overrides\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.722092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.721789 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.723005 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.722986 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:11:29.723094 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.723070 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 19:11:29.723341 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.723324 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 19:11:29.723465 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.723395 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kzflp\"" Jun 12 19:11:29.727148 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.727132 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 19:11:29.727357 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.727321 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qmjnk\"" Jun 12 19:11:29.727594 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.727578 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 19:11:29.727712 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.727695 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 19:11:29.749161 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.749139 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-662b6" Jun 12 19:11:29.757720 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.757698 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-662b6" Jun 12 19:11:29.810032 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.810000 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 19:11:29.822448 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8dvb\" (UniqueName: \"kubernetes.io/projected/77048b64-4fc6-4841-a6f5-602cee883b68-kube-api-access-n8dvb\") pod \"node-ca-mg6nm\" (UID: \"77048b64-4fc6-4841-a6f5-602cee883b68\") " pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.822622 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-log-socket\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.822622 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822482 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:29.822622 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-run-k8s-cni-cncf-io\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.822622 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822545 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-log-socket\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.822622 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822611 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf413ba-720d-4080-a1b6-81aa7448185b-tmp\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-node-log\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a4c6057-9698-4300-ae96-f738a41bd82e-ovn-node-metrics-cert\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-os-release\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822719 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-node-log\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822746 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-sysconfig\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-sysctl-d\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-kubelet\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822791 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfj9b\" (UniqueName: \"kubernetes.io/projected/9a4c6057-9698-4300-ae96-f738a41bd82e-kube-api-access-pfj9b\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822806 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-system-cni-dir\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822823 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9de2fd1-5260-48d1-8fa3-a71229c218fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822834 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-sysconfig\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822839 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9de2fd1-5260-48d1-8fa3-a71229c218fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.822904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77048b64-4fc6-4841-a6f5-602cee883b68-serviceca\") pod \"node-ca-mg6nm\" (UID: \"77048b64-4fc6-4841-a6f5-602cee883b68\") " pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822912 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-kubernetes\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-systemd\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-slash\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.822998 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823010 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f07ac7dd-089a-47e8-8fb1-cc9686102d27-agent-certs\") pod \"konnectivity-agent-rq288\" (UID: \"f07ac7dd-089a-47e8-8fb1-cc9686102d27\") " pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f73e27a5-19e3-45f5-9fee-718113ba39f3-tmp-dir\") pod \"node-resolver-x68ms\" (UID: \"f73e27a5-19e3-45f5-9fee-718113ba39f3\") " pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbvhh\" (UniqueName: \"kubernetes.io/projected/ecf413ba-720d-4080-a1b6-81aa7448185b-kube-api-access-fbvhh\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823086 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-var-lib-openvswitch\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-os-release\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-cnibin\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823181 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-run-multus-certs\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-cnibin\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823236 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77048b64-4fc6-4841-a6f5-602cee883b68-serviceca\") pod \"node-ca-mg6nm\" (UID: \"77048b64-4fc6-4841-a6f5-602cee883b68\") " pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823258 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9de2fd1-5260-48d1-8fa3-a71229c218fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.823487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-daemon-config\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823298 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9de2fd1-5260-48d1-8fa3-a71229c218fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823309 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-var-lib-openvswitch\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-run\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823385 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-kubelet\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823408 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-system-cni-dir\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.823428 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-sysctl-d\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823484 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-os-release\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.823504 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret podName:576a70c6-3818-4726-b649-dbe1059ef0eb nodeName:}" failed. No retries permitted until 2026-06-12 19:11:30.323483316 +0000 UTC m=+2.980522434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret") pod "global-pull-secret-syncer-zs6dg" (UID: "576a70c6-3818-4726-b649-dbe1059ef0eb") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823504 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-cnibin\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823433 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-slash\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823645 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f73e27a5-19e3-45f5-9fee-718113ba39f3-tmp-dir\") pod \"node-resolver-x68ms\" (UID: \"f73e27a5-19e3-45f5-9fee-718113ba39f3\") " pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823669 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-kubernetes\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823733 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-systemd\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823798 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-run\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823829 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.824058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-socket-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823905 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvjfc\" (UniqueName: \"kubernetes.io/projected/9e5cdd07-9588-449a-a00f-0e4ad0b10252-kube-api-access-kvjfc\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823953 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.823997 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-sys\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824005 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9de2fd1-5260-48d1-8fa3-a71229c218fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824022 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-host\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824051 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a4c6057-9698-4300-ae96-f738a41bd82e-ovnkube-config\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824112 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9de2fd1-5260-48d1-8fa3-a71229c218fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824127 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824181 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-host\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824189 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9de2fd1-5260-48d1-8fa3-a71229c218fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824241 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-sys\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.824278 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-device-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.824798 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.824341 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs podName:3f558a51-da97-4815-815b-f1d519167f3f nodeName:}" failed. No retries permitted until 2026-06-12 19:11:30.324322937 +0000 UTC m=+2.981362055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs") pod "network-metrics-daemon-vqt4b" (UID: "3f558a51-da97-4815-815b-f1d519167f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-socket-dir-parent\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824410 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktrdv\" (UniqueName: \"kubernetes.io/projected/f73e27a5-19e3-45f5-9fee-718113ba39f3-kube-api-access-ktrdv\") pod \"node-resolver-x68ms\" (UID: \"f73e27a5-19e3-45f5-9fee-718113ba39f3\") " pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-systemd-units\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824459 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-system-cni-dir\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-var-lib-cni-multus\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824495 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-systemd-units\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-var-lib-kubelet\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-hostroot\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824553 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-etc-openvswitch\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-cni-dir\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f73e27a5-19e3-45f5-9fee-718113ba39f3-hosts-file\") pod \"node-resolver-x68ms\" (UID: \"f73e27a5-19e3-45f5-9fee-718113ba39f3\") " pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824617 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-etc-openvswitch\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824624 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/576a70c6-3818-4726-b649-dbe1059ef0eb-kubelet-config\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824661 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f73e27a5-19e3-45f5-9fee-718113ba39f3-hosts-file\") pod \"node-resolver-x68ms\" (UID: \"f73e27a5-19e3-45f5-9fee-718113ba39f3\") " pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a4c6057-9698-4300-ae96-f738a41bd82e-env-overrides\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824693 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/576a70c6-3818-4726-b649-dbe1059ef0eb-kubelet-config\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:29.825536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32938b63-1cb8-4537-b6bc-a54084c5cffa-iptables-alerter-script\") pod \"iptables-alerter-wh4vj\" (UID: \"32938b63-1cb8-4537-b6bc-a54084c5cffa\") " pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824763 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a4c6057-9698-4300-ae96-f738a41bd82e-ovnkube-config\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824771 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-var-lib-cni-bin\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-conf-dir\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824849 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824887 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-registration-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg6mf\" (UniqueName: \"kubernetes.io/projected/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-kube-api-access-vg6mf\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.824991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f07ac7dd-089a-47e8-8fb1-cc9686102d27-konnectivity-ca\") pod \"konnectivity-agent-rq288\" (UID: \"f07ac7dd-089a-47e8-8fb1-cc9686102d27\") " pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825018 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-run-netns\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slp49\" (UniqueName: \"kubernetes.io/projected/a9de2fd1-5260-48d1-8fa3-a71229c218fd-kube-api-access-slp49\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-sysctl-conf\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a4c6057-9698-4300-ae96-f738a41bd82e-env-overrides\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-lib-modules\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825133 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-run-openvswitch\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825160 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-run-ovn\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-cni-bin\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.826475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-lib-modules\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825210 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a4c6057-9698-4300-ae96-f738a41bd82e-ovnkube-script-lib\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825231 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-sysctl-conf\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825249 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-run-ovn\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825260 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-run-openvswitch\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-tuned\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-cni-netd\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-cni-bin\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825363 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-cni-netd\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825366 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-sys-fs\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825395 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32938b63-1cb8-4537-b6bc-a54084c5cffa-host-slash\") pod \"iptables-alerter-wh4vj\" (UID: \"32938b63-1cb8-4537-b6bc-a54084c5cffa\") " pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825419 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-etc-kubernetes\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825449 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77048b64-4fc6-4841-a6f5-602cee883b68-host\") pod \"node-ca-mg6nm\" (UID: \"77048b64-4fc6-4841-a6f5-602cee883b68\") " pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-modprobe-d\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-var-lib-kubelet\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825539 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77048b64-4fc6-4841-a6f5-602cee883b68-host\") pod \"node-ca-mg6nm\" (UID: \"77048b64-4fc6-4841-a6f5-602cee883b68\") " pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825552 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-var-lib-kubelet\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825587 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-run-netns\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.827346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825597 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-modprobe-d\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmphf\" (UniqueName: \"kubernetes.io/projected/32938b63-1cb8-4537-b6bc-a54084c5cffa-kube-api-access-nmphf\") pod \"iptables-alerter-wh4vj\" (UID: \"32938b63-1cb8-4537-b6bc-a54084c5cffa\") " pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zv5v\" (UniqueName: \"kubernetes.io/projected/3f558a51-da97-4815-815b-f1d519167f3f-kube-api-access-6zv5v\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825640 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-host-run-netns\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/576a70c6-3818-4726-b649-dbe1059ef0eb-dbus\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825695 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-run-systemd\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e5cdd07-9588-449a-a00f-0e4ad0b10252-cni-binary-copy\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825741 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a4c6057-9698-4300-ae96-f738a41bd82e-run-systemd\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825707 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a4c6057-9698-4300-ae96-f738a41bd82e-ovnkube-script-lib\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.825735 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/576a70c6-3818-4726-b649-dbe1059ef0eb-dbus\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.826178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf413ba-720d-4080-a1b6-81aa7448185b-tmp\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.826240 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a4c6057-9698-4300-ae96-f738a41bd82e-ovn-node-metrics-cert\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.828112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.828017 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecf413ba-720d-4080-a1b6-81aa7448185b-etc-tuned\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.832548 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.832506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8dvb\" (UniqueName: \"kubernetes.io/projected/77048b64-4fc6-4841-a6f5-602cee883b68-kube-api-access-n8dvb\") pod \"node-ca-mg6nm\" (UID: \"77048b64-4fc6-4841-a6f5-602cee883b68\") " pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:29.833722 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.833635 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfj9b\" (UniqueName: \"kubernetes.io/projected/9a4c6057-9698-4300-ae96-f738a41bd82e-kube-api-access-pfj9b\") pod \"ovnkube-node-mvrvx\" (UID: \"9a4c6057-9698-4300-ae96-f738a41bd82e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:29.834094 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.834069 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktrdv\" (UniqueName: \"kubernetes.io/projected/f73e27a5-19e3-45f5-9fee-718113ba39f3-kube-api-access-ktrdv\") pod \"node-resolver-x68ms\" (UID: \"f73e27a5-19e3-45f5-9fee-718113ba39f3\") " pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:29.834243 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.834113 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbvhh\" (UniqueName: \"kubernetes.io/projected/ecf413ba-720d-4080-a1b6-81aa7448185b-kube-api-access-fbvhh\") pod \"tuned-z78v6\" (UID: \"ecf413ba-720d-4080-a1b6-81aa7448185b\") " pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:29.835245 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.835210 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zv5v\" (UniqueName: \"kubernetes.io/projected/3f558a51-da97-4815-815b-f1d519167f3f-kube-api-access-6zv5v\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:29.835667 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.835643 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slp49\" (UniqueName: \"kubernetes.io/projected/a9de2fd1-5260-48d1-8fa3-a71229c218fd-kube-api-access-slp49\") pod \"multus-additional-cni-plugins-5l6mv\" (UID: \"a9de2fd1-5260-48d1-8fa3-a71229c218fd\") " pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:29.927090 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927046 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32938b63-1cb8-4537-b6bc-a54084c5cffa-host-slash\") pod \"iptables-alerter-wh4vj\" (UID: \"32938b63-1cb8-4537-b6bc-a54084c5cffa\") " pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:29.927090 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927091 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-etc-kubernetes\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927124 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmphf\" (UniqueName: \"kubernetes.io/projected/32938b63-1cb8-4537-b6bc-a54084c5cffa-kube-api-access-nmphf\") pod \"iptables-alerter-wh4vj\" (UID: \"32938b63-1cb8-4537-b6bc-a54084c5cffa\") " pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e5cdd07-9588-449a-a00f-0e4ad0b10252-cni-binary-copy\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927178 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927192 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32938b63-1cb8-4537-b6bc-a54084c5cffa-host-slash\") pod \"iptables-alerter-wh4vj\" (UID: \"32938b63-1cb8-4537-b6bc-a54084c5cffa\") " pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-run-k8s-cni-cncf-io\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-os-release\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f07ac7dd-089a-47e8-8fb1-cc9686102d27-agent-certs\") pod \"konnectivity-agent-rq288\" (UID: \"f07ac7dd-089a-47e8-8fb1-cc9686102d27\") " pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927300 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-cnibin\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927314 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-run-multus-certs\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-daemon-config\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-socket-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927369 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvjfc\" (UniqueName: \"kubernetes.io/projected/9e5cdd07-9588-449a-a00f-0e4ad0b10252-kube-api-access-kvjfc\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-device-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927450 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-socket-dir-parent\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-system-cni-dir\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-var-lib-cni-multus\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927498 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-var-lib-kubelet\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927513 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-hostroot\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-cni-dir\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32938b63-1cb8-4537-b6bc-a54084c5cffa-iptables-alerter-script\") pod \"iptables-alerter-wh4vj\" (UID: \"32938b63-1cb8-4537-b6bc-a54084c5cffa\") " pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-var-lib-cni-bin\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-conf-dir\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-registration-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg6mf\" (UniqueName: \"kubernetes.io/projected/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-kube-api-access-vg6mf\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f07ac7dd-089a-47e8-8fb1-cc9686102d27-konnectivity-ca\") pod \"konnectivity-agent-rq288\" (UID: \"f07ac7dd-089a-47e8-8fb1-cc9686102d27\") " pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-run-netns\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.927986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927637 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e5cdd07-9588-449a-a00f-0e4ad0b10252-cni-binary-copy\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927650 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-sys-fs\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927705 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-sys-fs\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927733 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-etc-kubernetes\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927777 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-run-k8s-cni-cncf-io\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927840 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-socket-dir-parent\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927904 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-os-release\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.927971 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-conf-dir\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928037 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-var-lib-kubelet\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928079 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-system-cni-dir\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928089 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-var-lib-cni-multus\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-run-netns\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928135 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-hostroot\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928156 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-registration-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928161 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-cni-dir\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928216 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-cnibin\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928254 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-run-multus-certs\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.928609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928263 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-socket-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.929220 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928268 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.929220 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928305 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-device-dir\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.929220 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928391 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e5cdd07-9588-449a-a00f-0e4ad0b10252-host-var-lib-cni-bin\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.929220 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928392 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32938b63-1cb8-4537-b6bc-a54084c5cffa-iptables-alerter-script\") pod \"iptables-alerter-wh4vj\" (UID: \"32938b63-1cb8-4537-b6bc-a54084c5cffa\") " pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:29.929220 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928497 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f07ac7dd-089a-47e8-8fb1-cc9686102d27-konnectivity-ca\") pod \"konnectivity-agent-rq288\" (UID: \"f07ac7dd-089a-47e8-8fb1-cc9686102d27\") " pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:29.929220 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.928577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e5cdd07-9588-449a-a00f-0e4ad0b10252-multus-daemon-config\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.930590 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.930539 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f07ac7dd-089a-47e8-8fb1-cc9686102d27-agent-certs\") pod \"konnectivity-agent-rq288\" (UID: \"f07ac7dd-089a-47e8-8fb1-cc9686102d27\") " pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:29.935890 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.935867 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:29.935890 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.935890 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:29.936083 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.935901 2560 projected.go:196] Error preparing data for projected volume kube-api-access-f676j for pod openshift-network-diagnostics/network-check-target-bn8xv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:29.936083 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:29.935992 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j podName:8705b171-7fc7-4eac-98e2-0dfc65b2840b nodeName:}" failed. No retries permitted until 2026-06-12 19:11:30.435973205 +0000 UTC m=+3.093012337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f676j" (UniqueName: "kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j") pod "network-check-target-bn8xv" (UID: "8705b171-7fc7-4eac-98e2-0dfc65b2840b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:29.939214 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.939124 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg6mf\" (UniqueName: \"kubernetes.io/projected/b6fc14d8-5322-42ae-a8e9-a1db373eeab1-kube-api-access-vg6mf\") pod \"aws-ebs-csi-driver-node-lsdb9\" (UID: \"b6fc14d8-5322-42ae-a8e9-a1db373eeab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:29.939659 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.939637 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvjfc\" (UniqueName: \"kubernetes.io/projected/9e5cdd07-9588-449a-a00f-0e4ad0b10252-kube-api-access-kvjfc\") pod \"multus-959z2\" (UID: \"9e5cdd07-9588-449a-a00f-0e4ad0b10252\") " pod="openshift-multus/multus-959z2" Jun 12 19:11:29.939749 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:29.939673 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmphf\" (UniqueName: \"kubernetes.io/projected/32938b63-1cb8-4537-b6bc-a54084c5cffa-kube-api-access-nmphf\") pod \"iptables-alerter-wh4vj\" (UID: \"32938b63-1cb8-4537-b6bc-a54084c5cffa\") " pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:30.008041 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.008002 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:11:30.017013 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.016984 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" Jun 12 19:11:30.023840 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.023816 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x68ms" Jun 12 19:11:30.030807 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.030777 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mg6nm" Jun 12 19:11:30.037782 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.037758 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z78v6" Jun 12 19:11:30.044523 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.044500 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:30.052422 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.052395 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-959z2" Jun 12 19:11:30.059151 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.059126 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wh4vj" Jun 12 19:11:30.063856 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.063834 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" Jun 12 19:11:30.212352 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.212273 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:30.331118 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.331083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:30.331118 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.331127 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:30.331362 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.331272 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:30.331362 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.331272 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:30.331362 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.331338 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs podName:3f558a51-da97-4815-815b-f1d519167f3f nodeName:}" failed. No retries permitted until 2026-06-12 19:11:31.331319635 +0000 UTC m=+3.988358754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs") pod "network-metrics-daemon-vqt4b" (UID: "3f558a51-da97-4815-815b-f1d519167f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:30.331362 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.331357 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret podName:576a70c6-3818-4726-b649-dbe1059ef0eb nodeName:}" failed. No retries permitted until 2026-06-12 19:11:31.331348829 +0000 UTC m=+3.988387955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret") pod "global-pull-secret-syncer-zs6dg" (UID: "576a70c6-3818-4726-b649-dbe1059ef0eb") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:30.532350 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.532267 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:30.532512 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.532437 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:30.532512 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.532466 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:30.532512 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.532481 2560 projected.go:196] Error preparing data for projected volume kube-api-access-f676j for pod openshift-network-diagnostics/network-check-target-bn8xv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:30.532619 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.532548 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j podName:8705b171-7fc7-4eac-98e2-0dfc65b2840b nodeName:}" failed. No retries permitted until 2026-06-12 19:11:31.532527906 +0000 UTC m=+4.189567024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f676j" (UniqueName: "kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j") pod "network-check-target-bn8xv" (UID: "8705b171-7fc7-4eac-98e2-0dfc65b2840b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:30.761533 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.761465 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 19:06:29 +0000 UTC" deadline="2027-12-30 01:27:38.525253203 +0000 UTC" Jun 12 19:11:30.761533 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.761530 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13566h16m7.763728433s" Jun 12 19:11:30.782085 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.782018 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:30.782261 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.782158 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:30.782580 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:30.782511 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:30.782679 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:30.782597 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:30.874651 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:30.874618 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77048b64_4fc6_4841_a6f5_602cee883b68.slice/crio-031847935feb3b5e9d607fdf7de8016acdfc430b17c69b2b37986b38fec0daf9 WatchSource:0}: Error finding container 031847935feb3b5e9d607fdf7de8016acdfc430b17c69b2b37986b38fec0daf9: Status 404 returned error can't find the container with id 031847935feb3b5e9d607fdf7de8016acdfc430b17c69b2b37986b38fec0daf9 Jun 12 19:11:30.876000 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:30.875971 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32938b63_1cb8_4537_b6bc_a54084c5cffa.slice/crio-6864826969d1c067b9814a98c55eee033deb326a0b76011c3a7d8bf25ae51460 WatchSource:0}: Error finding container 6864826969d1c067b9814a98c55eee033deb326a0b76011c3a7d8bf25ae51460: Status 404 returned error can't find the container with id 6864826969d1c067b9814a98c55eee033deb326a0b76011c3a7d8bf25ae51460 Jun 12 19:11:30.876910 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:30.876882 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf07ac7dd_089a_47e8_8fb1_cc9686102d27.slice/crio-e7966c2c0b200999f125b9218b549e69e84de7ff3136e736783bc2fcf9fb3879 WatchSource:0}: Error finding container e7966c2c0b200999f125b9218b549e69e84de7ff3136e736783bc2fcf9fb3879: Status 404 returned error can't find the container with id e7966c2c0b200999f125b9218b549e69e84de7ff3136e736783bc2fcf9fb3879 Jun 12 19:11:30.880862 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:30.880841 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4c6057_9698_4300_ae96_f738a41bd82e.slice/crio-8bfaa6d59a4e54c1421cec75cd07f3e532cf6c9fb214463793cff08e57fe0d47 WatchSource:0}: Error finding container 8bfaa6d59a4e54c1421cec75cd07f3e532cf6c9fb214463793cff08e57fe0d47: Status 404 returned error can't find the container with id 8bfaa6d59a4e54c1421cec75cd07f3e532cf6c9fb214463793cff08e57fe0d47 Jun 12 19:11:30.881672 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:30.881649 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9de2fd1_5260_48d1_8fa3_a71229c218fd.slice/crio-7903cb6ab0fa0da6cc656be4a0942b47117df2a5a31afd95d04efdfc1ec6c74c WatchSource:0}: Error finding container 7903cb6ab0fa0da6cc656be4a0942b47117df2a5a31afd95d04efdfc1ec6c74c: Status 404 returned error can't find the container with id 7903cb6ab0fa0da6cc656be4a0942b47117df2a5a31afd95d04efdfc1ec6c74c Jun 12 19:11:30.883600 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:30.883538 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6fc14d8_5322_42ae_a8e9_a1db373eeab1.slice/crio-8404f8897521c6abbf295b975c6c0c5186336bbaef2129d8afec2a903d052a62 WatchSource:0}: Error finding container 8404f8897521c6abbf295b975c6c0c5186336bbaef2129d8afec2a903d052a62: Status 404 returned error can't find the container with id 8404f8897521c6abbf295b975c6c0c5186336bbaef2129d8afec2a903d052a62 Jun 12 19:11:30.884336 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:30.884288 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73e27a5_19e3_45f5_9fee_718113ba39f3.slice/crio-3d7effc0d89e514bde90042a5fa657c3f8f82fc3465cd0826a7fa5927ea68d6e WatchSource:0}: Error finding container 3d7effc0d89e514bde90042a5fa657c3f8f82fc3465cd0826a7fa5927ea68d6e: Status 404 returned error can't find the container with id 3d7effc0d89e514bde90042a5fa657c3f8f82fc3465cd0826a7fa5927ea68d6e Jun 12 19:11:30.884685 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:11:30.884664 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5cdd07_9588_449a_a00f_0e4ad0b10252.slice/crio-f4eb789c05b20cea1063ec9a58d82f9e8af17c0198e2e882b9f80d20a4679e68 WatchSource:0}: Error finding container f4eb789c05b20cea1063ec9a58d82f9e8af17c0198e2e882b9f80d20a4679e68: Status 404 returned error can't find the container with id f4eb789c05b20cea1063ec9a58d82f9e8af17c0198e2e882b9f80d20a4679e68 Jun 12 19:11:31.145411 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.145383 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:31.338772 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.338679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:31.338772 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.338722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:31.338986 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:31.338851 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:31.338986 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:31.338861 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:31.338986 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:31.338941 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs podName:3f558a51-da97-4815-815b-f1d519167f3f nodeName:}" failed. No retries permitted until 2026-06-12 19:11:33.338894636 +0000 UTC m=+5.995933752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs") pod "network-metrics-daemon-vqt4b" (UID: "3f558a51-da97-4815-815b-f1d519167f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:31.338986 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:31.338960 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret podName:576a70c6-3818-4726-b649-dbe1059ef0eb nodeName:}" failed. No retries permitted until 2026-06-12 19:11:33.338951186 +0000 UTC m=+5.995990303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret") pod "global-pull-secret-syncer-zs6dg" (UID: "576a70c6-3818-4726-b649-dbe1059ef0eb") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:31.540787 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.540737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:31.540972 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:31.540947 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:31.540972 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:31.540969 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:31.541100 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:31.540983 2560 projected.go:196] Error preparing data for projected volume kube-api-access-f676j for pod openshift-network-diagnostics/network-check-target-bn8xv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:31.541100 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:31.541040 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j podName:8705b171-7fc7-4eac-98e2-0dfc65b2840b nodeName:}" failed. No retries permitted until 2026-06-12 19:11:33.541021741 +0000 UTC m=+6.198060862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f676j" (UniqueName: "kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j") pod "network-check-target-bn8xv" (UID: "8705b171-7fc7-4eac-98e2-0dfc65b2840b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:31.762094 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.761947 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 19:06:29 +0000 UTC" deadline="2027-11-21 12:28:57.390002926 +0000 UTC" Jun 12 19:11:31.762094 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.762009 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12641h17m25.62799998s" Jun 12 19:11:31.785184 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.784675 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:31.785184 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:31.784812 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:31.805016 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.804216 2560 generic.go:356] "Generic (PLEG): container finished" podID="72039ea588cd1aa514ff0bb34342eaf5" containerID="a8cebbdd56527b233f17216ddfb3f86164b0438aefa4e64b84dd438aee4b58b6" exitCode=0 Jun 12 19:11:31.805016 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.804302 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" event={"ID":"72039ea588cd1aa514ff0bb34342eaf5","Type":"ContainerDied","Data":"a8cebbdd56527b233f17216ddfb3f86164b0438aefa4e64b84dd438aee4b58b6"} Jun 12 19:11:31.810868 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.810832 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z78v6" event={"ID":"ecf413ba-720d-4080-a1b6-81aa7448185b","Type":"ContainerStarted","Data":"3a3adfc6e59e38024584669c9b467d86e1281f8b7f12da35f465e43df5fc6b94"} Jun 12 19:11:31.820723 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.820122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-959z2" event={"ID":"9e5cdd07-9588-449a-a00f-0e4ad0b10252","Type":"ContainerStarted","Data":"f4eb789c05b20cea1063ec9a58d82f9e8af17c0198e2e882b9f80d20a4679e68"} Jun 12 19:11:31.829588 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.829513 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x68ms" event={"ID":"f73e27a5-19e3-45f5-9fee-718113ba39f3","Type":"ContainerStarted","Data":"3d7effc0d89e514bde90042a5fa657c3f8f82fc3465cd0826a7fa5927ea68d6e"} Jun 12 19:11:31.835034 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.834996 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" event={"ID":"b6fc14d8-5322-42ae-a8e9-a1db373eeab1","Type":"ContainerStarted","Data":"8404f8897521c6abbf295b975c6c0c5186336bbaef2129d8afec2a903d052a62"} Jun 12 19:11:31.842458 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.842424 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wh4vj" event={"ID":"32938b63-1cb8-4537-b6bc-a54084c5cffa","Type":"ContainerStarted","Data":"6864826969d1c067b9814a98c55eee033deb326a0b76011c3a7d8bf25ae51460"} Jun 12 19:11:31.846351 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.846313 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mg6nm" event={"ID":"77048b64-4fc6-4841-a6f5-602cee883b68","Type":"ContainerStarted","Data":"031847935feb3b5e9d607fdf7de8016acdfc430b17c69b2b37986b38fec0daf9"} Jun 12 19:11:31.856698 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.856000 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal" event={"ID":"45c7ccf2d22eca00a3939e23b3e78371","Type":"ContainerStarted","Data":"a546694aeac05d4c89f466ed7a2ba37af2f8c7c394701883446acfade0c16f30"} Jun 12 19:11:31.861992 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.861891 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" event={"ID":"a9de2fd1-5260-48d1-8fa3-a71229c218fd","Type":"ContainerStarted","Data":"7903cb6ab0fa0da6cc656be4a0942b47117df2a5a31afd95d04efdfc1ec6c74c"} Jun 12 19:11:31.870451 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.870411 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" event={"ID":"9a4c6057-9698-4300-ae96-f738a41bd82e","Type":"ContainerStarted","Data":"8bfaa6d59a4e54c1421cec75cd07f3e532cf6c9fb214463793cff08e57fe0d47"} Jun 12 19:11:31.872934 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.872861 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-180.ec2.internal" podStartSLOduration=3.872830946 podStartE2EDuration="3.872830946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:31.871819568 +0000 UTC m=+4.528858719" watchObservedRunningTime="2026-06-12 19:11:31.872830946 +0000 UTC m=+4.529870086" Jun 12 19:11:31.875669 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:31.875634 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rq288" event={"ID":"f07ac7dd-089a-47e8-8fb1-cc9686102d27","Type":"ContainerStarted","Data":"e7966c2c0b200999f125b9218b549e69e84de7ff3136e736783bc2fcf9fb3879"} Jun 12 19:11:32.783075 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:32.782384 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:32.783075 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:32.782515 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:32.783075 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:32.782937 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:32.783075 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:32.783033 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:32.889026 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:32.888982 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" event={"ID":"72039ea588cd1aa514ff0bb34342eaf5","Type":"ContainerStarted","Data":"fd71af60b5201ad2dffacaf907d7944492debc25a3a6211b66e16e9f417031c3"} Jun 12 19:11:33.356808 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:33.356767 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:33.357008 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:33.356826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:33.357008 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:33.356993 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:33.357122 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:33.357057 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs podName:3f558a51-da97-4815-815b-f1d519167f3f nodeName:}" failed. No retries permitted until 2026-06-12 19:11:37.357038647 +0000 UTC m=+10.014077766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs") pod "network-metrics-daemon-vqt4b" (UID: "3f558a51-da97-4815-815b-f1d519167f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:33.357498 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:33.357443 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:33.357498 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:33.357496 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret podName:576a70c6-3818-4726-b649-dbe1059ef0eb nodeName:}" failed. No retries permitted until 2026-06-12 19:11:37.357480962 +0000 UTC m=+10.014520079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret") pod "global-pull-secret-syncer-zs6dg" (UID: "576a70c6-3818-4726-b649-dbe1059ef0eb") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:33.560323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:33.560282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:33.560494 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:33.560472 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:33.560565 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:33.560495 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:33.560565 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:33.560510 2560 projected.go:196] Error preparing data for projected volume kube-api-access-f676j for pod openshift-network-diagnostics/network-check-target-bn8xv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:33.560666 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:33.560572 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j podName:8705b171-7fc7-4eac-98e2-0dfc65b2840b nodeName:}" failed. No retries permitted until 2026-06-12 19:11:37.560552538 +0000 UTC m=+10.217591661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f676j" (UniqueName: "kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j") pod "network-check-target-bn8xv" (UID: "8705b171-7fc7-4eac-98e2-0dfc65b2840b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:33.784367 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:33.784278 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:33.784803 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:33.784431 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:34.781947 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:34.781894 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:34.782120 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:34.782091 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:34.782205 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:34.782175 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:34.782329 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:34.782300 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:35.783830 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:35.783389 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:35.783830 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:35.783527 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:36.782308 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:36.782267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:36.782489 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:36.782407 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:36.782489 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:36.782469 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:36.782614 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:36.782532 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:37.394696 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:37.394124 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:37.394696 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:37.394173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:37.394696 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:37.394295 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:37.394696 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:37.394294 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:37.394696 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:37.394350 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs podName:3f558a51-da97-4815-815b-f1d519167f3f nodeName:}" failed. No retries permitted until 2026-06-12 19:11:45.394332093 +0000 UTC m=+18.051371210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs") pod "network-metrics-daemon-vqt4b" (UID: "3f558a51-da97-4815-815b-f1d519167f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:37.394696 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:37.394367 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret podName:576a70c6-3818-4726-b649-dbe1059ef0eb nodeName:}" failed. No retries permitted until 2026-06-12 19:11:45.394360159 +0000 UTC m=+18.051399277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret") pod "global-pull-secret-syncer-zs6dg" (UID: "576a70c6-3818-4726-b649-dbe1059ef0eb") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:37.595623 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:37.595583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:37.595813 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:37.595730 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:37.595813 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:37.595753 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:37.595813 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:37.595766 2560 projected.go:196] Error preparing data for projected volume kube-api-access-f676j for pod openshift-network-diagnostics/network-check-target-bn8xv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:37.595995 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:37.595829 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j podName:8705b171-7fc7-4eac-98e2-0dfc65b2840b nodeName:}" failed. No retries permitted until 2026-06-12 19:11:45.595813305 +0000 UTC m=+18.252852422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f676j" (UniqueName: "kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j") pod "network-check-target-bn8xv" (UID: "8705b171-7fc7-4eac-98e2-0dfc65b2840b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:37.788043 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:37.787969 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:37.788197 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:37.788087 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:38.782327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:38.782293 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:38.782327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:38.782319 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:38.782813 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:38.782416 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:38.782813 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:38.782567 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:39.783610 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:39.783563 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:39.784102 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:39.783719 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:40.782278 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:40.782243 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:40.782573 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:40.782389 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:40.782573 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:40.782413 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:40.782573 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:40.782560 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:41.782849 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.782820 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:41.783509 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:41.782971 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:41.924673 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.924634 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x68ms" event={"ID":"f73e27a5-19e3-45f5-9fee-718113ba39f3","Type":"ContainerStarted","Data":"5346fa213482a466f51ed033a60ddfa55ad5cb35ddb3451a074fc75152140416"} Jun 12 19:11:41.926457 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.926425 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" event={"ID":"b6fc14d8-5322-42ae-a8e9-a1db373eeab1","Type":"ContainerStarted","Data":"3a1f5d0d9e1a54e258b33c5fc812d7fa6e68804c55b8dc99f6e8bcab1c2bead0"} Jun 12 19:11:41.928516 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.928490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mg6nm" event={"ID":"77048b64-4fc6-4841-a6f5-602cee883b68","Type":"ContainerStarted","Data":"91cdcf14fe1a4c0e091a5a77d7b7f9a4cf222aad1862c91fb106c5521a1871f0"} Jun 12 19:11:41.935022 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.934986 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9de2fd1-5260-48d1-8fa3-a71229c218fd" containerID="9f3e8aac5287aeb4356ebf4f86ed0bd62200b4098c42bd4335e6fd521d785c49" exitCode=0 Jun 12 19:11:41.935179 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.935075 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" event={"ID":"a9de2fd1-5260-48d1-8fa3-a71229c218fd","Type":"ContainerDied","Data":"9f3e8aac5287aeb4356ebf4f86ed0bd62200b4098c42bd4335e6fd521d785c49"} Jun 12 19:11:41.937941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.937894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rq288" event={"ID":"f07ac7dd-089a-47e8-8fb1-cc9686102d27","Type":"ContainerStarted","Data":"f78e993e0d1040f84e8fd03e1a34ebfcd4b1ac5b4c6306f3fb9228b61c151918"} Jun 12 19:11:41.940034 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.940002 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z78v6" event={"ID":"ecf413ba-720d-4080-a1b6-81aa7448185b","Type":"ContainerStarted","Data":"543892a174db44556523d66eae43c7b669f85fe877e706f310735ee57c74faca"} Jun 12 19:11:41.941198 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.941147 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x68ms" podStartSLOduration=3.966521365 podStartE2EDuration="13.941132639s" totalImagesPullingTime="9.974611274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:41.940179753 +0000 UTC m=+14.597218894" watchObservedRunningTime="2026-06-12 19:11:41.941132639 +0000 UTC m=+14.598171778" Jun 12 19:11:41.941343 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.941275 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-180.ec2.internal" podStartSLOduration=13.941269264 podStartE2EDuration="13.941269264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:32.916857635 +0000 UTC m=+5.573896777" watchObservedRunningTime="2026-06-12 19:11:41.941269264 +0000 UTC m=+14.598308401" Jun 12 19:11:41.948813 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.948784 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:41.949262 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.949228 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:41.955823 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.955771 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mg6nm" podStartSLOduration=3.9715261330000002 podStartE2EDuration="13.955754649s" totalImagesPullingTime="9.984228516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:41.955307304 +0000 UTC m=+14.612346445" watchObservedRunningTime="2026-06-12 19:11:41.955754649 +0000 UTC m=+14.612793787" Jun 12 19:11:41.981614 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:41.981555 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z78v6" podStartSLOduration=3.9568014160000002 podStartE2EDuration="13.981533133s" totalImagesPullingTime="10.024731717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:41.981269778 +0000 UTC m=+14.638308916" watchObservedRunningTime="2026-06-12 19:11:41.981533133 +0000 UTC m=+14.638572276" Jun 12 19:11:42.075739 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.075630 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rq288" podStartSLOduration=4.097652485 podStartE2EDuration="14.0756122s" totalImagesPullingTime="9.977959715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:42.038988626 +0000 UTC m=+14.696027766" watchObservedRunningTime="2026-06-12 19:11:42.0756122 +0000 UTC m=+14.732651693" Jun 12 19:11:42.487723 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.487696 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 19:11:42.782046 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.781951 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:42.782214 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:42.782075 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:42.782522 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.781957 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:42.782522 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:42.782463 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:42.783680 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.782856 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T19:11:42.487717522Z","UUID":"eac4a53f-409e-4ab5-88db-e3054708c3ac","Handler":null,"Name":"","Endpoint":""} Jun 12 19:11:42.785267 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.785241 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 19:11:42.785371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.785283 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 19:11:42.944947 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.944891 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" event={"ID":"b6fc14d8-5322-42ae-a8e9-a1db373eeab1","Type":"ContainerStarted","Data":"3f3d2294d076cc136ca3e454317ba9ab25baf73045953877eb39997f8327414a"} Jun 12 19:11:42.946626 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.946594 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wh4vj" event={"ID":"32938b63-1cb8-4537-b6bc-a54084c5cffa","Type":"ContainerStarted","Data":"95389a6626971c2ce2b3a045b5acd100f8c69d12f6329cbf12ca9978d6f15a1a"} Jun 12 19:11:42.964385 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:42.964333 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wh4vj" podStartSLOduration=4.954513157 podStartE2EDuration="14.964316336s" totalImagesPullingTime="10.009803179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:42.96393851 +0000 UTC m=+15.620977649" watchObservedRunningTime="2026-06-12 19:11:42.964316336 +0000 UTC m=+15.621355475" Jun 12 19:11:43.784295 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:43.783759 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:43.784295 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:43.783900 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:43.949241 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:43.949195 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 19:11:44.782781 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:44.782739 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:44.782978 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:44.782805 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:44.782978 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:44.782939 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:44.783101 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:44.783072 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:45.453622 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:45.453415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:45.454025 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:45.453636 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:45.454025 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:45.453754 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:45.454025 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:45.453809 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs podName:3f558a51-da97-4815-815b-f1d519167f3f nodeName:}" failed. No retries permitted until 2026-06-12 19:12:01.453794738 +0000 UTC m=+34.110833856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs") pod "network-metrics-daemon-vqt4b" (UID: "3f558a51-da97-4815-815b-f1d519167f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:45.454217 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:45.454201 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:45.454261 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:45.454248 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret podName:576a70c6-3818-4726-b649-dbe1059ef0eb nodeName:}" failed. No retries permitted until 2026-06-12 19:12:01.454233017 +0000 UTC m=+34.111272135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret") pod "global-pull-secret-syncer-zs6dg" (UID: "576a70c6-3818-4726-b649-dbe1059ef0eb") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:45.655669 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:45.655629 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:45.655877 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:45.655819 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:45.655877 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:45.655840 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:45.655877 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:45.655851 2560 projected.go:196] Error preparing data for projected volume kube-api-access-f676j for pod openshift-network-diagnostics/network-check-target-bn8xv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:45.656068 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:45.655902 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j podName:8705b171-7fc7-4eac-98e2-0dfc65b2840b nodeName:}" failed. No retries permitted until 2026-06-12 19:12:01.655888503 +0000 UTC m=+34.312927619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f676j" (UniqueName: "kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j") pod "network-check-target-bn8xv" (UID: "8705b171-7fc7-4eac-98e2-0dfc65b2840b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:45.782636 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:45.782547 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:45.782796 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:45.782696 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:46.782021 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:46.781984 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:46.782405 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:46.781987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:46.782405 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:46.782102 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:46.782405 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:46.782196 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:47.782807 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:47.782766 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:47.783285 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:47.782870 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:48.781931 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:48.781892 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:48.782134 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:48.782037 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:48.782134 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:48.782084 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:48.782244 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:48.782182 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:49.781977 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:49.781939 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:49.782533 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:49.782091 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:50.782241 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:50.782202 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:50.782241 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:50.782233 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:50.782674 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:50.782334 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:50.782674 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:50.782446 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:51.782839 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:51.782801 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:51.783318 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:51.782974 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:52.781934 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:52.781890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:52.782132 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:52.782044 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:52.782452 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:52.782427 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:52.782559 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:52.782542 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:53.782423 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:53.782385 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:53.782863 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:53.782524 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:54.781838 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.781666 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:54.781943 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.781672 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:54.781986 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:54.781957 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:54.782077 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:54.782054 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:54.975699 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.975662 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-959z2" event={"ID":"9e5cdd07-9588-449a-a00f-0e4ad0b10252","Type":"ContainerStarted","Data":"2436637ff3716ae0bf292c7501ec131cefa5865a26b98e5b299072411362c4fc"} Jun 12 19:11:54.977693 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.977657 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" event={"ID":"b6fc14d8-5322-42ae-a8e9-a1db373eeab1","Type":"ContainerStarted","Data":"8559c9e94f1aecb9859edbbc4cd44f78d454285c500e31dc014e3e0d313b0c10"} Jun 12 19:11:54.979762 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.979736 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9de2fd1-5260-48d1-8fa3-a71229c218fd" containerID="caf0d630769b131d809cdaa424a65f2ae3108131dce2a8b560a11fef09a19541" exitCode=0 Jun 12 19:11:54.979888 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.979830 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" event={"ID":"a9de2fd1-5260-48d1-8fa3-a71229c218fd","Type":"ContainerDied","Data":"caf0d630769b131d809cdaa424a65f2ae3108131dce2a8b560a11fef09a19541"} Jun 12 19:11:54.982897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.982863 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" event={"ID":"9a4c6057-9698-4300-ae96-f738a41bd82e","Type":"ContainerStarted","Data":"eb24f816c74e881c5c381b7187cf9b6b5c64f2d866b9f726a91c2a6124a82cf1"} Jun 12 19:11:54.983088 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.982950 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" event={"ID":"9a4c6057-9698-4300-ae96-f738a41bd82e","Type":"ContainerStarted","Data":"71261161047cd183a1caddafbef314d8c2501bcf65301a56613280912ba6b8e0"} Jun 12 19:11:54.983088 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.982988 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" event={"ID":"9a4c6057-9698-4300-ae96-f738a41bd82e","Type":"ContainerStarted","Data":"2996da7b7af6ff986e9fb3df36d88b7c66f91e2f09fc33c5dfed500bd7e2811b"} Jun 12 19:11:54.983088 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.983020 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" event={"ID":"9a4c6057-9698-4300-ae96-f738a41bd82e","Type":"ContainerStarted","Data":"df13afba5286646ec44063ef943f04fba969b2e805eac9a3377ec2434ffef58a"} Jun 12 19:11:54.983088 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.983051 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" event={"ID":"9a4c6057-9698-4300-ae96-f738a41bd82e","Type":"ContainerStarted","Data":"a1ee6118ab08aa8088f593a326a3e70c6caf610400feeb1d74a406e5f043ede2"} Jun 12 19:11:54.994686 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:54.994639 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-959z2" podStartSLOduration=3.4208940979999998 podStartE2EDuration="26.994624426s" totalImagesPullingTime="23.573730328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:54.99393438 +0000 UTC m=+27.650973511" watchObservedRunningTime="2026-06-12 19:11:54.994624426 +0000 UTC m=+27.651663565" Jun 12 19:11:55.016854 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:55.016804 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdb9" podStartSLOduration=3.82639139 podStartE2EDuration="27.016787556s" totalImagesPullingTime="23.190396166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:55.016762014 +0000 UTC m=+27.673801161" watchObservedRunningTime="2026-06-12 19:11:55.016787556 +0000 UTC m=+27.673826678" Jun 12 19:11:55.782246 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:55.782159 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:55.782406 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:55.782276 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:55.988001 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:55.987966 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" event={"ID":"9a4c6057-9698-4300-ae96-f738a41bd82e","Type":"ContainerStarted","Data":"31af9771c7886c72a7a64bf4c18c383fa09f76de97c0fcb53586fce59dd5c9d6"} Jun 12 19:11:56.782249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:56.782214 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:56.782435 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:56.782324 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:56.782435 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:56.782377 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:56.782506 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:56.782479 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:56.991956 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:56.991902 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9de2fd1-5260-48d1-8fa3-a71229c218fd" containerID="471ea853deadcc50f765e2e75509bc4d360dbd413708013f0b332697e6cce814" exitCode=0 Jun 12 19:11:56.992435 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:56.991972 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" event={"ID":"a9de2fd1-5260-48d1-8fa3-a71229c218fd","Type":"ContainerDied","Data":"471ea853deadcc50f765e2e75509bc4d360dbd413708013f0b332697e6cce814"} Jun 12 19:11:57.782779 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:57.782746 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:57.782989 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:57.782867 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:11:57.998962 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:57.998907 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" event={"ID":"9a4c6057-9698-4300-ae96-f738a41bd82e","Type":"ContainerStarted","Data":"c6b22ecb005e8f521227ff6ee573657907d11120732f421b89ff43b39521b4f4"} Jun 12 19:11:58.781937 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:58.781882 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:11:58.782149 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:58.781882 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:11:58.782149 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:58.782006 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:11:58.782149 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:58.782099 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:11:59.002984 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:59.002951 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9de2fd1-5260-48d1-8fa3-a71229c218fd" containerID="ef78d47c7d8ab5a64bab11ff5034ae8b4fa16ff85b19317477278306be5afbfb" exitCode=0 Jun 12 19:11:59.003335 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:59.003025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" event={"ID":"a9de2fd1-5260-48d1-8fa3-a71229c218fd","Type":"ContainerDied","Data":"ef78d47c7d8ab5a64bab11ff5034ae8b4fa16ff85b19317477278306be5afbfb"} Jun 12 19:11:59.761489 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:59.761248 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:59.761719 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:59.761614 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 19:11:59.761877 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:59.761854 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rq288" Jun 12 19:11:59.781832 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:11:59.781798 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:11:59.782017 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:11:59.781947 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:12:00.010413 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:00.010370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" event={"ID":"9a4c6057-9698-4300-ae96-f738a41bd82e","Type":"ContainerStarted","Data":"d08d626f8e14599105685320b633b2ff06259076d381e1f022c25a4af8b9446e"} Jun 12 19:12:00.044329 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:00.044208 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" podStartSLOduration=9.414037234 podStartE2EDuration="33.044191931s" totalImagesPullingTime="23.630154697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:00.043861687 +0000 UTC m=+32.700900839" watchObservedRunningTime="2026-06-12 19:12:00.044191931 +0000 UTC m=+32.701231070" Jun 12 19:12:00.782556 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:00.782519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:00.782556 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:00.782548 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:00.782816 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:00.782662 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:12:00.782816 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:00.782775 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:12:01.013293 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.013253 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:12:01.013741 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.013340 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:12:01.013741 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.013387 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:12:01.030024 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.029993 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:12:01.030195 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.030184 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:12:01.472084 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.472044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:01.472351 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.472111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:12:01.472351 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.472217 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:12:01.472351 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.472252 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:12:01.472351 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.472275 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret podName:576a70c6-3818-4726-b649-dbe1059ef0eb nodeName:}" failed. No retries permitted until 2026-06-12 19:12:33.472256404 +0000 UTC m=+66.129295521 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret") pod "global-pull-secret-syncer-zs6dg" (UID: "576a70c6-3818-4726-b649-dbe1059ef0eb") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:12:01.472351 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.472317 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs podName:3f558a51-da97-4815-815b-f1d519167f3f nodeName:}" failed. No retries permitted until 2026-06-12 19:12:33.472296391 +0000 UTC m=+66.129335512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs") pod "network-metrics-daemon-vqt4b" (UID: "3f558a51-da97-4815-815b-f1d519167f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:12:01.553658 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.553621 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zs6dg"] Jun 12 19:12:01.553878 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.553791 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:01.553965 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.553898 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:12:01.557226 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.557156 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bn8xv"] Jun 12 19:12:01.557376 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.557318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:01.557440 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.557418 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:12:01.557755 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.557732 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vqt4b"] Jun 12 19:12:01.557863 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.557851 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:12:01.558008 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.557988 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:12:01.673228 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:01.673185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:01.673438 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.673333 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:12:01.673438 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.673352 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:12:01.673438 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.673362 2560 projected.go:196] Error preparing data for projected volume kube-api-access-f676j for pod openshift-network-diagnostics/network-check-target-bn8xv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:12:01.673438 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:01.673431 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j podName:8705b171-7fc7-4eac-98e2-0dfc65b2840b nodeName:}" failed. No retries permitted until 2026-06-12 19:12:33.67341138 +0000 UTC m=+66.330450507 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f676j" (UniqueName: "kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j") pod "network-check-target-bn8xv" (UID: "8705b171-7fc7-4eac-98e2-0dfc65b2840b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:12:02.782233 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:02.782202 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:02.782634 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:02.782331 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:12:03.782428 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:03.782390 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:12:03.782895 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:03.782434 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:03.782895 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:03.782552 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:12:03.782895 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:03.782658 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:12:04.781733 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:04.781692 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:04.781966 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:04.781837 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:12:05.782953 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:05.782690 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:05.783406 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:05.782766 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:12:05.786986 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:05.783052 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:12:05.787145 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:05.787071 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:12:06.781729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:06.781707 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:06.781846 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:06.781804 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zs6dg" podUID="576a70c6-3818-4726-b649-dbe1059ef0eb" Jun 12 19:12:07.028455 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:07.028360 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9de2fd1-5260-48d1-8fa3-a71229c218fd" containerID="266db934c386e295edc6c7168c49c0da53bddbaa1a69a9b4064b720189bf86cd" exitCode=0 Jun 12 19:12:07.028455 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:07.028409 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" event={"ID":"a9de2fd1-5260-48d1-8fa3-a71229c218fd","Type":"ContainerDied","Data":"266db934c386e295edc6c7168c49c0da53bddbaa1a69a9b4064b720189bf86cd"} Jun 12 19:12:07.782686 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:07.782656 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:07.782884 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:07.782769 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8xv" podUID="8705b171-7fc7-4eac-98e2-0dfc65b2840b" Jun 12 19:12:07.782884 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:07.782788 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:12:07.783048 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:07.782906 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:12:08.033806 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.033712 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9de2fd1-5260-48d1-8fa3-a71229c218fd" containerID="00c35e9c0d84e58c2a2466449d985e41e8a5914e254e4e552a611f25b077fd76" exitCode=0 Jun 12 19:12:08.033806 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.033777 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" event={"ID":"a9de2fd1-5260-48d1-8fa3-a71229c218fd","Type":"ContainerDied","Data":"00c35e9c0d84e58c2a2466449d985e41e8a5914e254e4e552a611f25b077fd76"} Jun 12 19:12:08.202397 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.202366 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-180.ec2.internal" event="NodeReady" Jun 12 19:12:08.202582 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.202544 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 19:12:08.245527 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.245492 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f5558cfc5-vkbgv"] Jun 12 19:12:08.266307 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.266270 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.270672 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.270642 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5558cfc5-vkbgv"] Jun 12 19:12:08.270997 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.270669 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 19:12:08.271088 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.271020 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 19:12:08.271088 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.271021 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 19:12:08.271088 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.271082 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vhjkg\"" Jun 12 19:12:08.275271 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.275231 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-snhpj"] Jun 12 19:12:08.285847 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.285768 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 19:12:08.294130 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.294097 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nt6lr"] Jun 12 19:12:08.294239 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.294222 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-snhpj" Jun 12 19:12:08.296887 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.296862 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 19:12:08.297764 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.297739 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 19:12:08.297955 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.297833 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 19:12:08.297955 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.297858 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z8hpj\"" Jun 12 19:12:08.316292 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.316259 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nt6lr"] Jun 12 19:12:08.316292 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.316299 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-snhpj"] Jun 12 19:12:08.316500 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.316341 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.318998 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.318980 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 19:12:08.319340 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.319327 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 19:12:08.319473 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.319459 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b26x6\"" Jun 12 19:12:08.424937 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.424878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-installation-pull-secrets\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.424937 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.424912 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b6880fd-053a-4c13-836b-d8e91febbe85-cert\") pod \"ingress-canary-snhpj\" (UID: \"5b6880fd-053a-4c13-836b-d8e91febbe85\") " pod="openshift-ingress-canary/ingress-canary-snhpj" Jun 12 19:12:08.425182 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.424963 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a522ebac-d7a4-4f0d-a596-da66772e7def-config-volume\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.425182 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.425182 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a522ebac-d7a4-4f0d-a596-da66772e7def-tmp-dir\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.425182 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425041 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-certificates\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.425182 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425097 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-image-registry-private-configuration\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.425182 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.425182 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425149 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e0240c2-73e4-41ec-9b03-e1509a8a5298-ca-trust-extracted\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.425182 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xcsv\" (UniqueName: \"kubernetes.io/projected/5b6880fd-053a-4c13-836b-d8e91febbe85-kube-api-access-2xcsv\") pod \"ingress-canary-snhpj\" (UID: \"5b6880fd-053a-4c13-836b-d8e91febbe85\") " pod="openshift-ingress-canary/ingress-canary-snhpj" Jun 12 19:12:08.425452 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-bound-sa-token\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.425452 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425218 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnfrd\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-kube-api-access-qnfrd\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.425452 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp9cg\" (UniqueName: \"kubernetes.io/projected/a522ebac-d7a4-4f0d-a596-da66772e7def-kube-api-access-hp9cg\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.425452 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.425316 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-trusted-ca\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.525788 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.525752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-installation-pull-secrets\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.525788 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.525786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b6880fd-053a-4c13-836b-d8e91febbe85-cert\") pod \"ingress-canary-snhpj\" (UID: \"5b6880fd-053a-4c13-836b-d8e91febbe85\") " pod="openshift-ingress-canary/ingress-canary-snhpj" Jun 12 19:12:08.526047 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.525811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a522ebac-d7a4-4f0d-a596-da66772e7def-config-volume\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.526047 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.525959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.526047 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.525987 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a522ebac-d7a4-4f0d-a596-da66772e7def-tmp-dir\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.526047 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-certificates\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.526217 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526051 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-image-registry-private-configuration\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.526217 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:08.526056 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:08.526217 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526079 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.526217 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e0240c2-73e4-41ec-9b03-e1509a8a5298-ca-trust-extracted\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.526217 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:08.526124 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls podName:a522ebac-d7a4-4f0d-a596-da66772e7def nodeName:}" failed. No retries permitted until 2026-06-12 19:12:09.026104605 +0000 UTC m=+41.683143721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls") pod "dns-default-nt6lr" (UID: "a522ebac-d7a4-4f0d-a596-da66772e7def") : secret "dns-default-metrics-tls" not found Jun 12 19:12:08.526217 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526152 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xcsv\" (UniqueName: \"kubernetes.io/projected/5b6880fd-053a-4c13-836b-d8e91febbe85-kube-api-access-2xcsv\") pod \"ingress-canary-snhpj\" (UID: \"5b6880fd-053a-4c13-836b-d8e91febbe85\") " pod="openshift-ingress-canary/ingress-canary-snhpj" Jun 12 19:12:08.526217 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526187 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-bound-sa-token\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.526217 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnfrd\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-kube-api-access-qnfrd\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.526582 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526270 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp9cg\" (UniqueName: \"kubernetes.io/projected/a522ebac-d7a4-4f0d-a596-da66772e7def-kube-api-access-hp9cg\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.526582 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526302 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-trusted-ca\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.526582 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526365 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a522ebac-d7a4-4f0d-a596-da66772e7def-tmp-dir\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.526582 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526462 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a522ebac-d7a4-4f0d-a596-da66772e7def-config-volume\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.526582 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526473 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e0240c2-73e4-41ec-9b03-e1509a8a5298-ca-trust-extracted\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.526782 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.526737 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-certificates\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.526989 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:08.526968 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:12:08.527054 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:08.526992 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5558cfc5-vkbgv: secret "image-registry-tls" not found Jun 12 19:12:08.527808 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:08.527578 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls podName:4e0240c2-73e4-41ec-9b03-e1509a8a5298 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:09.027034525 +0000 UTC m=+41.684073661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls") pod "image-registry-7f5558cfc5-vkbgv" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298") : secret "image-registry-tls" not found Jun 12 19:12:08.529364 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.529341 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-trusted-ca\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.531015 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.530988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-installation-pull-secrets\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.531116 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.531091 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-image-registry-private-configuration\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.532799 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.532780 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b6880fd-053a-4c13-836b-d8e91febbe85-cert\") pod \"ingress-canary-snhpj\" (UID: \"5b6880fd-053a-4c13-836b-d8e91febbe85\") " pod="openshift-ingress-canary/ingress-canary-snhpj" Jun 12 19:12:08.536618 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.536561 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-bound-sa-token\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.537746 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.537723 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnfrd\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-kube-api-access-qnfrd\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:08.537991 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.537973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xcsv\" (UniqueName: \"kubernetes.io/projected/5b6880fd-053a-4c13-836b-d8e91febbe85-kube-api-access-2xcsv\") pod \"ingress-canary-snhpj\" (UID: \"5b6880fd-053a-4c13-836b-d8e91febbe85\") " pod="openshift-ingress-canary/ingress-canary-snhpj" Jun 12 19:12:08.538140 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.538125 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp9cg\" (UniqueName: \"kubernetes.io/projected/a522ebac-d7a4-4f0d-a596-da66772e7def-kube-api-access-hp9cg\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:08.604704 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.604654 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-snhpj" Jun 12 19:12:08.782766 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.782570 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:08.785516 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.785495 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 19:12:08.835104 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:08.835071 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-snhpj"] Jun 12 19:12:08.838911 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:12:08.838884 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6880fd_053a_4c13_836b_d8e91febbe85.slice/crio-645d6bfe8c6fc7e5a4a5eb4df402beb4c52f4b9531ee3621b5beadd3c079ab5c WatchSource:0}: Error finding container 645d6bfe8c6fc7e5a4a5eb4df402beb4c52f4b9531ee3621b5beadd3c079ab5c: Status 404 returned error can't find the container with id 645d6bfe8c6fc7e5a4a5eb4df402beb4c52f4b9531ee3621b5beadd3c079ab5c Jun 12 19:12:09.030793 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.030751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:09.030989 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.030803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:09.030989 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:09.030899 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:09.030989 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:09.030905 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:12:09.030989 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:09.030937 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5558cfc5-vkbgv: secret "image-registry-tls" not found Jun 12 19:12:09.030989 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:09.030981 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls podName:a522ebac-d7a4-4f0d-a596-da66772e7def nodeName:}" failed. No retries permitted until 2026-06-12 19:12:10.030965443 +0000 UTC m=+42.688004560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls") pod "dns-default-nt6lr" (UID: "a522ebac-d7a4-4f0d-a596-da66772e7def") : secret "dns-default-metrics-tls" not found Jun 12 19:12:09.031160 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:09.030996 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls podName:4e0240c2-73e4-41ec-9b03-e1509a8a5298 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:10.030988853 +0000 UTC m=+42.688027969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls") pod "image-registry-7f5558cfc5-vkbgv" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298") : secret "image-registry-tls" not found Jun 12 19:12:09.037767 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.037728 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-snhpj" event={"ID":"5b6880fd-053a-4c13-836b-d8e91febbe85","Type":"ContainerStarted","Data":"645d6bfe8c6fc7e5a4a5eb4df402beb4c52f4b9531ee3621b5beadd3c079ab5c"} Jun 12 19:12:09.041221 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.041137 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" event={"ID":"a9de2fd1-5260-48d1-8fa3-a71229c218fd","Type":"ContainerStarted","Data":"cae4770ef579d83f83882b7deadf286ef13bc4a83121740f6d0ed049a04c8880"} Jun 12 19:12:09.073851 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.073795 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5l6mv" podStartSLOduration=8.438016190999999 podStartE2EDuration="41.073779498s" totalImagesPullingTime="32.635763307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:09.072369602 +0000 UTC m=+41.729408742" watchObservedRunningTime="2026-06-12 19:12:09.073779498 +0000 UTC m=+41.730818638" Jun 12 19:12:09.781775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.781735 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:09.782018 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.781958 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:12:09.785314 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.785289 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-trrmf\"" Jun 12 19:12:09.786495 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.786471 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 19:12:09.786599 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.786485 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 19:12:09.786599 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.786485 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6rt4s\"" Jun 12 19:12:09.786599 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:09.786484 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 19:12:10.040012 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:10.039909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:10.040012 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:10.039994 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:10.040520 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:10.040085 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:10.040520 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:10.040141 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls podName:a522ebac-d7a4-4f0d-a596-da66772e7def nodeName:}" failed. No retries permitted until 2026-06-12 19:12:12.040127871 +0000 UTC m=+44.697166988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls") pod "dns-default-nt6lr" (UID: "a522ebac-d7a4-4f0d-a596-da66772e7def") : secret "dns-default-metrics-tls" not found Jun 12 19:12:10.040520 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:10.040157 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:12:10.040520 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:10.040177 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5558cfc5-vkbgv: secret "image-registry-tls" not found Jun 12 19:12:10.040520 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:10.040231 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls podName:4e0240c2-73e4-41ec-9b03-e1509a8a5298 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:12.040211148 +0000 UTC m=+44.697250285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls") pod "image-registry-7f5558cfc5-vkbgv" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298") : secret "image-registry-tls" not found Jun 12 19:12:12.049967 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:12.049906 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-snhpj" event={"ID":"5b6880fd-053a-4c13-836b-d8e91febbe85","Type":"ContainerStarted","Data":"5ee78db2604d70f7a71b6cffddf88ee6713e1ebb7c862dfce9315746d100d01a"} Jun 12 19:12:12.056769 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:12.056742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:12.056872 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:12.056785 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:12.056905 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:12.056880 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:12.056964 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:12.056953 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls podName:a522ebac-d7a4-4f0d-a596-da66772e7def nodeName:}" failed. No retries permitted until 2026-06-12 19:12:16.056937972 +0000 UTC m=+48.713977089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls") pod "dns-default-nt6lr" (UID: "a522ebac-d7a4-4f0d-a596-da66772e7def") : secret "dns-default-metrics-tls" not found Jun 12 19:12:12.057004 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:12.056883 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:12:12.057004 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:12.056981 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5558cfc5-vkbgv: secret "image-registry-tls" not found Jun 12 19:12:12.057064 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:12.057020 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls podName:4e0240c2-73e4-41ec-9b03-e1509a8a5298 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:16.057009196 +0000 UTC m=+48.714048313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls") pod "image-registry-7f5558cfc5-vkbgv" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298") : secret "image-registry-tls" not found Jun 12 19:12:12.069315 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:12.069259 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-snhpj" podStartSLOduration=1.835371466 podStartE2EDuration="4.069243138s" totalImagesPullingTime="2.233871672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:12.068450474 +0000 UTC m=+44.725489613" watchObservedRunningTime="2026-06-12 19:12:12.069243138 +0000 UTC m=+44.726282256" Jun 12 19:12:16.088609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:16.088568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:16.089099 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:16.088654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:16.089099 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:16.088732 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:12:16.089099 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:16.088747 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:16.089099 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:16.088751 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5558cfc5-vkbgv: secret "image-registry-tls" not found Jun 12 19:12:16.089099 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:16.088800 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls podName:4e0240c2-73e4-41ec-9b03-e1509a8a5298 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:24.088784904 +0000 UTC m=+56.745824021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls") pod "image-registry-7f5558cfc5-vkbgv" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298") : secret "image-registry-tls" not found Jun 12 19:12:16.089099 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:16.088813 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls podName:a522ebac-d7a4-4f0d-a596-da66772e7def nodeName:}" failed. No retries permitted until 2026-06-12 19:12:24.088807074 +0000 UTC m=+56.745846191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls") pod "dns-default-nt6lr" (UID: "a522ebac-d7a4-4f0d-a596-da66772e7def") : secret "dns-default-metrics-tls" not found Jun 12 19:12:24.147592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:24.147544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:24.148159 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:24.147614 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:24.148159 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:24.147706 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:24.148159 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:24.147763 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:12:24.148159 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:24.147776 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls podName:a522ebac-d7a4-4f0d-a596-da66772e7def nodeName:}" failed. No retries permitted until 2026-06-12 19:12:40.14775861 +0000 UTC m=+72.804797726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls") pod "dns-default-nt6lr" (UID: "a522ebac-d7a4-4f0d-a596-da66772e7def") : secret "dns-default-metrics-tls" not found Jun 12 19:12:24.148159 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:24.147778 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5558cfc5-vkbgv: secret "image-registry-tls" not found Jun 12 19:12:24.148159 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:24.147865 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls podName:4e0240c2-73e4-41ec-9b03-e1509a8a5298 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:40.14784845 +0000 UTC m=+72.804887571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls") pod "image-registry-7f5558cfc5-vkbgv" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298") : secret "image-registry-tls" not found Jun 12 19:12:33.027977 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.027942 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvrvx" Jun 12 19:12:33.515297 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.515254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:33.515481 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.515302 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:12:33.517991 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.517968 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 19:12:33.518090 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.517972 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 19:12:33.526242 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:33.526216 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 19:12:33.526359 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:33.526306 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs podName:3f558a51-da97-4815-815b-f1d519167f3f nodeName:}" failed. No retries permitted until 2026-06-12 19:13:37.526284177 +0000 UTC m=+130.183323295 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs") pod "network-metrics-daemon-vqt4b" (UID: "3f558a51-da97-4815-815b-f1d519167f3f") : secret "metrics-daemon-secret" not found Jun 12 19:12:33.530048 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.530029 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576a70c6-3818-4726-b649-dbe1059ef0eb-original-pull-secret\") pod \"global-pull-secret-syncer-zs6dg\" (UID: \"576a70c6-3818-4726-b649-dbe1059ef0eb\") " pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:33.692141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.692086 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zs6dg" Jun 12 19:12:33.716445 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.716411 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:33.719495 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.719470 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 19:12:33.729384 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.729359 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 19:12:33.740039 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.740011 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f676j\" (UniqueName: \"kubernetes.io/projected/8705b171-7fc7-4eac-98e2-0dfc65b2840b-kube-api-access-f676j\") pod \"network-check-target-bn8xv\" (UID: \"8705b171-7fc7-4eac-98e2-0dfc65b2840b\") " pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:33.795776 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.795744 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-trrmf\"" Jun 12 19:12:33.804019 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.803977 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:33.823172 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.823140 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zs6dg"] Jun 12 19:12:33.826438 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:12:33.826400 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576a70c6_3818_4726_b649_dbe1059ef0eb.slice/crio-6a26ab8a0c5c7b72ae56ca68633080ab80d8dd455b89c172cfc9eb0a3a7a99d3 WatchSource:0}: Error finding container 6a26ab8a0c5c7b72ae56ca68633080ab80d8dd455b89c172cfc9eb0a3a7a99d3: Status 404 returned error can't find the container with id 6a26ab8a0c5c7b72ae56ca68633080ab80d8dd455b89c172cfc9eb0a3a7a99d3 Jun 12 19:12:33.941567 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:33.941525 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bn8xv"] Jun 12 19:12:33.945013 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:12:33.944972 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8705b171_7fc7_4eac_98e2_0dfc65b2840b.slice/crio-7dfd2f71d7e264b55f1cb04a11c651381dedb0742f072456edd0efe23edcf57a WatchSource:0}: Error finding container 7dfd2f71d7e264b55f1cb04a11c651381dedb0742f072456edd0efe23edcf57a: Status 404 returned error can't find the container with id 7dfd2f71d7e264b55f1cb04a11c651381dedb0742f072456edd0efe23edcf57a Jun 12 19:12:34.103388 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:34.103297 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bn8xv" event={"ID":"8705b171-7fc7-4eac-98e2-0dfc65b2840b","Type":"ContainerStarted","Data":"7dfd2f71d7e264b55f1cb04a11c651381dedb0742f072456edd0efe23edcf57a"} Jun 12 19:12:34.104478 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:34.104459 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zs6dg" event={"ID":"576a70c6-3818-4726-b649-dbe1059ef0eb","Type":"ContainerStarted","Data":"6a26ab8a0c5c7b72ae56ca68633080ab80d8dd455b89c172cfc9eb0a3a7a99d3"} Jun 12 19:12:40.124467 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:40.124417 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bn8xv" event={"ID":"8705b171-7fc7-4eac-98e2-0dfc65b2840b","Type":"ContainerStarted","Data":"8a15aa70f82f90a60381a00769ff59b42fabffbdb75f14e44f04d9f9b674e5c2"} Jun 12 19:12:40.125003 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:40.124563 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:12:40.125994 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:40.125968 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zs6dg" event={"ID":"576a70c6-3818-4726-b649-dbe1059ef0eb","Type":"ContainerStarted","Data":"673544a4dce01803f0c7250f9fba9281dbc1edb96c28d8b4c96f198464191995"} Jun 12 19:12:40.142588 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:40.142531 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bn8xv" podStartSLOduration=66.357585382 podStartE2EDuration="1m12.142513336s" totalImagesPullingTime="5.784927954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:40.14188071 +0000 UTC m=+72.798919850" watchObservedRunningTime="2026-06-12 19:12:40.142513336 +0000 UTC m=+72.799552474" Jun 12 19:12:40.157780 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:40.157729 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zs6dg" podStartSLOduration=66.251053952 podStartE2EDuration="1m12.157710151s" totalImagesPullingTime="5.906656199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:40.157289833 +0000 UTC m=+72.814328971" watchObservedRunningTime="2026-06-12 19:12:40.157710151 +0000 UTC m=+72.814749289" Jun 12 19:12:40.167456 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:40.167420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:12:40.167539 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:12:40.167486 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:12:40.167602 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:40.167584 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:40.167664 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:40.167653 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls podName:a522ebac-d7a4-4f0d-a596-da66772e7def nodeName:}" failed. No retries permitted until 2026-06-12 19:13:12.167635292 +0000 UTC m=+104.824674422 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls") pod "dns-default-nt6lr" (UID: "a522ebac-d7a4-4f0d-a596-da66772e7def") : secret "dns-default-metrics-tls" not found Jun 12 19:12:40.167723 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:40.167587 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:12:40.167723 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:40.167688 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5558cfc5-vkbgv: secret "image-registry-tls" not found Jun 12 19:12:40.167808 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:12:40.167754 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls podName:4e0240c2-73e4-41ec-9b03-e1509a8a5298 nodeName:}" failed. No retries permitted until 2026-06-12 19:13:12.167732832 +0000 UTC m=+104.824771971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls") pod "image-registry-7f5558cfc5-vkbgv" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298") : secret "image-registry-tls" not found Jun 12 19:13:11.131001 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:13:11.130966 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bn8xv" Jun 12 19:13:12.183296 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:13:12.183248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:13:12.183684 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:13:12.183305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:13:12.183684 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:13:12.183409 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:13:12.183684 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:13:12.183407 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:13:12.183684 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:13:12.183422 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5558cfc5-vkbgv: secret "image-registry-tls" not found Jun 12 19:13:12.183684 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:13:12.183490 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls podName:a522ebac-d7a4-4f0d-a596-da66772e7def nodeName:}" failed. No retries permitted until 2026-06-12 19:14:16.183469241 +0000 UTC m=+168.840508360 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls") pod "dns-default-nt6lr" (UID: "a522ebac-d7a4-4f0d-a596-da66772e7def") : secret "dns-default-metrics-tls" not found Jun 12 19:13:12.183684 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:13:12.183508 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls podName:4e0240c2-73e4-41ec-9b03-e1509a8a5298 nodeName:}" failed. No retries permitted until 2026-06-12 19:14:16.183499695 +0000 UTC m=+168.840538814 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls") pod "image-registry-7f5558cfc5-vkbgv" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298") : secret "image-registry-tls" not found Jun 12 19:13:37.557184 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:13:37.557139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:13:37.557640 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:13:37.557266 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 19:13:37.557640 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:13:37.557331 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs podName:3f558a51-da97-4815-815b-f1d519167f3f nodeName:}" failed. No retries permitted until 2026-06-12 19:15:39.557315299 +0000 UTC m=+252.214354416 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs") pod "network-metrics-daemon-vqt4b" (UID: "3f558a51-da97-4815-815b-f1d519167f3f") : secret "metrics-daemon-secret" not found Jun 12 19:14:11.277992 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:14:11.277869 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" podUID="4e0240c2-73e4-41ec-9b03-e1509a8a5298" Jun 12 19:14:11.324517 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:14:11.324455 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nt6lr" podUID="a522ebac-d7a4-4f0d-a596-da66772e7def" Jun 12 19:14:11.339235 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:14:11.339211 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt6lr" Jun 12 19:14:11.339356 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:14:11.339211 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:14:12.797747 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:14:12.797691 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vqt4b" podUID="3f558a51-da97-4815-815b-f1d519167f3f" Jun 12 19:14:16.237112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:14:16.237058 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:14:16.237112 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:14:16.237117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:14:16.237628 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:14:16.237207 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:14:16.237628 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:14:16.237241 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:14:16.237628 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:14:16.237252 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5558cfc5-vkbgv: secret "image-registry-tls" not found Jun 12 19:14:16.237628 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:14:16.237281 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls podName:a522ebac-d7a4-4f0d-a596-da66772e7def nodeName:}" failed. No retries permitted until 2026-06-12 19:16:18.237263752 +0000 UTC m=+290.894302870 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls") pod "dns-default-nt6lr" (UID: "a522ebac-d7a4-4f0d-a596-da66772e7def") : secret "dns-default-metrics-tls" not found Jun 12 19:14:16.237628 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:14:16.237304 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls podName:4e0240c2-73e4-41ec-9b03-e1509a8a5298 nodeName:}" failed. No retries permitted until 2026-06-12 19:16:18.23729157 +0000 UTC m=+290.894330688 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls") pod "image-registry-7f5558cfc5-vkbgv" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298") : secret "image-registry-tls" not found Jun 12 19:14:27.782852 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:14:27.782816 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:15:02.216372 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.216330 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-mtf6v"] Jun 12 19:15:02.218712 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.218686 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.219522 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.219499 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh"] Jun 12 19:15:02.221309 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.221284 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh" Jun 12 19:15:02.227269 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.227241 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 12 19:15:02.227850 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.227828 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs"] Jun 12 19:15:02.228222 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.228203 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kxcjc\"" Jun 12 19:15:02.229133 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.229117 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:15:02.229540 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.229523 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6849884d84-7q7hb"] Jun 12 19:15:02.229643 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.229630 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.231182 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.231153 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.231411 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.231326 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 12 19:15:02.231411 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.231359 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 12 19:15:02.231763 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.231742 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hjgfp\"" Jun 12 19:15:02.237849 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.237830 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 19:15:02.238017 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.237995 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 12 19:15:02.238092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.237994 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 12 19:15:02.239040 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.238868 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 19:15:02.239040 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.238868 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 12 19:15:02.239040 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.238962 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 19:15:02.239040 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.238965 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 12 19:15:02.239240 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.239171 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 19:15:02.239240 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.239177 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xtj4b\"" Jun 12 19:15:02.240079 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.240063 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 12 19:15:02.240174 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.240096 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 12 19:15:02.248111 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.248088 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-mtf6v"] Jun 12 19:15:02.250289 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.250269 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9ppqs\"" Jun 12 19:15:02.252533 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.252509 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 12 19:15:02.253319 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.253295 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh"] Jun 12 19:15:02.324122 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.324087 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-8xc2x"] Jun 12 19:15:02.326017 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.325995 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h"] Jun 12 19:15:02.326133 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.326116 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.328164 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.328138 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k"] Jun 12 19:15:02.328307 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.328259 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:02.329942 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.329899 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.341146 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.341122 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 12 19:15:02.341493 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.341461 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 12 19:15:02.341592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.341464 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 12 19:15:02.341592 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.341471 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:15:02.341763 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.341746 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:15:02.341829 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.341804 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 19:15:02.341898 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.341878 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 12 19:15:02.342044 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.342030 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6q8kk\"" Jun 12 19:15:02.342174 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.342160 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 12 19:15:02.342561 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.342548 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cmtbk\"" Jun 12 19:15:02.342609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.342593 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sn4vr\"" Jun 12 19:15:02.345775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.345758 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 12 19:15:02.346276 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.346263 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 19:15:02.346537 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.346520 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 12 19:15:02.355028 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.354969 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6849884d84-7q7hb"] Jun 12 19:15:02.356366 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.356343 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs"] Jun 12 19:15:02.361099 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.361064 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k"] Jun 12 19:15:02.362800 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.362777 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-8xc2x"] Jun 12 19:15:02.362987 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.362968 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e309f40-74d1-44ff-be6a-98ed82002869-config\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.363062 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.362999 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.363062 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363042 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e309f40-74d1-44ff-be6a-98ed82002869-trusted-ca\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.363146 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363076 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gz4l\" (UniqueName: \"kubernetes.io/projected/6eaed572-c30c-45ab-9671-c57af5246ff5-kube-api-access-4gz4l\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.363146 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.363146 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363116 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg8qp\" (UniqueName: \"kubernetes.io/projected/b37e11a4-3f0f-42e8-b77e-35aca5b6d1a0-kube-api-access-lg8qp\") pod \"network-check-source-6947749cfc-c7lsh\" (UID: \"b37e11a4-3f0f-42e8-b77e-35aca5b6d1a0\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh" Jun 12 19:15:02.363265 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkccm\" (UniqueName: \"kubernetes.io/projected/267d10fa-9a18-411e-a497-18a537cbb40d-kube-api-access-nkccm\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.363265 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/267d10fa-9a18-411e-a497-18a537cbb40d-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.363265 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e309f40-74d1-44ff-be6a-98ed82002869-serving-cert\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.363265 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.363426 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-stats-auth\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.363426 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-default-certificate\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.363426 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.363360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwrbs\" (UniqueName: \"kubernetes.io/projected/1e309f40-74d1-44ff-be6a-98ed82002869-kube-api-access-cwrbs\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.365887 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.365867 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 12 19:15:02.380131 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.380099 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h"] Jun 12 19:15:02.390598 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.390569 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x"] Jun 12 19:15:02.392630 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.392613 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x" Jun 12 19:15:02.401642 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.401620 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9hgkz\"" Jun 12 19:15:02.401885 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.401872 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:15:02.402077 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.402065 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 12 19:15:02.432292 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.432262 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x"] Jun 12 19:15:02.463783 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.463747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.463974 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.463788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg8qp\" (UniqueName: \"kubernetes.io/projected/b37e11a4-3f0f-42e8-b77e-35aca5b6d1a0-kube-api-access-lg8qp\") pod \"network-check-source-6947749cfc-c7lsh\" (UID: \"b37e11a4-3f0f-42e8-b77e-35aca5b6d1a0\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh" Jun 12 19:15:02.463974 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.463842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkccm\" (UniqueName: \"kubernetes.io/projected/267d10fa-9a18-411e-a497-18a537cbb40d-kube-api-access-nkccm\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.463974 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.463871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:02.463974 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.463894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/267d10fa-9a18-411e-a497-18a537cbb40d-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.463974 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.463963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e309f40-74d1-44ff-be6a-98ed82002869-serving-cert\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.463997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm5d7\" (UniqueName: \"kubernetes.io/projected/6a19eacb-0d57-4fb8-af5f-ef0c1aa711ad-kube-api-access-rm5d7\") pod \"volume-data-source-validator-bd4ccd799-bjj9x\" (UID: \"6a19eacb-0d57-4fb8-af5f-ef0c1aa711ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x" Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464031 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c7b00-e5f7-4b65-a49d-a4c845903520-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7b00-e5f7-4b65-a49d-a4c845903520-snapshots\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.464091 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.464122 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464124 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9091e6de-482a-4b96-be50-dd440317d294-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-n4f2k\" (UID: \"9091e6de-482a-4b96-be50-dd440317d294\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.464165 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:02.964144055 +0000 UTC m=+215.621183179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : secret "router-metrics-certs-default" not found Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.464184 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls podName:267d10fa-9a18-411e-a497-18a537cbb40d nodeName:}" failed. No retries permitted until 2026-06-12 19:15:02.964174739 +0000 UTC m=+215.621213859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-gjkvs" (UID: "267d10fa-9a18-411e-a497-18a537cbb40d") : secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464207 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfkgz\" (UniqueName: \"kubernetes.io/projected/96903af3-354b-459d-88ff-6701e41d9544-kube-api-access-hfkgz\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:02.464249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464229 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5z7t\" (UniqueName: \"kubernetes.io/projected/ec5c7b00-e5f7-4b65-a49d-a4c845903520-kube-api-access-x5z7t\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-stats-auth\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464336 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec5c7b00-e5f7-4b65-a49d-a4c845903520-serving-cert\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464386 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9091e6de-482a-4b96-be50-dd440317d294-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-n4f2k\" (UID: \"9091e6de-482a-4b96-be50-dd440317d294\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-default-certificate\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464467 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrbs\" (UniqueName: \"kubernetes.io/projected/1e309f40-74d1-44ff-be6a-98ed82002869-kube-api-access-cwrbs\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464495 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e309f40-74d1-44ff-be6a-98ed82002869-config\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7b00-e5f7-4b65-a49d-a4c845903520-tmp\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464582 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c7b00-e5f7-4b65-a49d-a4c845903520-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464640 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdgtc\" (UniqueName: \"kubernetes.io/projected/9091e6de-482a-4b96-be50-dd440317d294-kube-api-access-sdgtc\") pod \"kube-storage-version-migrator-operator-7c578b78fc-n4f2k\" (UID: \"9091e6de-482a-4b96-be50-dd440317d294\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464692 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e309f40-74d1-44ff-be6a-98ed82002869-trusted-ca\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464720 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/267d10fa-9a18-411e-a497-18a537cbb40d-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.464815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.464730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gz4l\" (UniqueName: \"kubernetes.io/projected/6eaed572-c30c-45ab-9671-c57af5246ff5-kube-api-access-4gz4l\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.465556 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.464891 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:02.964874876 +0000 UTC m=+215.621913994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : configmap references non-existent config key: service-ca.crt Jun 12 19:15:02.465556 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.465371 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e309f40-74d1-44ff-be6a-98ed82002869-config\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.465740 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.465718 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e309f40-74d1-44ff-be6a-98ed82002869-trusted-ca\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.466729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.466679 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e309f40-74d1-44ff-be6a-98ed82002869-serving-cert\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.466875 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.466858 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-stats-auth\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.466936 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.466883 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-default-certificate\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.475506 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.475471 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg8qp\" (UniqueName: \"kubernetes.io/projected/b37e11a4-3f0f-42e8-b77e-35aca5b6d1a0-kube-api-access-lg8qp\") pod \"network-check-source-6947749cfc-c7lsh\" (UID: \"b37e11a4-3f0f-42e8-b77e-35aca5b6d1a0\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh" Jun 12 19:15:02.475632 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.475597 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkccm\" (UniqueName: \"kubernetes.io/projected/267d10fa-9a18-411e-a497-18a537cbb40d-kube-api-access-nkccm\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.476621 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.476597 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gz4l\" (UniqueName: \"kubernetes.io/projected/6eaed572-c30c-45ab-9671-c57af5246ff5-kube-api-access-4gz4l\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.476716 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.476663 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwrbs\" (UniqueName: \"kubernetes.io/projected/1e309f40-74d1-44ff-be6a-98ed82002869-kube-api-access-cwrbs\") pod \"console-operator-5dbbb5d744-mtf6v\" (UID: \"1e309f40-74d1-44ff-be6a-98ed82002869\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.528331 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.528295 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:02.535065 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.535043 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.565769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec5c7b00-e5f7-4b65-a49d-a4c845903520-serving-cert\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.565821 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9091e6de-482a-4b96-be50-dd440317d294-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-n4f2k\" (UID: \"9091e6de-482a-4b96-be50-dd440317d294\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.565862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7b00-e5f7-4b65-a49d-a4c845903520-tmp\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.565900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c7b00-e5f7-4b65-a49d-a4c845903520-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.565941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdgtc\" (UniqueName: \"kubernetes.io/projected/9091e6de-482a-4b96-be50-dd440317d294-kube-api-access-sdgtc\") pod \"kube-storage-version-migrator-operator-7c578b78fc-n4f2k\" (UID: \"9091e6de-482a-4b96-be50-dd440317d294\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.566014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.566046 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm5d7\" (UniqueName: \"kubernetes.io/projected/6a19eacb-0d57-4fb8-af5f-ef0c1aa711ad-kube-api-access-rm5d7\") pod \"volume-data-source-validator-bd4ccd799-bjj9x\" (UID: \"6a19eacb-0d57-4fb8-af5f-ef0c1aa711ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.566084 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c7b00-e5f7-4b65-a49d-a4c845903520-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.566115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7b00-e5f7-4b65-a49d-a4c845903520-snapshots\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.566138 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9091e6de-482a-4b96-be50-dd440317d294-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-n4f2k\" (UID: \"9091e6de-482a-4b96-be50-dd440317d294\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.566166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfkgz\" (UniqueName: \"kubernetes.io/projected/96903af3-354b-459d-88ff-6701e41d9544-kube-api-access-hfkgz\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.566194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5z7t\" (UniqueName: \"kubernetes.io/projected/ec5c7b00-e5f7-4b65-a49d-a4c845903520-kube-api-access-x5z7t\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.566365 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.566325 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 19:15:02.567541 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.566482 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls podName:96903af3-354b-459d-88ff-6701e41d9544 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:03.06644787 +0000 UTC m=+215.723487000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls") pod "cluster-samples-operator-9547488fd-cpj4h" (UID: "96903af3-354b-459d-88ff-6701e41d9544") : secret "samples-operator-tls" not found Jun 12 19:15:02.567541 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.566540 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9091e6de-482a-4b96-be50-dd440317d294-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-n4f2k\" (UID: \"9091e6de-482a-4b96-be50-dd440317d294\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.567541 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.567175 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7b00-e5f7-4b65-a49d-a4c845903520-snapshots\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.567541 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.567381 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c7b00-e5f7-4b65-a49d-a4c845903520-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.567541 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.567394 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7b00-e5f7-4b65-a49d-a4c845903520-tmp\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.567862 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.567843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c7b00-e5f7-4b65-a49d-a4c845903520-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.569240 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.569214 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9091e6de-482a-4b96-be50-dd440317d294-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-n4f2k\" (UID: \"9091e6de-482a-4b96-be50-dd440317d294\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.569336 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.569260 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec5c7b00-e5f7-4b65-a49d-a4c845903520-serving-cert\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.580150 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.580100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5z7t\" (UniqueName: \"kubernetes.io/projected/ec5c7b00-e5f7-4b65-a49d-a4c845903520-kube-api-access-x5z7t\") pod \"insights-operator-5bbd86d6bd-8xc2x\" (UID: \"ec5c7b00-e5f7-4b65-a49d-a4c845903520\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.580150 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.580103 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm5d7\" (UniqueName: \"kubernetes.io/projected/6a19eacb-0d57-4fb8-af5f-ef0c1aa711ad-kube-api-access-rm5d7\") pod \"volume-data-source-validator-bd4ccd799-bjj9x\" (UID: \"6a19eacb-0d57-4fb8-af5f-ef0c1aa711ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x" Jun 12 19:15:02.580839 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.580813 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfkgz\" (UniqueName: \"kubernetes.io/projected/96903af3-354b-459d-88ff-6701e41d9544-kube-api-access-hfkgz\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:02.581391 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.581352 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdgtc\" (UniqueName: \"kubernetes.io/projected/9091e6de-482a-4b96-be50-dd440317d294-kube-api-access-sdgtc\") pod \"kube-storage-version-migrator-operator-7c578b78fc-n4f2k\" (UID: \"9091e6de-482a-4b96-be50-dd440317d294\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.635435 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.635400 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" Jun 12 19:15:02.648122 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.648092 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" Jun 12 19:15:02.677438 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.676956 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-mtf6v"] Jun 12 19:15:02.691327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.691298 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh"] Jun 12 19:15:02.694049 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:02.693996 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37e11a4_3f0f_42e8_b77e_35aca5b6d1a0.slice/crio-93d3e3bf8b3dcfdae52656ee51c457c0303c01dbb54bee92831255841f7df812 WatchSource:0}: Error finding container 93d3e3bf8b3dcfdae52656ee51c457c0303c01dbb54bee92831255841f7df812: Status 404 returned error can't find the container with id 93d3e3bf8b3dcfdae52656ee51c457c0303c01dbb54bee92831255841f7df812 Jun 12 19:15:02.701575 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.701388 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x" Jun 12 19:15:02.795396 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.795281 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-8xc2x"] Jun 12 19:15:02.798419 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:02.798359 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5c7b00_e5f7_4b65_a49d_a4c845903520.slice/crio-4b0e193a79e581189b09756610f2951d58cacd52310fa11caed26de0d9921458 WatchSource:0}: Error finding container 4b0e193a79e581189b09756610f2951d58cacd52310fa11caed26de0d9921458: Status 404 returned error can't find the container with id 4b0e193a79e581189b09756610f2951d58cacd52310fa11caed26de0d9921458 Jun 12 19:15:02.812992 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.812955 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k"] Jun 12 19:15:02.820081 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:02.820052 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9091e6de_482a_4b96_be50_dd440317d294.slice/crio-b4af481fb7ee9334d510c912f22fb8883cd1fcb1efeacd709d379c92a22c5ec5 WatchSource:0}: Error finding container b4af481fb7ee9334d510c912f22fb8883cd1fcb1efeacd709d379c92a22c5ec5: Status 404 returned error can't find the container with id b4af481fb7ee9334d510c912f22fb8883cd1fcb1efeacd709d379c92a22c5ec5 Jun 12 19:15:02.865538 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.865504 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x"] Jun 12 19:15:02.868334 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:02.868302 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a19eacb_0d57_4fb8_af5f_ef0c1aa711ad.slice/crio-9a0a54e130d4a89d14cc305fe733c3ffc6c1c776c6de3eec0125cb45b8873292 WatchSource:0}: Error finding container 9a0a54e130d4a89d14cc305fe733c3ffc6c1c776c6de3eec0125cb45b8873292: Status 404 returned error can't find the container with id 9a0a54e130d4a89d14cc305fe733c3ffc6c1c776c6de3eec0125cb45b8873292 Jun 12 19:15:02.969982 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.969861 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.969982 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.969971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:02.970177 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:02.970024 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:02.970177 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.970048 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:03.970027647 +0000 UTC m=+216.627066766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : configmap references non-existent config key: service-ca.crt Jun 12 19:15:02.970177 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.970113 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 19:15:02.970177 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.970167 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:03.970154754 +0000 UTC m=+216.627193871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : secret "router-metrics-certs-default" not found Jun 12 19:15:02.970177 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.970118 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:02.970344 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:02.970208 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls podName:267d10fa-9a18-411e-a497-18a537cbb40d nodeName:}" failed. No retries permitted until 2026-06-12 19:15:03.97019783 +0000 UTC m=+216.627236954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-gjkvs" (UID: "267d10fa-9a18-411e-a497-18a537cbb40d") : secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:03.071408 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.071375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:03.071613 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:03.071525 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 19:15:03.071613 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:03.071607 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls podName:96903af3-354b-459d-88ff-6701e41d9544 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:04.071585603 +0000 UTC m=+216.728624722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls") pod "cluster-samples-operator-9547488fd-cpj4h" (UID: "96903af3-354b-459d-88ff-6701e41d9544") : secret "samples-operator-tls" not found Jun 12 19:15:03.468133 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.468090 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh" event={"ID":"b37e11a4-3f0f-42e8-b77e-35aca5b6d1a0","Type":"ContainerStarted","Data":"7511385aa2b39ef83782def5b7e4188cc66041b243d7c460d6980c7e59e713dd"} Jun 12 19:15:03.468579 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.468158 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh" event={"ID":"b37e11a4-3f0f-42e8-b77e-35aca5b6d1a0","Type":"ContainerStarted","Data":"93d3e3bf8b3dcfdae52656ee51c457c0303c01dbb54bee92831255841f7df812"} Jun 12 19:15:03.471447 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.471387 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x" event={"ID":"6a19eacb-0d57-4fb8-af5f-ef0c1aa711ad","Type":"ContainerStarted","Data":"9a0a54e130d4a89d14cc305fe733c3ffc6c1c776c6de3eec0125cb45b8873292"} Jun 12 19:15:03.475603 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.475466 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" event={"ID":"9091e6de-482a-4b96-be50-dd440317d294","Type":"ContainerStarted","Data":"b4af481fb7ee9334d510c912f22fb8883cd1fcb1efeacd709d379c92a22c5ec5"} Jun 12 19:15:03.480632 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.480600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" event={"ID":"ec5c7b00-e5f7-4b65-a49d-a4c845903520","Type":"ContainerStarted","Data":"4b0e193a79e581189b09756610f2951d58cacd52310fa11caed26de0d9921458"} Jun 12 19:15:03.483685 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.483653 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" event={"ID":"1e309f40-74d1-44ff-be6a-98ed82002869","Type":"ContainerStarted","Data":"d36a783fdc1724a24b92b1b765cbd4598f0a7f66e7bafc90f9e7b73b0ce4d7a3"} Jun 12 19:15:03.487820 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.487677 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-c7lsh" podStartSLOduration=1.487657794 podStartE2EDuration="1.487657794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:03.485523115 +0000 UTC m=+216.142562255" watchObservedRunningTime="2026-06-12 19:15:03.487657794 +0000 UTC m=+216.144696934" Jun 12 19:15:03.979524 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.979478 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:03.979717 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.979562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:03.979717 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:03.979612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:03.979717 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:03.979691 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:05.979667644 +0000 UTC m=+218.636706762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : configmap references non-existent config key: service-ca.crt Jun 12 19:15:03.979912 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:03.979731 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:03.979912 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:03.979733 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 19:15:03.979912 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:03.979785 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls podName:267d10fa-9a18-411e-a497-18a537cbb40d nodeName:}" failed. No retries permitted until 2026-06-12 19:15:05.979770151 +0000 UTC m=+218.636809272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-gjkvs" (UID: "267d10fa-9a18-411e-a497-18a537cbb40d") : secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:03.979912 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:03.979802 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:05.979793668 +0000 UTC m=+218.636832797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : secret "router-metrics-certs-default" not found Jun 12 19:15:04.080929 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:04.080871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:04.081696 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:04.081148 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 19:15:04.081696 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:04.081219 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls podName:96903af3-354b-459d-88ff-6701e41d9544 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:06.081200709 +0000 UTC m=+218.738239833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls") pod "cluster-samples-operator-9547488fd-cpj4h" (UID: "96903af3-354b-459d-88ff-6701e41d9544") : secret "samples-operator-tls" not found Jun 12 19:15:04.488851 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:04.488800 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x" event={"ID":"6a19eacb-0d57-4fb8-af5f-ef0c1aa711ad","Type":"ContainerStarted","Data":"21efd23d1cb8b9aa161f24ebe41b8cba3da90dc73b2d60fbd049de21c6fe0529"} Jun 12 19:15:04.506341 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:04.506283 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-bjj9x" podStartSLOduration=1.05468402 podStartE2EDuration="2.506263885s" totalImagesPullingTime="1.451579865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:04.505903571 +0000 UTC m=+217.162942711" watchObservedRunningTime="2026-06-12 19:15:04.506263885 +0000 UTC m=+217.163303023" Jun 12 19:15:05.997688 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:05.997648 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:05.998075 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:05.997712 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:05.998075 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:05.997796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:05.998075 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:05.997799 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 19:15:05.998075 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:05.997864 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:05.998075 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:05.997878 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:09.997860056 +0000 UTC m=+222.654899188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : secret "router-metrics-certs-default" not found Jun 12 19:15:05.998075 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:05.997947 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:09.997933234 +0000 UTC m=+222.654972352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : configmap references non-existent config key: service-ca.crt Jun 12 19:15:05.998075 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:05.997969 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls podName:267d10fa-9a18-411e-a497-18a537cbb40d nodeName:}" failed. No retries permitted until 2026-06-12 19:15:09.997961896 +0000 UTC m=+222.655001013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-gjkvs" (UID: "267d10fa-9a18-411e-a497-18a537cbb40d") : secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:06.098205 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:06.098179 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:06.098331 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:06.098282 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 19:15:06.098373 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:06.098333 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls podName:96903af3-354b-459d-88ff-6701e41d9544 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:10.098320267 +0000 UTC m=+222.755359383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls") pod "cluster-samples-operator-9547488fd-cpj4h" (UID: "96903af3-354b-459d-88ff-6701e41d9544") : secret "samples-operator-tls" not found Jun 12 19:15:06.497165 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:06.497122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" event={"ID":"ec5c7b00-e5f7-4b65-a49d-a4c845903520","Type":"ContainerStarted","Data":"a4ce868fd50d971229d8bac51191e68113157794cd0f2904021240a17e08d4b7"} Jun 12 19:15:06.499159 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:06.499130 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/0.log" Jun 12 19:15:06.499310 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:06.499176 2560 generic.go:356] "Generic (PLEG): container finished" podID="1e309f40-74d1-44ff-be6a-98ed82002869" containerID="242fdb2db8fee2e2c94c2a1df2e2f952eaa1189b2813478e84dbec5f17e462e9" exitCode=255 Jun 12 19:15:06.499310 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:06.499208 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" event={"ID":"1e309f40-74d1-44ff-be6a-98ed82002869","Type":"ContainerDied","Data":"242fdb2db8fee2e2c94c2a1df2e2f952eaa1189b2813478e84dbec5f17e462e9"} Jun 12 19:15:06.499502 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:06.499485 2560 scope.go:117] "RemoveContainer" containerID="242fdb2db8fee2e2c94c2a1df2e2f952eaa1189b2813478e84dbec5f17e462e9" Jun 12 19:15:06.514836 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:06.514736 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" podStartSLOduration=1.28054432 podStartE2EDuration="4.514713352s" totalImagesPullingTime="3.234169032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:06.513858199 +0000 UTC m=+219.170897358" watchObservedRunningTime="2026-06-12 19:15:06.514713352 +0000 UTC m=+219.171752475" Jun 12 19:15:07.416957 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.416693 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p278h"] Jun 12 19:15:07.420515 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.420491 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.423449 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.423422 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 19:15:07.423627 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.423545 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tfqjf\"" Jun 12 19:15:07.424517 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.424495 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 19:15:07.433335 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.433307 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p278h"] Jun 12 19:15:07.505017 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.504978 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" event={"ID":"9091e6de-482a-4b96-be50-dd440317d294","Type":"ContainerStarted","Data":"a364a9547e9af0441bbfaf6a4b6738dad770cbaefddf184975f9c90b8d44749e"} Jun 12 19:15:07.506756 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.506730 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:15:07.507278 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.507258 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/0.log" Jun 12 19:15:07.507374 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.507308 2560 generic.go:356] "Generic (PLEG): container finished" podID="1e309f40-74d1-44ff-be6a-98ed82002869" containerID="020a22e9a0ec192fefb83b7f80cd7c404415d72bde9098394ac83e085af96709" exitCode=255 Jun 12 19:15:07.507428 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.507389 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" event={"ID":"1e309f40-74d1-44ff-be6a-98ed82002869","Type":"ContainerDied","Data":"020a22e9a0ec192fefb83b7f80cd7c404415d72bde9098394ac83e085af96709"} Jun 12 19:15:07.507495 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.507432 2560 scope.go:117] "RemoveContainer" containerID="242fdb2db8fee2e2c94c2a1df2e2f952eaa1189b2813478e84dbec5f17e462e9" Jun 12 19:15:07.507655 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.507633 2560 scope.go:117] "RemoveContainer" containerID="020a22e9a0ec192fefb83b7f80cd7c404415d72bde9098394ac83e085af96709" Jun 12 19:15:07.507844 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:07.507825 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-mtf6v_openshift-console-operator(1e309f40-74d1-44ff-be6a-98ed82002869)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" podUID="1e309f40-74d1-44ff-be6a-98ed82002869" Jun 12 19:15:07.511130 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.511105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-968hz\" (UniqueName: \"kubernetes.io/projected/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-api-access-968hz\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.511243 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.511146 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8d97f52e-3b42-44aa-af05-22ee54386bb8-crio-socket\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.511243 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.511229 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.511350 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.511296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d97f52e-3b42-44aa-af05-22ee54386bb8-data-volume\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.511350 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.511343 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.526682 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.526614 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" podStartSLOduration=1.493149495 podStartE2EDuration="5.526592295s" totalImagesPullingTime="4.0334428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:07.526261595 +0000 UTC m=+220.183300740" watchObservedRunningTime="2026-06-12 19:15:07.526592295 +0000 UTC m=+220.183631435" Jun 12 19:15:07.612794 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.612749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.612989 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.612912 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-968hz\" (UniqueName: \"kubernetes.io/projected/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-api-access-968hz\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.613056 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.612989 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8d97f52e-3b42-44aa-af05-22ee54386bb8-crio-socket\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.613056 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:07.613000 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:07.613174 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:07.613076 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:08.113054979 +0000 UTC m=+220.770094101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : configmap "kube-rbac-proxy" not found Jun 12 19:15:07.613174 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.613113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.613292 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.613246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d97f52e-3b42-44aa-af05-22ee54386bb8-data-volume\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.613604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.613563 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8d97f52e-3b42-44aa-af05-22ee54386bb8-crio-socket\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.613731 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:07.613605 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:07.613731 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.613645 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d97f52e-3b42-44aa-af05-22ee54386bb8-data-volume\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:07.613731 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:07.613679 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:08.113660251 +0000 UTC m=+220.770699373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:07.623062 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:07.623033 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-968hz\" (UniqueName: \"kubernetes.io/projected/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-api-access-968hz\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:08.116227 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.116185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:08.116530 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:08.116341 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:08.116530 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.116355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:08.116530 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:08.116426 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:09.116400468 +0000 UTC m=+221.773439601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : configmap "kube-rbac-proxy" not found Jun 12 19:15:08.116530 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:08.116480 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:08.116530 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:08.116530 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:09.116518676 +0000 UTC m=+221.773557793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:08.512066 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.511983 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:15:08.512458 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.512338 2560 scope.go:117] "RemoveContainer" containerID="020a22e9a0ec192fefb83b7f80cd7c404415d72bde9098394ac83e085af96709" Jun 12 19:15:08.512498 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:08.512484 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-mtf6v_openshift-console-operator(1e309f40-74d1-44ff-be6a-98ed82002869)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" podUID="1e309f40-74d1-44ff-be6a-98ed82002869" Jun 12 19:15:08.821188 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.821098 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-8fb7g"] Jun 12 19:15:08.824333 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.824313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:08.827225 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.827200 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 12 19:15:08.827353 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.827200 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 12 19:15:08.827353 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.827246 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 12 19:15:08.831764 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.828465 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 12 19:15:08.831764 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.828749 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-b7kzn\"" Jun 12 19:15:08.837879 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.837853 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-8fb7g"] Jun 12 19:15:08.925061 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.925019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5b04d2b9-8b1c-48ad-a1f7-90978bf4342d-signing-cabundle\") pod \"service-ca-7b994bc59-8fb7g\" (UID: \"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d\") " pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:08.925275 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.925085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5b04d2b9-8b1c-48ad-a1f7-90978bf4342d-signing-key\") pod \"service-ca-7b994bc59-8fb7g\" (UID: \"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d\") " pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:08.925275 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:08.925214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgwxh\" (UniqueName: \"kubernetes.io/projected/5b04d2b9-8b1c-48ad-a1f7-90978bf4342d-kube-api-access-qgwxh\") pod \"service-ca-7b994bc59-8fb7g\" (UID: \"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d\") " pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:09.025961 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.025901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5b04d2b9-8b1c-48ad-a1f7-90978bf4342d-signing-key\") pod \"service-ca-7b994bc59-8fb7g\" (UID: \"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d\") " pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:09.026141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.026010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgwxh\" (UniqueName: \"kubernetes.io/projected/5b04d2b9-8b1c-48ad-a1f7-90978bf4342d-kube-api-access-qgwxh\") pod \"service-ca-7b994bc59-8fb7g\" (UID: \"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d\") " pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:09.026141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.026135 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5b04d2b9-8b1c-48ad-a1f7-90978bf4342d-signing-cabundle\") pod \"service-ca-7b994bc59-8fb7g\" (UID: \"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d\") " pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:09.026754 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.026731 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5b04d2b9-8b1c-48ad-a1f7-90978bf4342d-signing-cabundle\") pod \"service-ca-7b994bc59-8fb7g\" (UID: \"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d\") " pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:09.028447 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.028428 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5b04d2b9-8b1c-48ad-a1f7-90978bf4342d-signing-key\") pod \"service-ca-7b994bc59-8fb7g\" (UID: \"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d\") " pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:09.035277 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.035253 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgwxh\" (UniqueName: \"kubernetes.io/projected/5b04d2b9-8b1c-48ad-a1f7-90978bf4342d-kube-api-access-qgwxh\") pod \"service-ca-7b994bc59-8fb7g\" (UID: \"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d\") " pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:09.127509 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.127464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:09.127705 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.127568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:09.127705 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:09.127641 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:09.127705 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:09.127681 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:09.127822 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:09.127716 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:11.127699277 +0000 UTC m=+223.784738393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:09.127822 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:09.127737 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:11.127723627 +0000 UTC m=+223.784762743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : configmap "kube-rbac-proxy" not found Jun 12 19:15:09.138146 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.138115 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" Jun 12 19:15:09.271726 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.271690 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-8fb7g"] Jun 12 19:15:09.275893 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:09.275861 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b04d2b9_8b1c_48ad_a1f7_90978bf4342d.slice/crio-1272ccc1d7b6d01bee05247aa15519f6f5e9bd0fff1194c5263f4eafe5c8f504 WatchSource:0}: Error finding container 1272ccc1d7b6d01bee05247aa15519f6f5e9bd0fff1194c5263f4eafe5c8f504: Status 404 returned error can't find the container with id 1272ccc1d7b6d01bee05247aa15519f6f5e9bd0fff1194c5263f4eafe5c8f504 Jun 12 19:15:09.413461 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.413384 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x68ms_f73e27a5-19e3-45f5-9fee-718113ba39f3/dns-node-resolver/0.log" Jun 12 19:15:09.518251 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:09.518215 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" event={"ID":"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d","Type":"ContainerStarted","Data":"1272ccc1d7b6d01bee05247aa15519f6f5e9bd0fff1194c5263f4eafe5c8f504"} Jun 12 19:15:10.036666 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:10.036625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:10.036873 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:10.036690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:10.036873 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:10.036781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:10.036873 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:10.036799 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 19:15:10.036873 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:10.036863 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:10.037117 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:10.036893 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:18.036856416 +0000 UTC m=+230.693895539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : secret "router-metrics-certs-default" not found Jun 12 19:15:10.037117 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:10.036940 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls podName:267d10fa-9a18-411e-a497-18a537cbb40d nodeName:}" failed. No retries permitted until 2026-06-12 19:15:18.036901637 +0000 UTC m=+230.693940760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-gjkvs" (UID: "267d10fa-9a18-411e-a497-18a537cbb40d") : secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:10.037117 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:10.036960 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:18.036950988 +0000 UTC m=+230.693990108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : configmap references non-existent config key: service-ca.crt Jun 12 19:15:10.138131 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:10.138095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:10.138335 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:10.138278 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 19:15:10.138410 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:10.138354 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls podName:96903af3-354b-459d-88ff-6701e41d9544 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:18.138330966 +0000 UTC m=+230.795370084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls") pod "cluster-samples-operator-9547488fd-cpj4h" (UID: "96903af3-354b-459d-88ff-6701e41d9544") : secret "samples-operator-tls" not found Jun 12 19:15:10.611540 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:10.611506 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mg6nm_77048b64-4fc6-4841-a6f5-602cee883b68/node-ca/0.log" Jun 12 19:15:11.147814 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:11.147771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:11.148045 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:11.147872 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:11.148045 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:11.147895 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:11.148045 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:11.147979 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:15.147963727 +0000 UTC m=+227.805002843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:11.148045 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:11.147993 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:11.148045 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:11.148046 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:15.148029598 +0000 UTC m=+227.805068778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : configmap "kube-rbac-proxy" not found Jun 12 19:15:11.411822 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:11.411788 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-snhpj_5b6880fd-053a-4c13-836b-d8e91febbe85/serve-healthcheck-canary/0.log" Jun 12 19:15:11.528729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:11.528686 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" event={"ID":"5b04d2b9-8b1c-48ad-a1f7-90978bf4342d","Type":"ContainerStarted","Data":"62c6945fdc038312dcab2b1217e7db9f062e391e8cd50a14b0e893eff75628c0"} Jun 12 19:15:11.545822 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:11.545760 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-8fb7g" podStartSLOduration=1.8304158830000001 podStartE2EDuration="3.545741985s" totalImagesPullingTime="1.715326102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:11.544448233 +0000 UTC m=+224.201487372" watchObservedRunningTime="2026-06-12 19:15:11.545741985 +0000 UTC m=+224.202781123" Jun 12 19:15:12.529223 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:12.529118 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:12.529769 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:12.529745 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:12.530201 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:12.530185 2560 scope.go:117] "RemoveContainer" containerID="020a22e9a0ec192fefb83b7f80cd7c404415d72bde9098394ac83e085af96709" Jun 12 19:15:12.530394 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:12.530371 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-mtf6v_openshift-console-operator(1e309f40-74d1-44ff-be6a-98ed82002869)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" podUID="1e309f40-74d1-44ff-be6a-98ed82002869" Jun 12 19:15:15.184841 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:15.184780 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:15.185323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:15.184903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:15.185323 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:15.184963 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:15.185323 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:15.185036 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:23.18501854 +0000 UTC m=+235.842057660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:15.185323 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:15.185033 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:15.185323 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:15.185098 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm podName:8d97f52e-3b42-44aa-af05-22ee54386bb8 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:23.185080178 +0000 UTC m=+235.842119295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p278h" (UID: "8d97f52e-3b42-44aa-af05-22ee54386bb8") : configmap "kube-rbac-proxy" not found Jun 12 19:15:18.113148 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:18.113109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:18.113624 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:18.113186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:18.113624 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:18.113265 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:18.113624 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:18.113362 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:18.113624 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:18.113404 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle podName:6eaed572-c30c-45ab-9671-c57af5246ff5 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:34.113386641 +0000 UTC m=+246.770425778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle") pod "router-default-6849884d84-7q7hb" (UID: "6eaed572-c30c-45ab-9671-c57af5246ff5") : configmap references non-existent config key: service-ca.crt Jun 12 19:15:18.113624 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:15:18.113435 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls podName:267d10fa-9a18-411e-a497-18a537cbb40d nodeName:}" failed. No retries permitted until 2026-06-12 19:15:34.113416396 +0000 UTC m=+246.770455535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-gjkvs" (UID: "267d10fa-9a18-411e-a497-18a537cbb40d") : secret "cluster-monitoring-operator-tls" not found Jun 12 19:15:18.116254 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:18.116226 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eaed572-c30c-45ab-9671-c57af5246ff5-metrics-certs\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:18.214030 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:18.213986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:18.216805 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:18.216770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96903af3-354b-459d-88ff-6701e41d9544-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-cpj4h\" (UID: \"96903af3-354b-459d-88ff-6701e41d9544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:18.241304 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:18.241262 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" Jun 12 19:15:18.390979 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:18.390879 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h"] Jun 12 19:15:18.552171 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:18.552132 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" event={"ID":"96903af3-354b-459d-88ff-6701e41d9544","Type":"ContainerStarted","Data":"f98ddcf7fc0ca97c316350da88e282af7e3acd7d848de475a53321bf93bfba87"} Jun 12 19:15:21.562816 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:21.562777 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" event={"ID":"96903af3-354b-459d-88ff-6701e41d9544","Type":"ContainerStarted","Data":"832c75719c99d08bd5cf59ff7e469677660beb2b5d0b9767447f828070c65079"} Jun 12 19:15:21.563246 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:21.562832 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" event={"ID":"96903af3-354b-459d-88ff-6701e41d9544","Type":"ContainerStarted","Data":"ed801d2a2c5e5f11a9be62225c43305fdf5603155634fc14b0339fa32d569d15"} Jun 12 19:15:21.590705 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:21.590644 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-cpj4h" podStartSLOduration=17.503719021 podStartE2EDuration="19.590626385s" totalImagesPullingTime="2.086907364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:21.589906141 +0000 UTC m=+234.246945280" watchObservedRunningTime="2026-06-12 19:15:21.590626385 +0000 UTC m=+234.247665524" Jun 12 19:15:22.782369 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:22.782335 2560 scope.go:117] "RemoveContainer" containerID="020a22e9a0ec192fefb83b7f80cd7c404415d72bde9098394ac83e085af96709" Jun 12 19:15:23.259100 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.259054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:23.259298 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.259148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:23.259787 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.259753 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d97f52e-3b42-44aa-af05-22ee54386bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:23.261613 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.261587 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d97f52e-3b42-44aa-af05-22ee54386bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p278h\" (UID: \"8d97f52e-3b42-44aa-af05-22ee54386bb8\") " pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:23.329579 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.329542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p278h" Jun 12 19:15:23.469877 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.469844 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p278h"] Jun 12 19:15:23.473225 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:23.473195 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d97f52e_3b42_44aa_af05_22ee54386bb8.slice/crio-6b8d8426916f10cbeee2a5af477948f8fa766884c06c1e37288adb4755d841a6 WatchSource:0}: Error finding container 6b8d8426916f10cbeee2a5af477948f8fa766884c06c1e37288adb4755d841a6: Status 404 returned error can't find the container with id 6b8d8426916f10cbeee2a5af477948f8fa766884c06c1e37288adb4755d841a6 Jun 12 19:15:23.571695 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.571612 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:15:23.571850 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.571704 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" event={"ID":"1e309f40-74d1-44ff-be6a-98ed82002869","Type":"ContainerStarted","Data":"c86ea0912574ebae331eabf59cf16f65f5180caa2cd81412898b09a92bc11c86"} Jun 12 19:15:23.572058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.572027 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:23.573051 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.573025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p278h" event={"ID":"8d97f52e-3b42-44aa-af05-22ee54386bb8","Type":"ContainerStarted","Data":"6b8d8426916f10cbeee2a5af477948f8fa766884c06c1e37288adb4755d841a6"} Jun 12 19:15:23.591695 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.591633 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" podStartSLOduration=18.237952329 podStartE2EDuration="21.59160774s" totalImagesPullingTime="3.353655411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:23.591187295 +0000 UTC m=+236.248226458" watchObservedRunningTime="2026-06-12 19:15:23.59160774 +0000 UTC m=+236.248646880" Jun 12 19:15:23.689958 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:23.689906 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-mtf6v" Jun 12 19:15:27.589535 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:27.589505 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p278h" event={"ID":"8d97f52e-3b42-44aa-af05-22ee54386bb8","Type":"ContainerStarted","Data":"79e743cbae493546c562dec2a143b20700136e63d9e9ae2b3d3c8038f0cb5bf5"} Jun 12 19:15:27.589949 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:27.589558 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p278h" event={"ID":"8d97f52e-3b42-44aa-af05-22ee54386bb8","Type":"ContainerStarted","Data":"800f467fe8467c3bf228f44a8c5795298e00cce7341fc61d48dbab8e51e15acf"} Jun 12 19:15:29.598732 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:29.598692 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p278h" event={"ID":"8d97f52e-3b42-44aa-af05-22ee54386bb8","Type":"ContainerStarted","Data":"cc348056542ddaef0b89a30856c2275bd6b575cba68303afbf72e8e8d7668eb5"} Jun 12 19:15:29.620778 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:29.620720 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p278h" podStartSLOduration=17.105581033 podStartE2EDuration="22.620703795s" totalImagesPullingTime="5.515122762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:15:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:29.620080223 +0000 UTC m=+242.277119374" watchObservedRunningTime="2026-06-12 19:15:29.620703795 +0000 UTC m=+242.277742956" Jun 12 19:15:33.153495 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.153461 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-csbvk"] Jun 12 19:15:33.156578 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.156560 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-csbvk" Jun 12 19:15:33.159440 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.159419 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cdkpg\"" Jun 12 19:15:33.159832 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.159816 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 19:15:33.159882 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.159826 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 19:15:33.180865 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.180831 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-csbvk"] Jun 12 19:15:33.256878 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.256845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsxd9\" (UniqueName: \"kubernetes.io/projected/0e40fbb1-be9e-496b-b1d2-a548a54a4c2c-kube-api-access-wsxd9\") pod \"downloads-694c955b9-csbvk\" (UID: \"0e40fbb1-be9e-496b-b1d2-a548a54a4c2c\") " pod="openshift-console/downloads-694c955b9-csbvk" Jun 12 19:15:33.357461 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.357434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsxd9\" (UniqueName: \"kubernetes.io/projected/0e40fbb1-be9e-496b-b1d2-a548a54a4c2c-kube-api-access-wsxd9\") pod \"downloads-694c955b9-csbvk\" (UID: \"0e40fbb1-be9e-496b-b1d2-a548a54a4c2c\") " pod="openshift-console/downloads-694c955b9-csbvk" Jun 12 19:15:33.369685 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.369657 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsxd9\" (UniqueName: \"kubernetes.io/projected/0e40fbb1-be9e-496b-b1d2-a548a54a4c2c-kube-api-access-wsxd9\") pod \"downloads-694c955b9-csbvk\" (UID: \"0e40fbb1-be9e-496b-b1d2-a548a54a4c2c\") " pod="openshift-console/downloads-694c955b9-csbvk" Jun 12 19:15:33.465529 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.465430 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-csbvk" Jun 12 19:15:33.614601 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:33.614579 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-csbvk"] Jun 12 19:15:33.616980 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:33.616950 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e40fbb1_be9e_496b_b1d2_a548a54a4c2c.slice/crio-9c56d24dbc0d74cd88fe56593b35f39ba0b1dfb8256ec724f4582b8362a674fc WatchSource:0}: Error finding container 9c56d24dbc0d74cd88fe56593b35f39ba0b1dfb8256ec724f4582b8362a674fc: Status 404 returned error can't find the container with id 9c56d24dbc0d74cd88fe56593b35f39ba0b1dfb8256ec724f4582b8362a674fc Jun 12 19:15:34.164008 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.163966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:34.164390 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.164034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:34.164604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.164583 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eaed572-c30c-45ab-9671-c57af5246ff5-service-ca-bundle\") pod \"router-default-6849884d84-7q7hb\" (UID: \"6eaed572-c30c-45ab-9671-c57af5246ff5\") " pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:34.166459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.166439 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/267d10fa-9a18-411e-a497-18a537cbb40d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-gjkvs\" (UID: \"267d10fa-9a18-411e-a497-18a537cbb40d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:34.343561 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.343527 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xtj4b\"" Jun 12 19:15:34.351599 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.351568 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" Jun 12 19:15:34.353857 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.353822 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9ppqs\"" Jun 12 19:15:34.359471 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.359438 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:34.531083 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.530764 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs"] Jun 12 19:15:34.533651 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:34.533619 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267d10fa_9a18_411e_a497_18a537cbb40d.slice/crio-ede55df5cf650bec732c90c54dd3d0b28098fc102eea726788458d267f78106f WatchSource:0}: Error finding container ede55df5cf650bec732c90c54dd3d0b28098fc102eea726788458d267f78106f: Status 404 returned error can't find the container with id ede55df5cf650bec732c90c54dd3d0b28098fc102eea726788458d267f78106f Jun 12 19:15:34.559627 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.559587 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6849884d84-7q7hb"] Jun 12 19:15:34.563239 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:34.563208 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eaed572_c30c_45ab_9671_c57af5246ff5.slice/crio-c31b1fbc912db0aa94e44b154cab538eda83d62bcad1b62f17ffd261d5928940 WatchSource:0}: Error finding container c31b1fbc912db0aa94e44b154cab538eda83d62bcad1b62f17ffd261d5928940: Status 404 returned error can't find the container with id c31b1fbc912db0aa94e44b154cab538eda83d62bcad1b62f17ffd261d5928940 Jun 12 19:15:34.618771 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.618737 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6849884d84-7q7hb" event={"ID":"6eaed572-c30c-45ab-9671-c57af5246ff5","Type":"ContainerStarted","Data":"c31b1fbc912db0aa94e44b154cab538eda83d62bcad1b62f17ffd261d5928940"} Jun 12 19:15:34.619738 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.619710 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" event={"ID":"267d10fa-9a18-411e-a497-18a537cbb40d","Type":"ContainerStarted","Data":"ede55df5cf650bec732c90c54dd3d0b28098fc102eea726788458d267f78106f"} Jun 12 19:15:34.620629 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:34.620607 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-csbvk" event={"ID":"0e40fbb1-be9e-496b-b1d2-a548a54a4c2c","Type":"ContainerStarted","Data":"9c56d24dbc0d74cd88fe56593b35f39ba0b1dfb8256ec724f4582b8362a674fc"} Jun 12 19:15:35.626869 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:35.626831 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6849884d84-7q7hb" event={"ID":"6eaed572-c30c-45ab-9671-c57af5246ff5","Type":"ContainerStarted","Data":"dc1b9f31fe86d0fda70ff451f3962529f9f4992cc10f55c738d2c4085060298b"} Jun 12 19:15:35.648239 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:35.648179 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6849884d84-7q7hb" podStartSLOduration=33.648152764 podStartE2EDuration="33.648152764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:35.647954253 +0000 UTC m=+248.304993393" watchObservedRunningTime="2026-06-12 19:15:35.648152764 +0000 UTC m=+248.305191898" Jun 12 19:15:36.360638 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:36.360601 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:36.364045 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:36.364020 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:36.632305 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:36.632257 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" event={"ID":"267d10fa-9a18-411e-a497-18a537cbb40d","Type":"ContainerStarted","Data":"36719f85d665835633cb7d285ffc831efc8cdb7c41dc9d995e53efb59b3a4df9"} Jun 12 19:15:36.632767 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:36.632522 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:36.633730 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:36.633707 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6849884d84-7q7hb" Jun 12 19:15:36.661598 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:36.661536 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-gjkvs" podStartSLOduration=32.705576756 podStartE2EDuration="34.661511167s" totalImagesPullingTime="1.955934411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:36.659774824 +0000 UTC m=+249.316813964" watchObservedRunningTime="2026-06-12 19:15:36.661511167 +0000 UTC m=+249.318550284" Jun 12 19:15:39.617599 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:39.617488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:15:39.620384 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:39.620289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f558a51-da97-4815-815b-f1d519167f3f-metrics-certs\") pod \"network-metrics-daemon-vqt4b\" (UID: \"3f558a51-da97-4815-815b-f1d519167f3f\") " pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:15:39.789626 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:39.789593 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6rt4s\"" Jun 12 19:15:39.793966 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:39.793940 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vqt4b" Jun 12 19:15:39.976124 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:39.976096 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vqt4b"] Jun 12 19:15:39.979227 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:39.979191 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f558a51_da97_4815_815b_f1d519167f3f.slice/crio-c63d4b94685f1fe12dc847c01e35ac5793182520b40ae29a9da00d29cb53f2fc WatchSource:0}: Error finding container c63d4b94685f1fe12dc847c01e35ac5793182520b40ae29a9da00d29cb53f2fc: Status 404 returned error can't find the container with id c63d4b94685f1fe12dc847c01e35ac5793182520b40ae29a9da00d29cb53f2fc Jun 12 19:15:40.648524 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:40.648483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vqt4b" event={"ID":"3f558a51-da97-4815-815b-f1d519167f3f","Type":"ContainerStarted","Data":"c63d4b94685f1fe12dc847c01e35ac5793182520b40ae29a9da00d29cb53f2fc"} Jun 12 19:15:42.657320 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:42.657283 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vqt4b" event={"ID":"3f558a51-da97-4815-815b-f1d519167f3f","Type":"ContainerStarted","Data":"5011ff415468613b8343cc332873e01863999b97ad7cc8684fb77db55f256f1b"} Jun 12 19:15:42.657793 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:42.657334 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vqt4b" event={"ID":"3f558a51-da97-4815-815b-f1d519167f3f","Type":"ContainerStarted","Data":"ead67478e99ad8eb0f5336b791eb1137190aa49dc1146cfd2d16173d6fb6ca10"} Jun 12 19:15:42.679586 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:42.679518 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vqt4b" podStartSLOduration=254.03981475 podStartE2EDuration="4m15.679498428s" totalImagesPullingTime="1.639683678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:42.677864357 +0000 UTC m=+255.334903502" watchObservedRunningTime="2026-06-12 19:15:42.679498428 +0000 UTC m=+255.336537567" Jun 12 19:15:44.529231 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.528112 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ff7wz"] Jun 12 19:15:44.530844 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.530819 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.535701 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.535083 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 19:15:44.535701 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.535469 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 19:15:44.536621 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.536431 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 19:15:44.536744 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.536710 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9lrff\"" Jun 12 19:15:44.538103 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.537008 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 19:15:44.662552 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.662518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.662748 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.662577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9d2\" (UniqueName: \"kubernetes.io/projected/fef58b6a-b923-42b8-974c-28d2dca4c07b-kube-api-access-xn9d2\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.662748 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.662605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fef58b6a-b923-42b8-974c-28d2dca4c07b-root\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.662748 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.662637 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-tls\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.662748 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.662662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.662748 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.662734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fef58b6a-b923-42b8-974c-28d2dca4c07b-sys\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.663031 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.662774 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef58b6a-b923-42b8-974c-28d2dca4c07b-metrics-client-ca\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.663031 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.662810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-wtmp\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.663031 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.662957 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-textfile\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764104 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764068 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9d2\" (UniqueName: \"kubernetes.io/projected/fef58b6a-b923-42b8-974c-28d2dca4c07b-kube-api-access-xn9d2\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764104 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fef58b6a-b923-42b8-974c-28d2dca4c07b-root\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764141 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-tls\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764163 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764199 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fef58b6a-b923-42b8-974c-28d2dca4c07b-sys\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764201 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fef58b6a-b923-42b8-974c-28d2dca4c07b-root\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef58b6a-b923-42b8-974c-28d2dca4c07b-metrics-client-ca\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-wtmp\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764279 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fef58b6a-b923-42b8-974c-28d2dca4c07b-sys\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764731 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-textfile\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764731 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764410 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764731 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764421 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-wtmp\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764881 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764737 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-textfile\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.764881 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764866 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef58b6a-b923-42b8-974c-28d2dca4c07b-metrics-client-ca\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.765007 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.764932 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.766689 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.766664 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-tls\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.767181 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.767162 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef58b6a-b923-42b8-974c-28d2dca4c07b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.772332 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.772305 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9d2\" (UniqueName: \"kubernetes.io/projected/fef58b6a-b923-42b8-974c-28d2dca4c07b-kube-api-access-xn9d2\") pod \"node-exporter-ff7wz\" (UID: \"fef58b6a-b923-42b8-974c-28d2dca4c07b\") " pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.844461 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:44.844383 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ff7wz" Jun 12 19:15:44.855648 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:44.855616 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef58b6a_b923_42b8_974c_28d2dca4c07b.slice/crio-c3e40fb110217424bfb8f2b04541a46a7a070164dde655743ffaeafc62ada408 WatchSource:0}: Error finding container c3e40fb110217424bfb8f2b04541a46a7a070164dde655743ffaeafc62ada408: Status 404 returned error can't find the container with id c3e40fb110217424bfb8f2b04541a46a7a070164dde655743ffaeafc62ada408 Jun 12 19:15:45.611689 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.611462 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:15:45.615786 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.615751 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.618455 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.618424 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 19:15:45.618455 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.618423 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 19:15:45.618658 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.618423 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 19:15:45.619089 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.619068 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 19:15:45.619398 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.619377 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 19:15:45.619479 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.619428 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 19:15:45.619479 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.619454 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 19:15:45.619577 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.619383 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 19:15:45.619740 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.619724 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 19:15:45.619859 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.619728 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6nl7n\"" Jun 12 19:15:45.633874 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.633796 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:15:45.674658 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.674617 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ff7wz" event={"ID":"fef58b6a-b923-42b8-974c-28d2dca4c07b","Type":"ContainerStarted","Data":"c3e40fb110217424bfb8f2b04541a46a7a070164dde655743ffaeafc62ada408"} Jun 12 19:15:45.773410 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773362 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773573 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773438 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773573 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-config-out\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773573 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773638 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773688 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-web-config\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773980 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l8qj\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-kube-api-access-9l8qj\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773980 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773791 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773980 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.773980 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773843 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.774167 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.773984 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875125 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875093 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875281 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875136 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875350 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-web-config\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875416 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875395 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875472 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l8qj\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-kube-api-access-9l8qj\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875472 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875568 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875568 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875508 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875568 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875714 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875595 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875714 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875714 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-config-out\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.875849 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.875737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.876848 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.876650 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.877620 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.877462 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.878481 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.878448 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.879330 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.879301 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.880510 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.880483 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.881659 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.881636 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.882038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.881990 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.882968 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.882624 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-web-config\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.883123 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.883028 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.883452 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.883431 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.884173 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.884152 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.885036 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.885012 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-config-out\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.887145 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.887100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l8qj\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-kube-api-access-9l8qj\") pod \"alertmanager-main-0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:45.933293 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:45.931882 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:15:46.111703 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:46.111667 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:15:46.114561 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:46.114523 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afd022f_aec4_4ea4_9882_676acfb436f0.slice/crio-d0e7a7487fd20191f127e4907e2a49b1b904f4fd6edb0362a5a0fe2532cc2265 WatchSource:0}: Error finding container d0e7a7487fd20191f127e4907e2a49b1b904f4fd6edb0362a5a0fe2532cc2265: Status 404 returned error can't find the container with id d0e7a7487fd20191f127e4907e2a49b1b904f4fd6edb0362a5a0fe2532cc2265 Jun 12 19:15:46.680945 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:46.680836 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerStarted","Data":"d0e7a7487fd20191f127e4907e2a49b1b904f4fd6edb0362a5a0fe2532cc2265"} Jun 12 19:15:46.683223 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:46.683191 2560 generic.go:356] "Generic (PLEG): container finished" podID="fef58b6a-b923-42b8-974c-28d2dca4c07b" containerID="5b795edc6f7da52df76baebeb06ed1328bdd376f7a306bcd95162f60aefebd62" exitCode=0 Jun 12 19:15:46.683353 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:46.683234 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ff7wz" event={"ID":"fef58b6a-b923-42b8-974c-28d2dca4c07b","Type":"ContainerDied","Data":"5b795edc6f7da52df76baebeb06ed1328bdd376f7a306bcd95162f60aefebd62"} Jun 12 19:15:47.690375 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:47.690340 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ff7wz" event={"ID":"fef58b6a-b923-42b8-974c-28d2dca4c07b","Type":"ContainerStarted","Data":"7bb6451b86bbb2e19b353388450677f5acf1b518b009804f8018957ecd91f0b5"} Jun 12 19:15:47.690848 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:47.690403 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ff7wz" event={"ID":"fef58b6a-b923-42b8-974c-28d2dca4c07b","Type":"ContainerStarted","Data":"01a2e9ba10f0fa751681c3c294cf90a285b9bea83dec417615c383c95455c627"} Jun 12 19:15:47.717619 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:47.717562 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ff7wz" podStartSLOduration=2.683051739 podStartE2EDuration="3.717535839s" totalImagesPullingTime="941.820621ms" totalInitContainerRuntime="92.663479ms" isStatefulPod=true podCreationTimestamp="2026-06-12 19:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:47.715542297 +0000 UTC m=+260.372581453" watchObservedRunningTime="2026-06-12 19:15:47.717535839 +0000 UTC m=+260.374574980" Jun 12 19:15:48.188578 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.188525 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f6cdbfb49-qfzxm"] Jun 12 19:15:48.190952 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.190903 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.199605 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.199568 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 19:15:48.200716 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.200509 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 19:15:48.200716 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.200522 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 19:15:48.200716 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.200528 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 19:15:48.200716 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.200587 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 19:15:48.200716 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.200604 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hjc2q\"" Jun 12 19:15:48.205450 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.205425 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 19:15:48.217597 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.217563 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6cdbfb49-qfzxm"] Jun 12 19:15:48.299213 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.299174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-service-ca\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.299396 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.299260 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-trusted-ca-bundle\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.299396 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.299327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-oauth-config\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.299396 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.299355 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-config\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.299541 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.299428 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-serving-cert\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.299541 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.299524 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-oauth-serving-cert\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.299620 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.299551 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lv5w\" (UniqueName: \"kubernetes.io/projected/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-kube-api-access-5lv5w\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.400250 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.400209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-oauth-serving-cert\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.400250 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.400255 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lv5w\" (UniqueName: \"kubernetes.io/projected/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-kube-api-access-5lv5w\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.400496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.400393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-service-ca\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.400496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.400458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-trusted-ca-bundle\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.400587 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.400549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-oauth-config\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.400587 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.400576 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-config\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.400691 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.400616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-serving-cert\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.401127 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.401088 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-oauth-serving-cert\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.401268 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.401139 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-service-ca\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.401575 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.401451 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-trusted-ca-bundle\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.401653 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.401619 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-config\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.403483 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.403459 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-serving-cert\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.403605 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.403586 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-oauth-config\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.411744 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.411707 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lv5w\" (UniqueName: \"kubernetes.io/projected/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-kube-api-access-5lv5w\") pod \"console-6f6cdbfb49-qfzxm\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.501821 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.501735 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:15:48.839232 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.839146 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b8fb556fb-6q55j"] Jun 12 19:15:48.844007 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.842775 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:48.845661 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.845632 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 12 19:15:48.846838 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.846813 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 12 19:15:48.846838 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.846831 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9n903vqp041je\"" Jun 12 19:15:48.847073 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.846863 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tlv8f\"" Jun 12 19:15:48.847171 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.847136 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 19:15:48.847281 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.847265 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 12 19:15:48.854414 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.854383 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b8fb556fb-6q55j"] Jun 12 19:15:48.906451 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.906412 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7367c7b5-03bb-481c-be78-d42db435a3b6-secret-metrics-server-tls\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:48.906631 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.906462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7367c7b5-03bb-481c-be78-d42db435a3b6-client-ca-bundle\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:48.906631 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.906582 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7367c7b5-03bb-481c-be78-d42db435a3b6-audit-log\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:48.906631 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.906623 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7367c7b5-03bb-481c-be78-d42db435a3b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:48.906755 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.906646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vncjs\" (UniqueName: \"kubernetes.io/projected/7367c7b5-03bb-481c-be78-d42db435a3b6-kube-api-access-vncjs\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:48.906755 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.906663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7367c7b5-03bb-481c-be78-d42db435a3b6-metrics-server-audit-profiles\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:48.906817 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:48.906757 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7367c7b5-03bb-481c-be78-d42db435a3b6-secret-metrics-server-client-certs\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.007363 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.007319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7367c7b5-03bb-481c-be78-d42db435a3b6-audit-log\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.007558 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.007384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7367c7b5-03bb-481c-be78-d42db435a3b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.007628 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.007590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vncjs\" (UniqueName: \"kubernetes.io/projected/7367c7b5-03bb-481c-be78-d42db435a3b6-kube-api-access-vncjs\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.007690 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.007638 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7367c7b5-03bb-481c-be78-d42db435a3b6-metrics-server-audit-profiles\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.007690 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.007681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7367c7b5-03bb-481c-be78-d42db435a3b6-secret-metrics-server-client-certs\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.007788 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.007725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7367c7b5-03bb-481c-be78-d42db435a3b6-secret-metrics-server-tls\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.007788 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.007762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7367c7b5-03bb-481c-be78-d42db435a3b6-client-ca-bundle\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.007879 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.007812 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7367c7b5-03bb-481c-be78-d42db435a3b6-audit-log\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.008166 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.008142 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7367c7b5-03bb-481c-be78-d42db435a3b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.008746 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.008703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7367c7b5-03bb-481c-be78-d42db435a3b6-metrics-server-audit-profiles\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.010758 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.010723 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7367c7b5-03bb-481c-be78-d42db435a3b6-secret-metrics-server-client-certs\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.011060 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.011012 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7367c7b5-03bb-481c-be78-d42db435a3b6-secret-metrics-server-tls\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.011222 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.011205 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7367c7b5-03bb-481c-be78-d42db435a3b6-client-ca-bundle\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.017396 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.017366 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vncjs\" (UniqueName: \"kubernetes.io/projected/7367c7b5-03bb-481c-be78-d42db435a3b6-kube-api-access-vncjs\") pod \"metrics-server-5b8fb556fb-6q55j\" (UID: \"7367c7b5-03bb-481c-be78-d42db435a3b6\") " pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.156677 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.156633 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:15:49.336704 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.336666 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-9cglf"] Jun 12 19:15:49.339179 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.339155 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:15:49.342049 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.341785 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 12 19:15:49.342049 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.341811 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8d48w\"" Jun 12 19:15:49.350737 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.350709 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-9cglf"] Jun 12 19:15:49.411333 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.411242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f25b67-066c-4b30-8dca-b634f6865fe2-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-9cglf\" (UID: \"19f25b67-066c-4b30-8dca-b634f6865fe2\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:15:49.411333 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.411300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqrlp\" (UniqueName: \"kubernetes.io/projected/19f25b67-066c-4b30-8dca-b634f6865fe2-kube-api-access-wqrlp\") pod \"monitoring-plugin-589576dfc7-9cglf\" (UID: \"19f25b67-066c-4b30-8dca-b634f6865fe2\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:15:49.512061 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.512028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f25b67-066c-4b30-8dca-b634f6865fe2-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-9cglf\" (UID: \"19f25b67-066c-4b30-8dca-b634f6865fe2\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:15:49.512061 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.512074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqrlp\" (UniqueName: \"kubernetes.io/projected/19f25b67-066c-4b30-8dca-b634f6865fe2-kube-api-access-wqrlp\") pod \"monitoring-plugin-589576dfc7-9cglf\" (UID: \"19f25b67-066c-4b30-8dca-b634f6865fe2\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:15:49.514904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.514876 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f25b67-066c-4b30-8dca-b634f6865fe2-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-9cglf\" (UID: \"19f25b67-066c-4b30-8dca-b634f6865fe2\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:15:49.521105 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.521042 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqrlp\" (UniqueName: \"kubernetes.io/projected/19f25b67-066c-4b30-8dca-b634f6865fe2-kube-api-access-wqrlp\") pod \"monitoring-plugin-589576dfc7-9cglf\" (UID: \"19f25b67-066c-4b30-8dca-b634f6865fe2\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:15:49.652331 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:49.652293 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:15:50.448954 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.448894 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56695bd6f8-c67sh"] Jun 12 19:15:50.451472 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.451446 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.469594 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.469555 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56695bd6f8-c67sh"] Jun 12 19:15:50.519828 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.519786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-trusted-ca-bundle\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.520037 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.519847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-service-ca\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.520037 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.519875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-oauth-serving-cert\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.520037 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.519959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-config\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.520037 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.520020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-oauth-config\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.520213 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.520072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5fp8\" (UniqueName: \"kubernetes.io/projected/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-kube-api-access-m5fp8\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.520213 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.520098 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-serving-cert\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.621405 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.621368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-trusted-ca-bundle\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.621405 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.621415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-service-ca\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.621669 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.621435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-oauth-serving-cert\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.621669 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.621482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-config\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.621669 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.621535 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-oauth-config\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.621669 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.621598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5fp8\" (UniqueName: \"kubernetes.io/projected/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-kube-api-access-m5fp8\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.621669 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.621626 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-serving-cert\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.622395 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.622357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-oauth-serving-cert\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.622507 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.622403 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-config\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.622507 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.622443 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-trusted-ca-bundle\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.622507 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.622469 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-service-ca\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.624862 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.624839 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-oauth-config\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.625028 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.624996 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-serving-cert\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.632246 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.632212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5fp8\" (UniqueName: \"kubernetes.io/projected/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-kube-api-access-m5fp8\") pod \"console-56695bd6f8-c67sh\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:50.762664 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:50.762575 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:15:54.526593 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.526559 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6cdbfb49-qfzxm"] Jun 12 19:15:54.555834 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:54.555798 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59681a0f_0aa5_4e10_b028_94fbbeb5fd69.slice/crio-3062efcc3ea524c41d4dae248eee0a409697a224d1fb09e7b57c674a576089e8 WatchSource:0}: Error finding container 3062efcc3ea524c41d4dae248eee0a409697a224d1fb09e7b57c674a576089e8: Status 404 returned error can't find the container with id 3062efcc3ea524c41d4dae248eee0a409697a224d1fb09e7b57c674a576089e8 Jun 12 19:15:54.574742 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.574717 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56695bd6f8-c67sh"] Jun 12 19:15:54.576537 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:54.576516 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ed739e_5a69_468b_b6fa_8d7b9b73b0b8.slice/crio-060c03c4ea20f9d5a836993fc982101f5c3c99b77db8beda1d5bce4d785c12a9 WatchSource:0}: Error finding container 060c03c4ea20f9d5a836993fc982101f5c3c99b77db8beda1d5bce4d785c12a9: Status 404 returned error can't find the container with id 060c03c4ea20f9d5a836993fc982101f5c3c99b77db8beda1d5bce4d785c12a9 Jun 12 19:15:54.724977 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.724885 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6cdbfb49-qfzxm" event={"ID":"59681a0f-0aa5-4e10-b028-94fbbeb5fd69","Type":"ContainerStarted","Data":"3062efcc3ea524c41d4dae248eee0a409697a224d1fb09e7b57c674a576089e8"} Jun 12 19:15:54.727222 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.726494 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-csbvk" event={"ID":"0e40fbb1-be9e-496b-b1d2-a548a54a4c2c","Type":"ContainerStarted","Data":"34cfad747d26a058bf2ee8fa9d9227ace2fab3da39f1ce88ef661f63520ec1ff"} Jun 12 19:15:54.727222 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.726801 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-csbvk" Jun 12 19:15:54.728392 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.727888 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56695bd6f8-c67sh" event={"ID":"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8","Type":"ContainerStarted","Data":"060c03c4ea20f9d5a836993fc982101f5c3c99b77db8beda1d5bce4d785c12a9"} Jun 12 19:15:54.729818 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.729776 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerID="cd928f62f4df37aa0fdef29beb5dd588d79272e65715ee1a4fbd4e84902c5406" exitCode=0 Jun 12 19:15:54.729818 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.729808 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerDied","Data":"cd928f62f4df37aa0fdef29beb5dd588d79272e65715ee1a4fbd4e84902c5406"} Jun 12 19:15:54.737403 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.737378 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-csbvk" Jun 12 19:15:54.745405 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.745323 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-csbvk" podStartSLOduration=0.97149409 podStartE2EDuration="21.745306213s" totalImagesPullingTime="20.773812123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:54.743856047 +0000 UTC m=+267.400895210" watchObservedRunningTime="2026-06-12 19:15:54.745306213 +0000 UTC m=+267.402345354" Jun 12 19:15:54.752545 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.752514 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-9cglf"] Jun 12 19:15:54.757466 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:54.757228 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b8fb556fb-6q55j"] Jun 12 19:15:54.757754 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:54.757721 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f25b67_066c_4b30_8dca_b634f6865fe2.slice/crio-f2ee3320ba26b474b63953fe731c00817f65d26141f68b31c2ffdb9193172ec0 WatchSource:0}: Error finding container f2ee3320ba26b474b63953fe731c00817f65d26141f68b31c2ffdb9193172ec0: Status 404 returned error can't find the container with id f2ee3320ba26b474b63953fe731c00817f65d26141f68b31c2ffdb9193172ec0 Jun 12 19:15:54.758319 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:15:54.758283 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7367c7b5_03bb_481c_be78_d42db435a3b6.slice/crio-ccb3066a26f30df2d20417807e04ed8f73285c8d5c243e02ac4185ed017d1782 WatchSource:0}: Error finding container ccb3066a26f30df2d20417807e04ed8f73285c8d5c243e02ac4185ed017d1782: Status 404 returned error can't find the container with id ccb3066a26f30df2d20417807e04ed8f73285c8d5c243e02ac4185ed017d1782 Jun 12 19:15:55.740410 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:55.740324 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" event={"ID":"19f25b67-066c-4b30-8dca-b634f6865fe2","Type":"ContainerStarted","Data":"f2ee3320ba26b474b63953fe731c00817f65d26141f68b31c2ffdb9193172ec0"} Jun 12 19:15:55.745892 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:15:55.745768 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" event={"ID":"7367c7b5-03bb-481c-be78-d42db435a3b6","Type":"ContainerStarted","Data":"ccb3066a26f30df2d20417807e04ed8f73285c8d5c243e02ac4185ed017d1782"} Jun 12 19:16:01.776234 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.776189 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6cdbfb49-qfzxm" event={"ID":"59681a0f-0aa5-4e10-b028-94fbbeb5fd69","Type":"ContainerStarted","Data":"400f733370d566ce292c12388a8c481aa58dfb23eb7b99f6dcba46b2a3294536"} Jun 12 19:16:01.777985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.777957 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" event={"ID":"19f25b67-066c-4b30-8dca-b634f6865fe2","Type":"ContainerStarted","Data":"83d3c95c878212447930a7ded6fe4a67be6eef02c6e58b40199609aced988d6c"} Jun 12 19:16:01.778124 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.778008 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:16:01.780609 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.780122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" event={"ID":"7367c7b5-03bb-481c-be78-d42db435a3b6","Type":"ContainerStarted","Data":"5df838fa90b1e03aa59fc3a68f66cc485e7d9802b899ccbe9bdac346e782ea9f"} Jun 12 19:16:01.788059 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.788030 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" Jun 12 19:16:01.788210 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.788080 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56695bd6f8-c67sh" event={"ID":"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8","Type":"ContainerStarted","Data":"b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90"} Jun 12 19:16:01.788210 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.788110 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerStarted","Data":"f19fbe21be069f1da4faa8811651ee904826a5eba8d8c64cc6351ea174b0f5e9"} Jun 12 19:16:01.788210 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.788154 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerStarted","Data":"aaa46252df99c3048bd3fb6ad332f7e2da4734a613d613d664d66edcb7d5f24f"} Jun 12 19:16:01.788210 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.788179 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerStarted","Data":"bfc2f9d101e934aa680ed582be7a000ded4f62a6f791cb9f3b3d0e6186f61941"} Jun 12 19:16:01.788210 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.788202 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerStarted","Data":"802ccba0d3ea394b9af9113a532ace09a14f6b31c33851f95a1e7b845e561b34"} Jun 12 19:16:01.788423 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.788231 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerStarted","Data":"eb6718a908b05fc2b9e7219309093f83d793aaa87a49a78728186492c2b6497f"} Jun 12 19:16:01.795542 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.795484 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f6cdbfb49-qfzxm" podStartSLOduration=7.34656669 podStartE2EDuration="13.795463041s" totalImagesPullingTime="6.448896351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:16:01.793848129 +0000 UTC m=+274.450887293" watchObservedRunningTime="2026-06-12 19:16:01.795463041 +0000 UTC m=+274.452502308" Jun 12 19:16:01.830642 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.830522 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" podStartSLOduration=7.585177656 podStartE2EDuration="13.830497974s" totalImagesPullingTime="6.245320318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:16:01.811793845 +0000 UTC m=+274.468832987" watchObservedRunningTime="2026-06-12 19:16:01.830497974 +0000 UTC m=+274.487537114" Jun 12 19:16:01.831251 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.831209 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9cglf" podStartSLOduration=6.586156467 podStartE2EDuration="12.831198905s" totalImagesPullingTime="6.245042438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:16:01.830422004 +0000 UTC m=+274.487461147" watchObservedRunningTime="2026-06-12 19:16:01.831198905 +0000 UTC m=+274.488238044" Jun 12 19:16:01.852426 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:01.851299 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56695bd6f8-c67sh" podStartSLOduration=5.410633589 podStartE2EDuration="11.851278279s" totalImagesPullingTime="6.44064469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:16:01.849249071 +0000 UTC m=+274.506288208" watchObservedRunningTime="2026-06-12 19:16:01.851278279 +0000 UTC m=+274.508317420" Jun 12 19:16:03.798248 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:03.798208 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerStarted","Data":"15e8b063ec3458eeeda324a9e919b549fe44544fd9b113d8238ce0fb3d6c6fd7"} Jun 12 19:16:03.831161 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:03.831093 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.958361885 podStartE2EDuration="18.831072682s" totalImagesPullingTime="15.849011327s" totalInitContainerRuntime="23.69947ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:16:03.829818812 +0000 UTC m=+276.486857983" watchObservedRunningTime="2026-06-12 19:16:03.831072682 +0000 UTC m=+276.488111823" Jun 12 19:16:08.502841 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:08.502789 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:16:08.503338 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:08.502867 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:16:08.504414 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:08.504385 2560 patch_prober.go:28] interesting pod/console-6f6cdbfb49-qfzxm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 12 19:16:08.504470 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:08.504443 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f6cdbfb49-qfzxm" podUID="59681a0f-0aa5-4e10-b028-94fbbeb5fd69" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 12 19:16:09.157209 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:09.157173 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:16:09.157420 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:09.157243 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:16:10.763198 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:10.763152 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:16:10.763198 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:10.763209 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:16:10.764860 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:10.764832 2560 patch_prober.go:28] interesting pod/console-56695bd6f8-c67sh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 12 19:16:10.765005 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:10.764884 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56695bd6f8-c67sh" podUID="e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 12 19:16:14.339799 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:16:14.339749 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" podUID="4e0240c2-73e4-41ec-9b03-e1509a8a5298" Jun 12 19:16:14.339799 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:16:14.339749 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nt6lr" podUID="a522ebac-d7a4-4f0d-a596-da66772e7def" Jun 12 19:16:14.841068 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:14.841036 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt6lr" Jun 12 19:16:14.841272 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:14.841040 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:16:18.302513 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.302467 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:16:18.302513 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.302524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:16:18.305139 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.305110 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a522ebac-d7a4-4f0d-a596-da66772e7def-metrics-tls\") pod \"dns-default-nt6lr\" (UID: \"a522ebac-d7a4-4f0d-a596-da66772e7def\") " pod="openshift-dns/dns-default-nt6lr" Jun 12 19:16:18.305255 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.305172 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"image-registry-7f5558cfc5-vkbgv\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:16:18.445901 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.445860 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vhjkg\"" Jun 12 19:16:18.446132 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.445952 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b26x6\"" Jun 12 19:16:18.452455 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.452430 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt6lr" Jun 12 19:16:18.452611 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.452510 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:16:18.503177 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.503149 2560 patch_prober.go:28] interesting pod/console-6f6cdbfb49-qfzxm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 12 19:16:18.503302 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.503197 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f6cdbfb49-qfzxm" podUID="59681a0f-0aa5-4e10-b028-94fbbeb5fd69" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 12 19:16:18.631165 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.631133 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nt6lr"] Jun 12 19:16:18.634160 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:16:18.634124 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda522ebac_d7a4_4f0d_a596_da66772e7def.slice/crio-2b034852184cd2f4611dfa420a2fc9906a3c7323497129e6d543c70a2dd5f6a2 WatchSource:0}: Error finding container 2b034852184cd2f4611dfa420a2fc9906a3c7323497129e6d543c70a2dd5f6a2: Status 404 returned error can't find the container with id 2b034852184cd2f4611dfa420a2fc9906a3c7323497129e6d543c70a2dd5f6a2 Jun 12 19:16:18.657156 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.657131 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5558cfc5-vkbgv"] Jun 12 19:16:18.659595 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:16:18.659561 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0240c2_73e4_41ec_9b03_e1509a8a5298.slice/crio-4a703fcf357330ee72c5bf1870b58e5188e64403563670552c812dbe7abea8d1 WatchSource:0}: Error finding container 4a703fcf357330ee72c5bf1870b58e5188e64403563670552c812dbe7abea8d1: Status 404 returned error can't find the container with id 4a703fcf357330ee72c5bf1870b58e5188e64403563670552c812dbe7abea8d1 Jun 12 19:16:18.858231 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.858137 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nt6lr" event={"ID":"a522ebac-d7a4-4f0d-a596-da66772e7def","Type":"ContainerStarted","Data":"2b034852184cd2f4611dfa420a2fc9906a3c7323497129e6d543c70a2dd5f6a2"} Jun 12 19:16:18.859775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.859746 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" event={"ID":"4e0240c2-73e4-41ec-9b03-e1509a8a5298","Type":"ContainerStarted","Data":"b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f"} Jun 12 19:16:18.859941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.859795 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" event={"ID":"4e0240c2-73e4-41ec-9b03-e1509a8a5298","Type":"ContainerStarted","Data":"4a703fcf357330ee72c5bf1870b58e5188e64403563670552c812dbe7abea8d1"} Jun 12 19:16:18.859941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.859858 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:16:18.880267 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:18.880217 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" podStartSLOduration=290.88019935 podStartE2EDuration="4m50.88019935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:16:18.879154322 +0000 UTC m=+291.536193460" watchObservedRunningTime="2026-06-12 19:16:18.88019935 +0000 UTC m=+291.537238489" Jun 12 19:16:20.764062 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:20.764012 2560 patch_prober.go:28] interesting pod/console-56695bd6f8-c67sh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 12 19:16:20.764591 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:20.764085 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56695bd6f8-c67sh" podUID="e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 12 19:16:21.874809 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:21.874771 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nt6lr" event={"ID":"a522ebac-d7a4-4f0d-a596-da66772e7def","Type":"ContainerStarted","Data":"19ae5a4a35b1512aee4bbaf963032ab8d48d1ef1e105aab3e0d6cac33ea4c686"} Jun 12 19:16:21.875318 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:21.874835 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nt6lr" event={"ID":"a522ebac-d7a4-4f0d-a596-da66772e7def","Type":"ContainerStarted","Data":"2d6d180a435264aae5bcb2ef052a71c09c413f1d0b23e84f40d2d9b89e5d4248"} Jun 12 19:16:21.875318 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:21.874863 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nt6lr" Jun 12 19:16:21.901083 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:21.896549 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nt6lr" podStartSLOduration=251.382716161 podStartE2EDuration="4m13.896526871s" totalImagesPullingTime="2.51381071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:16:21.894393725 +0000 UTC m=+294.551432902" watchObservedRunningTime="2026-06-12 19:16:21.896526871 +0000 UTC m=+294.553566010" Jun 12 19:16:26.900572 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:26.900541 2560 generic.go:356] "Generic (PLEG): container finished" podID="ec5c7b00-e5f7-4b65-a49d-a4c845903520" containerID="a4ce868fd50d971229d8bac51191e68113157794cd0f2904021240a17e08d4b7" exitCode=0 Jun 12 19:16:26.901026 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:26.900610 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" event={"ID":"ec5c7b00-e5f7-4b65-a49d-a4c845903520","Type":"ContainerDied","Data":"a4ce868fd50d971229d8bac51191e68113157794cd0f2904021240a17e08d4b7"} Jun 12 19:16:26.901026 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:26.900983 2560 scope.go:117] "RemoveContainer" containerID="a4ce868fd50d971229d8bac51191e68113157794cd0f2904021240a17e08d4b7" Jun 12 19:16:27.735366 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:27.735333 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:16:27.736307 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:27.736283 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:16:27.746366 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:27.746342 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 19:16:27.907176 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:27.907141 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-8xc2x" event={"ID":"ec5c7b00-e5f7-4b65-a49d-a4c845903520","Type":"ContainerStarted","Data":"e2e784ddaec69b0d823f7c11fd13763b4eaf30780204483fcdb6dd42522ecb20"} Jun 12 19:16:28.502844 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:28.502811 2560 patch_prober.go:28] interesting pod/console-6f6cdbfb49-qfzxm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 12 19:16:28.503040 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:28.502859 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f6cdbfb49-qfzxm" podUID="59681a0f-0aa5-4e10-b028-94fbbeb5fd69" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 12 19:16:29.162053 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:29.162026 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:16:29.165818 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:29.165792 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b8fb556fb-6q55j" Jun 12 19:16:29.780932 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:29.780889 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1afd022f-aec4-4ea4-9882-676acfb436f0/init-config-reloader/0.log" Jun 12 19:16:29.982653 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:29.982604 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1afd022f-aec4-4ea4-9882-676acfb436f0/alertmanager/0.log" Jun 12 19:16:30.187515 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:30.187488 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1afd022f-aec4-4ea4-9882-676acfb436f0/config-reloader/0.log" Jun 12 19:16:30.381142 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:30.381116 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1afd022f-aec4-4ea4-9882-676acfb436f0/kube-rbac-proxy-web/0.log" Jun 12 19:16:30.582443 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:30.582364 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1afd022f-aec4-4ea4-9882-676acfb436f0/kube-rbac-proxy/0.log" Jun 12 19:16:30.763828 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:30.763787 2560 patch_prober.go:28] interesting pod/console-56695bd6f8-c67sh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 12 19:16:30.764011 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:30.763856 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56695bd6f8-c67sh" podUID="e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 12 19:16:30.781058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:30.781027 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1afd022f-aec4-4ea4-9882-676acfb436f0/kube-rbac-proxy-metric/0.log" Jun 12 19:16:30.981537 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:30.981507 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1afd022f-aec4-4ea4-9882-676acfb436f0/prom-label-proxy/0.log" Jun 12 19:16:31.182621 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:31.182593 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-gjkvs_267d10fa-9a18-411e-a497-18a537cbb40d/cluster-monitoring-operator/0.log" Jun 12 19:16:31.881970 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:31.881934 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nt6lr" Jun 12 19:16:31.981169 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:31.981131 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b8fb556fb-6q55j_7367c7b5-03bb-481c-be78-d42db435a3b6/metrics-server/0.log" Jun 12 19:16:32.182886 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:32.182814 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-9cglf_19f25b67-066c-4b30-8dca-b634f6865fe2/monitoring-plugin/0.log" Jun 12 19:16:32.929808 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:32.929776 2560 generic.go:356] "Generic (PLEG): container finished" podID="9091e6de-482a-4b96-be50-dd440317d294" containerID="a364a9547e9af0441bbfaf6a4b6738dad770cbaefddf184975f9c90b8d44749e" exitCode=0 Jun 12 19:16:32.930207 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:32.929846 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" event={"ID":"9091e6de-482a-4b96-be50-dd440317d294","Type":"ContainerDied","Data":"a364a9547e9af0441bbfaf6a4b6738dad770cbaefddf184975f9c90b8d44749e"} Jun 12 19:16:32.930249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:32.930229 2560 scope.go:117] "RemoveContainer" containerID="a364a9547e9af0441bbfaf6a4b6738dad770cbaefddf184975f9c90b8d44749e" Jun 12 19:16:33.581672 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:33.581643 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ff7wz_fef58b6a-b923-42b8-974c-28d2dca4c07b/init-textfile/0.log" Jun 12 19:16:33.782515 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:33.782483 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ff7wz_fef58b6a-b923-42b8-974c-28d2dca4c07b/node-exporter/0.log" Jun 12 19:16:33.940352 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:33.940315 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-n4f2k" event={"ID":"9091e6de-482a-4b96-be50-dd440317d294","Type":"ContainerStarted","Data":"a3bcb97792dfa98f314d73a002f9358507faefb01283af097e821e4f547512e5"} Jun 12 19:16:33.982107 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:33.982078 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ff7wz_fef58b6a-b923-42b8-974c-28d2dca4c07b/kube-rbac-proxy/0.log" Jun 12 19:16:38.182522 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:38.182491 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:16:38.383321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:38.383287 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/2.log" Jun 12 19:16:38.457433 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:38.457336 2560 patch_prober.go:28] interesting pod/image-registry-7f5558cfc5-vkbgv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 19:16:38.457433 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:38.457388 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" podUID="4e0240c2-73e4-41ec-9b03-e1509a8a5298" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 19:16:38.506027 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:38.505994 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:16:38.509881 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:38.509857 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:16:38.582154 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:38.582118 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56695bd6f8-c67sh_e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8/console/0.log" Jun 12 19:16:38.981759 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:38.981729 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f6cdbfb49-qfzxm_59681a0f-0aa5-4e10-b028-94fbbeb5fd69/console/0.log" Jun 12 19:16:39.184743 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:39.184704 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-csbvk_0e40fbb1-be9e-496b-b1d2-a548a54a4c2c/download-server/0.log" Jun 12 19:16:39.869739 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:39.869703 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:16:40.181991 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:40.181903 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt6lr_a522ebac-d7a4-4f0d-a596-da66772e7def/dns/0.log" Jun 12 19:16:40.381986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:40.381954 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt6lr_a522ebac-d7a4-4f0d-a596-da66772e7def/kube-rbac-proxy/0.log" Jun 12 19:16:40.767282 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:40.767247 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:16:40.771490 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:40.771459 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:16:40.781519 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:40.781496 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x68ms_f73e27a5-19e3-45f5-9fee-718113ba39f3/dns-node-resolver/0.log" Jun 12 19:16:40.842540 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:40.842501 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f6cdbfb49-qfzxm"] Jun 12 19:16:41.382762 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:41.382731 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f5558cfc5-vkbgv_4e0240c2-73e4-41ec-9b03-e1509a8a5298/registry/0.log" Jun 12 19:16:41.981413 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:41.981381 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mg6nm_77048b64-4fc6-4841-a6f5-602cee883b68/node-ca/0.log" Jun 12 19:16:42.182418 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:42.182387 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6849884d84-7q7hb_6eaed572-c30c-45ab-9671-c57af5246ff5/router/0.log" Jun 12 19:16:42.782249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:16:42.782219 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-snhpj_5b6880fd-053a-4c13-836b-d8e91febbe85/serve-healthcheck-canary/0.log" Jun 12 19:17:00.932600 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:00.932563 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f5558cfc5-vkbgv"] Jun 12 19:17:04.851887 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:04.851839 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:17:04.852410 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:04.852200 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="alertmanager" containerID="cri-o://eb6718a908b05fc2b9e7219309093f83d793aaa87a49a78728186492c2b6497f" gracePeriod=120 Jun 12 19:17:04.852410 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:04.852248 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy-web" containerID="cri-o://bfc2f9d101e934aa680ed582be7a000ded4f62a6f791cb9f3b3d0e6186f61941" gracePeriod=120 Jun 12 19:17:04.852410 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:04.852299 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy" containerID="cri-o://aaa46252df99c3048bd3fb6ad332f7e2da4734a613d613d664d66edcb7d5f24f" gracePeriod=120 Jun 12 19:17:04.852410 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:04.852298 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="prom-label-proxy" containerID="cri-o://15e8b063ec3458eeeda324a9e919b549fe44544fd9b113d8238ce0fb3d6c6fd7" gracePeriod=120 Jun 12 19:17:04.852410 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:04.852248 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy-metric" containerID="cri-o://f19fbe21be069f1da4faa8811651ee904826a5eba8d8c64cc6351ea174b0f5e9" gracePeriod=120 Jun 12 19:17:04.852410 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:04.852316 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="config-reloader" containerID="cri-o://802ccba0d3ea394b9af9113a532ace09a14f6b31c33851f95a1e7b845e561b34" gracePeriod=120 Jun 12 19:17:05.085858 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.085826 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerID="15e8b063ec3458eeeda324a9e919b549fe44544fd9b113d8238ce0fb3d6c6fd7" exitCode=0 Jun 12 19:17:05.085858 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.085851 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerID="f19fbe21be069f1da4faa8811651ee904826a5eba8d8c64cc6351ea174b0f5e9" exitCode=0 Jun 12 19:17:05.085858 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.085859 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerID="aaa46252df99c3048bd3fb6ad332f7e2da4734a613d613d664d66edcb7d5f24f" exitCode=0 Jun 12 19:17:05.085858 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.085866 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerID="802ccba0d3ea394b9af9113a532ace09a14f6b31c33851f95a1e7b845e561b34" exitCode=0 Jun 12 19:17:05.085858 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.085873 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerID="eb6718a908b05fc2b9e7219309093f83d793aaa87a49a78728186492c2b6497f" exitCode=0 Jun 12 19:17:05.086177 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.085894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerDied","Data":"15e8b063ec3458eeeda324a9e919b549fe44544fd9b113d8238ce0fb3d6c6fd7"} Jun 12 19:17:05.086177 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.085972 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerDied","Data":"f19fbe21be069f1da4faa8811651ee904826a5eba8d8c64cc6351ea174b0f5e9"} Jun 12 19:17:05.086177 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.085999 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerDied","Data":"aaa46252df99c3048bd3fb6ad332f7e2da4734a613d613d664d66edcb7d5f24f"} Jun 12 19:17:05.086177 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.086024 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerDied","Data":"802ccba0d3ea394b9af9113a532ace09a14f6b31c33851f95a1e7b845e561b34"} Jun 12 19:17:05.086177 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.086050 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerDied","Data":"eb6718a908b05fc2b9e7219309093f83d793aaa87a49a78728186492c2b6497f"} Jun 12 19:17:05.865074 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:05.865035 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f6cdbfb49-qfzxm" podUID="59681a0f-0aa5-4e10-b028-94fbbeb5fd69" containerName="console" containerID="cri-o://400f733370d566ce292c12388a8c481aa58dfb23eb7b99f6dcba46b2a3294536" gracePeriod=15 Jun 12 19:17:06.093496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.093463 2560 generic.go:356] "Generic (PLEG): container finished" podID="59681a0f-0aa5-4e10-b028-94fbbeb5fd69" containerID="400f733370d566ce292c12388a8c481aa58dfb23eb7b99f6dcba46b2a3294536" exitCode=0 Jun 12 19:17:06.093674 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.093586 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6cdbfb49-qfzxm" event={"ID":"59681a0f-0aa5-4e10-b028-94fbbeb5fd69","Type":"ContainerDied","Data":"400f733370d566ce292c12388a8c481aa58dfb23eb7b99f6dcba46b2a3294536"} Jun 12 19:17:06.098044 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.098008 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerID="bfc2f9d101e934aa680ed582be7a000ded4f62a6f791cb9f3b3d0e6186f61941" exitCode=0 Jun 12 19:17:06.098206 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.098068 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerDied","Data":"bfc2f9d101e934aa680ed582be7a000ded4f62a6f791cb9f3b3d0e6186f61941"} Jun 12 19:17:06.147113 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.147089 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:17:06.152057 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.152028 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:06.232379 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232337 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-cluster-tls-config\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.232543 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232396 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-trusted-ca-bundle\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.232543 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232423 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-config\") pod \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " Jun 12 19:17:06.232543 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232446 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-oauth-config\") pod \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " Jun 12 19:17:06.232543 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232471 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-oauth-serving-cert\") pod \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " Jun 12 19:17:06.232543 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232497 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-web-config\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.232543 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232532 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-config-volume\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.232773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232557 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-main-db\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.232773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232591 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lv5w\" (UniqueName: \"kubernetes.io/projected/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-kube-api-access-5lv5w\") pod \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " Jun 12 19:17:06.232773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232618 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.232773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232671 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.232773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232719 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-tls-assets\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.232773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232742 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-metrics-client-ca\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.232773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232774 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-serving-cert\") pod \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " Jun 12 19:17:06.233115 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232802 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l8qj\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-kube-api-access-9l8qj\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.233115 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232832 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-trusted-ca-bundle\") pod \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " Jun 12 19:17:06.233115 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232863 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-service-ca\") pod \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\" (UID: \"59681a0f-0aa5-4e10-b028-94fbbeb5fd69\") " Jun 12 19:17:06.233115 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232911 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-main-tls\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.233115 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232967 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-config-out\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.233115 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.232993 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy\") pod \"1afd022f-aec4-4ea4-9882-676acfb436f0\" (UID: \"1afd022f-aec4-4ea4-9882-676acfb436f0\") " Jun 12 19:17:06.233293 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.233105 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59681a0f-0aa5-4e10-b028-94fbbeb5fd69" (UID: "59681a0f-0aa5-4e10-b028-94fbbeb5fd69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:06.233345 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.233324 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-oauth-serving-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.234083 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.233815 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-config" (OuterVolumeSpecName: "console-config") pod "59681a0f-0aa5-4e10-b028-94fbbeb5fd69" (UID: "59681a0f-0aa5-4e10-b028-94fbbeb5fd69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:06.234408 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.234380 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:06.235382 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.235182 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-service-ca" (OuterVolumeSpecName: "service-ca") pod "59681a0f-0aa5-4e10-b028-94fbbeb5fd69" (UID: "59681a0f-0aa5-4e10-b028-94fbbeb5fd69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:06.235475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.235453 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:06.235965 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.235664 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "59681a0f-0aa5-4e10-b028-94fbbeb5fd69" (UID: "59681a0f-0aa5-4e10-b028-94fbbeb5fd69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:06.236255 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.236226 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:17:06.238655 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.238594 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:06.238814 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.238758 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:06.239354 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.239297 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59681a0f-0aa5-4e10-b028-94fbbeb5fd69" (UID: "59681a0f-0aa5-4e10-b028-94fbbeb5fd69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:06.239555 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.239521 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-kube-api-access-9l8qj" (OuterVolumeSpecName: "kube-api-access-9l8qj") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "kube-api-access-9l8qj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:17:06.239721 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.239693 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:17:06.239721 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.239703 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:06.240146 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.240016 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-config-out" (OuterVolumeSpecName: "config-out") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:17:06.240146 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.240096 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59681a0f-0aa5-4e10-b028-94fbbeb5fd69" (UID: "59681a0f-0aa5-4e10-b028-94fbbeb5fd69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:06.240281 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.240232 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:06.241011 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.240989 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-config-volume" (OuterVolumeSpecName: "config-volume") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:06.241365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.241337 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-kube-api-access-5lv5w" (OuterVolumeSpecName: "kube-api-access-5lv5w") pod "59681a0f-0aa5-4e10-b028-94fbbeb5fd69" (UID: "59681a0f-0aa5-4e10-b028-94fbbeb5fd69"). InnerVolumeSpecName "kube-api-access-5lv5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:17:06.243496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.243475 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:06.251322 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.251291 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-web-config" (OuterVolumeSpecName: "web-config") pod "1afd022f-aec4-4ea4-9882-676acfb436f0" (UID: "1afd022f-aec4-4ea4-9882-676acfb436f0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:06.333976 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.333895 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lv5w\" (UniqueName: \"kubernetes.io/projected/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-kube-api-access-5lv5w\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.333976 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.333970 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.333976 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.333982 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.333993 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-tls-assets\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334002 2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-metrics-client-ca\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334010 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-serving-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334018 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l8qj\" (UniqueName: \"kubernetes.io/projected/1afd022f-aec4-4ea4-9882-676acfb436f0-kube-api-access-9l8qj\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334028 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-trusted-ca-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334036 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-service-ca\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334045 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-main-tls\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334053 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-config-out\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334063 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334071 2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-cluster-tls-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334079 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334087 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334095 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59681a0f-0aa5-4e10-b028-94fbbeb5fd69-console-oauth-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334104 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-web-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334112 2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1afd022f-aec4-4ea4-9882-676acfb436f0-config-volume\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:06.334216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:06.334119 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1afd022f-aec4-4ea4-9882-676acfb436f0-alertmanager-main-db\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:07.105398 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.105366 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.105835 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.105359 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1afd022f-aec4-4ea4-9882-676acfb436f0","Type":"ContainerDied","Data":"d0e7a7487fd20191f127e4907e2a49b1b904f4fd6edb0362a5a0fe2532cc2265"} Jun 12 19:17:07.105835 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.105543 2560 scope.go:117] "RemoveContainer" containerID="15e8b063ec3458eeeda324a9e919b549fe44544fd9b113d8238ce0fb3d6c6fd7" Jun 12 19:17:07.106960 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.106887 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6cdbfb49-qfzxm" event={"ID":"59681a0f-0aa5-4e10-b028-94fbbeb5fd69","Type":"ContainerDied","Data":"3062efcc3ea524c41d4dae248eee0a409697a224d1fb09e7b57c674a576089e8"} Jun 12 19:17:07.106960 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.106907 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6cdbfb49-qfzxm" Jun 12 19:17:07.114957 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.114900 2560 scope.go:117] "RemoveContainer" containerID="f19fbe21be069f1da4faa8811651ee904826a5eba8d8c64cc6351ea174b0f5e9" Jun 12 19:17:07.122876 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.122857 2560 scope.go:117] "RemoveContainer" containerID="aaa46252df99c3048bd3fb6ad332f7e2da4734a613d613d664d66edcb7d5f24f" Jun 12 19:17:07.130772 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.130748 2560 scope.go:117] "RemoveContainer" containerID="bfc2f9d101e934aa680ed582be7a000ded4f62a6f791cb9f3b3d0e6186f61941" Jun 12 19:17:07.134815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.134764 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:17:07.138631 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.138603 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:17:07.139483 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.139443 2560 scope.go:117] "RemoveContainer" containerID="802ccba0d3ea394b9af9113a532ace09a14f6b31c33851f95a1e7b845e561b34" Jun 12 19:17:07.148027 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.148003 2560 scope.go:117] "RemoveContainer" containerID="eb6718a908b05fc2b9e7219309093f83d793aaa87a49a78728186492c2b6497f" Jun 12 19:17:07.149179 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.149157 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f6cdbfb49-qfzxm"] Jun 12 19:17:07.156438 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.156408 2560 scope.go:117] "RemoveContainer" containerID="cd928f62f4df37aa0fdef29beb5dd588d79272e65715ee1a4fbd4e84902c5406" Jun 12 19:17:07.158777 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.158753 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f6cdbfb49-qfzxm"] Jun 12 19:17:07.165119 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.165099 2560 scope.go:117] "RemoveContainer" containerID="400f733370d566ce292c12388a8c481aa58dfb23eb7b99f6dcba46b2a3294536" Jun 12 19:17:07.165934 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.165891 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:17:07.166305 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166263 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy-web" Jun 12 19:17:07.166305 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166281 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy-web" Jun 12 19:17:07.166305 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166295 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy" Jun 12 19:17:07.166305 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166303 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166316 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="init-config-reloader" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166324 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="init-config-reloader" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166334 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="config-reloader" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166342 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="config-reloader" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166353 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy-metric" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166361 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy-metric" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166393 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="alertmanager" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166402 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="alertmanager" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166413 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="prom-label-proxy" Jun 12 19:17:07.166425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166421 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="prom-label-proxy" Jun 12 19:17:07.166694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166432 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59681a0f-0aa5-4e10-b028-94fbbeb5fd69" containerName="console" Jun 12 19:17:07.166694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166441 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="59681a0f-0aa5-4e10-b028-94fbbeb5fd69" containerName="console" Jun 12 19:17:07.166694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166515 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="config-reloader" Jun 12 19:17:07.166694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166524 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy-web" Jun 12 19:17:07.166694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166532 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy-metric" Jun 12 19:17:07.166694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166538 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="prom-label-proxy" Jun 12 19:17:07.166694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166544 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="alertmanager" Jun 12 19:17:07.166694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166551 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="59681a0f-0aa5-4e10-b028-94fbbeb5fd69" containerName="console" Jun 12 19:17:07.166694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.166556 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" containerName="kube-rbac-proxy" Jun 12 19:17:07.170137 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.170115 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.173294 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.173228 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 19:17:07.173294 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.173276 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 19:17:07.173524 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.173324 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 19:17:07.173524 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.173359 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 19:17:07.173524 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.173366 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 19:17:07.173524 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.173368 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 19:17:07.173524 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.173324 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 19:17:07.173806 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.173536 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6nl7n\"" Jun 12 19:17:07.173806 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.173800 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 19:17:07.178870 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.178849 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 19:17:07.190848 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.190818 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:17:07.240454 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240406 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba5ab42-e9b8-41cc-8abc-a3821d90756f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240454 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240453 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240648 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xstz\" (UniqueName: \"kubernetes.io/projected/aba5ab42-e9b8-41cc-8abc-a3821d90756f-kube-api-access-9xstz\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240648 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aba5ab42-e9b8-41cc-8abc-a3821d90756f-config-out\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240648 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240563 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aba5ab42-e9b8-41cc-8abc-a3821d90756f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240648 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-web-config\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240648 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba5ab42-e9b8-41cc-8abc-a3821d90756f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240648 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240618 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240861 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240746 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-config-volume\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240861 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240861 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aba5ab42-e9b8-41cc-8abc-a3821d90756f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.240861 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.241023 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.240872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.341600 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aba5ab42-e9b8-41cc-8abc-a3821d90756f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.341600 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-web-config\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.341852 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba5ab42-e9b8-41cc-8abc-a3821d90756f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.341852 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.341852 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-config-volume\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.341852 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341794 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.341852 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341829 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aba5ab42-e9b8-41cc-8abc-a3821d90756f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.342130 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341869 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.342130 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.342130 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.341977 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba5ab42-e9b8-41cc-8abc-a3821d90756f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.342130 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.342007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.342130 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.342034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xstz\" (UniqueName: \"kubernetes.io/projected/aba5ab42-e9b8-41cc-8abc-a3821d90756f-kube-api-access-9xstz\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.342130 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.342085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aba5ab42-e9b8-41cc-8abc-a3821d90756f-config-out\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.342547 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.342452 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba5ab42-e9b8-41cc-8abc-a3821d90756f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.343539 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.343235 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba5ab42-e9b8-41cc-8abc-a3821d90756f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.343749 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.343725 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aba5ab42-e9b8-41cc-8abc-a3821d90756f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.345115 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.345086 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-config-volume\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.345381 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.345306 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aba5ab42-e9b8-41cc-8abc-a3821d90756f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.345558 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.345530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.345667 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.345612 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-web-config\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.345815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.345749 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aba5ab42-e9b8-41cc-8abc-a3821d90756f-config-out\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.346094 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.346064 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.346166 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.346131 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.346166 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.346151 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.346901 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.346878 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aba5ab42-e9b8-41cc-8abc-a3821d90756f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.353036 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.353013 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xstz\" (UniqueName: \"kubernetes.io/projected/aba5ab42-e9b8-41cc-8abc-a3821d90756f-kube-api-access-9xstz\") pod \"alertmanager-main-0\" (UID: \"aba5ab42-e9b8-41cc-8abc-a3821d90756f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.481084 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.480987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:17:07.623593 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.623559 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:17:07.627004 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:17:07.626975 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba5ab42_e9b8_41cc_8abc_a3821d90756f.slice/crio-d1f0bbec98e1296ffba94aa3b8a75fbaf9651c2bac5dfa43fd80f9906f6c8af8 WatchSource:0}: Error finding container d1f0bbec98e1296ffba94aa3b8a75fbaf9651c2bac5dfa43fd80f9906f6c8af8: Status 404 returned error can't find the container with id d1f0bbec98e1296ffba94aa3b8a75fbaf9651c2bac5dfa43fd80f9906f6c8af8 Jun 12 19:17:07.787474 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.787392 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1afd022f-aec4-4ea4-9882-676acfb436f0" path="/var/lib/kubelet/pods/1afd022f-aec4-4ea4-9882-676acfb436f0/volumes" Jun 12 19:17:07.788064 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:07.788050 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59681a0f-0aa5-4e10-b028-94fbbeb5fd69" path="/var/lib/kubelet/pods/59681a0f-0aa5-4e10-b028-94fbbeb5fd69/volumes" Jun 12 19:17:08.115978 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.115943 2560 generic.go:356] "Generic (PLEG): container finished" podID="aba5ab42-e9b8-41cc-8abc-a3821d90756f" containerID="2493f674584fb77120004df12c978aeb6ab48e834e128610b0de160789067969" exitCode=0 Jun 12 19:17:08.116397 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.116020 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba5ab42-e9b8-41cc-8abc-a3821d90756f","Type":"ContainerDied","Data":"2493f674584fb77120004df12c978aeb6ab48e834e128610b0de160789067969"} Jun 12 19:17:08.116397 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.116097 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba5ab42-e9b8-41cc-8abc-a3821d90756f","Type":"ContainerStarted","Data":"d1f0bbec98e1296ffba94aa3b8a75fbaf9651c2bac5dfa43fd80f9906f6c8af8"} Jun 12 19:17:08.884539 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.884505 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bd6f64cb-c9v69"] Jun 12 19:17:08.886912 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.886891 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:08.889743 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.889714 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 19:17:08.890103 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.889807 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 19:17:08.890103 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.889982 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-n9t9q\"" Jun 12 19:17:08.890103 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.890038 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 19:17:08.890777 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.890760 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 19:17:08.890978 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.890961 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 19:17:08.894935 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.894888 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 19:17:08.910365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.910336 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bd6f64cb-c9v69"] Jun 12 19:17:08.954005 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.953973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-secret-telemeter-client\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:08.954005 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.954007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58eee837-58e7-4069-8521-40a02dd23f8c-metrics-client-ca\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:08.954215 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.954028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:08.954215 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.954118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58eee837-58e7-4069-8521-40a02dd23f8c-serving-certs-ca-bundle\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:08.954215 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.954174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-federate-client-tls\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:08.954215 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.954204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-telemeter-client-tls\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:08.954341 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.954227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58eee837-58e7-4069-8521-40a02dd23f8c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:08.954341 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:08.954244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7mvq\" (UniqueName: \"kubernetes.io/projected/58eee837-58e7-4069-8521-40a02dd23f8c-kube-api-access-b7mvq\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.055470 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.055421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58eee837-58e7-4069-8521-40a02dd23f8c-serving-certs-ca-bundle\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.055639 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.055488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-federate-client-tls\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.055639 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.055525 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-telemeter-client-tls\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.055639 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.055555 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58eee837-58e7-4069-8521-40a02dd23f8c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.055639 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.055576 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7mvq\" (UniqueName: \"kubernetes.io/projected/58eee837-58e7-4069-8521-40a02dd23f8c-kube-api-access-b7mvq\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.059985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.055625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-secret-telemeter-client\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.059985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.056184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58eee837-58e7-4069-8521-40a02dd23f8c-metrics-client-ca\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.059985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.056237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.059985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.056876 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58eee837-58e7-4069-8521-40a02dd23f8c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.059985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.056892 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58eee837-58e7-4069-8521-40a02dd23f8c-serving-certs-ca-bundle\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.059985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.058012 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58eee837-58e7-4069-8521-40a02dd23f8c-metrics-client-ca\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.059985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.059007 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-secret-telemeter-client\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.059985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.059174 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-federate-client-tls\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.059985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.059650 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.064214 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.064185 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58eee837-58e7-4069-8521-40a02dd23f8c-telemeter-client-tls\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.066753 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.066728 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7mvq\" (UniqueName: \"kubernetes.io/projected/58eee837-58e7-4069-8521-40a02dd23f8c-kube-api-access-b7mvq\") pod \"telemeter-client-7bd6f64cb-c9v69\" (UID: \"58eee837-58e7-4069-8521-40a02dd23f8c\") " pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.124996 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.124953 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba5ab42-e9b8-41cc-8abc-a3821d90756f","Type":"ContainerStarted","Data":"c73281cb53f27b3574e507cfd476522c3775aa28549a6c5a098b514b16fd41f7"} Jun 12 19:17:09.125427 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.125075 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba5ab42-e9b8-41cc-8abc-a3821d90756f","Type":"ContainerStarted","Data":"d112ee2edf2c1d12179cd0e9663fb6f88f12e5381889bce67eda186a445d740f"} Jun 12 19:17:09.125427 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.125116 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba5ab42-e9b8-41cc-8abc-a3821d90756f","Type":"ContainerStarted","Data":"698986a01bcf0b4ddc04a25c9b5b6e590e7328d1539b2cf9fbf0c5ff899da72f"} Jun 12 19:17:09.125427 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.125159 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba5ab42-e9b8-41cc-8abc-a3821d90756f","Type":"ContainerStarted","Data":"54c39cbaca8a9935f3354710134e95181a5b896c5bd09e3bfbdd0f2534c44d85"} Jun 12 19:17:09.125427 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.125194 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba5ab42-e9b8-41cc-8abc-a3821d90756f","Type":"ContainerStarted","Data":"642f88c727d1f30a9e149248da9f2fadc96ff12a53bcdb4a795c14947cb1e2ea"} Jun 12 19:17:09.125427 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.125231 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba5ab42-e9b8-41cc-8abc-a3821d90756f","Type":"ContainerStarted","Data":"12095113a36caf9fba61b298528147ccefdfa0132567fd0d72972df7c80f0cb7"} Jun 12 19:17:09.155749 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.155622 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.139422978 podStartE2EDuration="2.155600479s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.177501ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:17:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:17:09.15389746 +0000 UTC m=+341.810936635" watchObservedRunningTime="2026-06-12 19:17:09.155600479 +0000 UTC m=+341.812639619" Jun 12 19:17:09.199780 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.199745 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" Jun 12 19:17:09.342614 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.342582 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bd6f64cb-c9v69"] Jun 12 19:17:09.345125 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:17:09.345095 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58eee837_58e7_4069_8521_40a02dd23f8c.slice/crio-8674beddd826d25e976a73c4662f9dde6f769927c7d1fcd9087e058e101be5fd WatchSource:0}: Error finding container 8674beddd826d25e976a73c4662f9dde6f769927c7d1fcd9087e058e101be5fd: Status 404 returned error can't find the container with id 8674beddd826d25e976a73c4662f9dde6f769927c7d1fcd9087e058e101be5fd Jun 12 19:17:09.347097 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:09.347079 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:17:10.131578 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:10.131538 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" event={"ID":"58eee837-58e7-4069-8521-40a02dd23f8c","Type":"ContainerStarted","Data":"8674beddd826d25e976a73c4662f9dde6f769927c7d1fcd9087e058e101be5fd"} Jun 12 19:17:12.142078 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:12.142048 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" event={"ID":"58eee837-58e7-4069-8521-40a02dd23f8c","Type":"ContainerStarted","Data":"8b3205bc520189ba44af24be882c2805e976185edffab795f5b9e4283a7fed91"} Jun 12 19:17:13.149240 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:13.149205 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" event={"ID":"58eee837-58e7-4069-8521-40a02dd23f8c","Type":"ContainerStarted","Data":"3c1bd4811c0b3694610aeaefbff8cfc295d2ae384b0bf805c352e14802119e7f"} Jun 12 19:17:13.149621 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:13.149264 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" event={"ID":"58eee837-58e7-4069-8521-40a02dd23f8c","Type":"ContainerStarted","Data":"97487ff4567ef03e1bc8060d6ef95adb8fa3be24a36df8c4633cf1a9a487861f"} Jun 12 19:17:13.178999 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:13.178946 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bd6f64cb-c9v69" podStartSLOduration=2.471425334 podStartE2EDuration="5.17891176s" totalImagesPullingTime="2.707486426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:17:13.178247096 +0000 UTC m=+345.835286269" watchObservedRunningTime="2026-06-12 19:17:13.17891176 +0000 UTC m=+345.835950899" Jun 12 19:17:13.882668 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:13.882632 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5645c87bd-p5wdv"] Jun 12 19:17:13.885152 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:13.885124 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:13.896904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:13.896874 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5645c87bd-p5wdv"] Jun 12 19:17:14.004697 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.004651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-serving-cert\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.004697 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.004689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-oauth-serving-cert\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.004949 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.004781 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnw8l\" (UniqueName: \"kubernetes.io/projected/dbdec2ab-3584-4121-973e-af5f26f0577c-kube-api-access-lnw8l\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.004949 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.004818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-console-config\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.004949 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.004851 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-service-ca\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.004949 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.004871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-trusted-ca-bundle\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.004949 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.004912 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-oauth-config\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.105773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.105728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnw8l\" (UniqueName: \"kubernetes.io/projected/dbdec2ab-3584-4121-973e-af5f26f0577c-kube-api-access-lnw8l\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.105773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.105771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-console-config\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.106025 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.105798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-service-ca\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.106025 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.105830 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-trusted-ca-bundle\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.106091 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.106040 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-oauth-config\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.106153 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.106136 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-serving-cert\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.106187 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.106168 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-oauth-serving-cert\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.106615 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.106575 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-service-ca\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.106908 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.106695 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-console-config\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.106908 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.106754 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-trusted-ca-bundle\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.106908 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.106808 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-oauth-serving-cert\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.108697 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.108666 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-oauth-config\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.108782 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.108697 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-serving-cert\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.114160 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.114137 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnw8l\" (UniqueName: \"kubernetes.io/projected/dbdec2ab-3584-4121-973e-af5f26f0577c-kube-api-access-lnw8l\") pod \"console-5645c87bd-p5wdv\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.196594 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.196491 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:14.335871 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:14.335845 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5645c87bd-p5wdv"] Jun 12 19:17:14.338376 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:17:14.338348 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbdec2ab_3584_4121_973e_af5f26f0577c.slice/crio-16a1283a6e298ab0368702abeb0a4a71c8461f8d98b4d6f96782906d4871e964 WatchSource:0}: Error finding container 16a1283a6e298ab0368702abeb0a4a71c8461f8d98b4d6f96782906d4871e964: Status 404 returned error can't find the container with id 16a1283a6e298ab0368702abeb0a4a71c8461f8d98b4d6f96782906d4871e964 Jun 12 19:17:15.162836 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:15.162797 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645c87bd-p5wdv" event={"ID":"dbdec2ab-3584-4121-973e-af5f26f0577c","Type":"ContainerStarted","Data":"4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f"} Jun 12 19:17:15.163052 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:15.162846 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645c87bd-p5wdv" event={"ID":"dbdec2ab-3584-4121-973e-af5f26f0577c","Type":"ContainerStarted","Data":"16a1283a6e298ab0368702abeb0a4a71c8461f8d98b4d6f96782906d4871e964"} Jun 12 19:17:15.183600 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:15.183545 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5645c87bd-p5wdv" podStartSLOduration=2.183529853 podStartE2EDuration="2.183529853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:17:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:17:15.180955725 +0000 UTC m=+347.837994863" watchObservedRunningTime="2026-06-12 19:17:15.183529853 +0000 UTC m=+347.840568992" Jun 12 19:17:24.197276 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:24.197230 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:24.197276 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:24.197292 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:24.202593 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:24.202565 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:24.206389 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:24.206368 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:17:24.267059 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:24.267015 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56695bd6f8-c67sh"] Jun 12 19:17:25.953782 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:25.953735 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" podUID="4e0240c2-73e4-41ec-9b03-e1509a8a5298" containerName="registry" containerID="cri-o://b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f" gracePeriod=30 Jun 12 19:17:26.207521 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.207445 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:17:26.209257 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.209234 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-bound-sa-token\") pod \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " Jun 12 19:17:26.209383 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.209262 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-trusted-ca\") pod \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " Jun 12 19:17:26.209383 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.209297 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e0240c2-73e4-41ec-9b03-e1509a8a5298-ca-trust-extracted\") pod \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " Jun 12 19:17:26.209383 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.209329 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-image-registry-private-configuration\") pod \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " Jun 12 19:17:26.209383 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.209361 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") pod \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " Jun 12 19:17:26.209610 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.209406 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnfrd\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-kube-api-access-qnfrd\") pod \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " Jun 12 19:17:26.209610 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.209464 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-certificates\") pod \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " Jun 12 19:17:26.209610 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.209500 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-installation-pull-secrets\") pod \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\" (UID: \"4e0240c2-73e4-41ec-9b03-e1509a8a5298\") " Jun 12 19:17:26.209746 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.209722 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4e0240c2-73e4-41ec-9b03-e1509a8a5298" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:26.210188 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.210152 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4e0240c2-73e4-41ec-9b03-e1509a8a5298" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:26.212610 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.212580 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-kube-api-access-qnfrd" (OuterVolumeSpecName: "kube-api-access-qnfrd") pod "4e0240c2-73e4-41ec-9b03-e1509a8a5298" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298"). InnerVolumeSpecName "kube-api-access-qnfrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:17:26.212839 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.212812 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4e0240c2-73e4-41ec-9b03-e1509a8a5298" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:17:26.212959 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.212822 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4e0240c2-73e4-41ec-9b03-e1509a8a5298" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:17:26.213307 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.213270 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4e0240c2-73e4-41ec-9b03-e1509a8a5298" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:26.213587 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.213547 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4e0240c2-73e4-41ec-9b03-e1509a8a5298" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:26.214320 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.214294 2560 generic.go:356] "Generic (PLEG): container finished" podID="4e0240c2-73e4-41ec-9b03-e1509a8a5298" containerID="b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f" exitCode=0 Jun 12 19:17:26.214414 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.214350 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" Jun 12 19:17:26.214414 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.214380 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" event={"ID":"4e0240c2-73e4-41ec-9b03-e1509a8a5298","Type":"ContainerDied","Data":"b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f"} Jun 12 19:17:26.214523 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.214468 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5558cfc5-vkbgv" event={"ID":"4e0240c2-73e4-41ec-9b03-e1509a8a5298","Type":"ContainerDied","Data":"4a703fcf357330ee72c5bf1870b58e5188e64403563670552c812dbe7abea8d1"} Jun 12 19:17:26.214523 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.214499 2560 scope.go:117] "RemoveContainer" containerID="b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f" Jun 12 19:17:26.220044 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.220015 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e0240c2-73e4-41ec-9b03-e1509a8a5298-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4e0240c2-73e4-41ec-9b03-e1509a8a5298" (UID: "4e0240c2-73e4-41ec-9b03-e1509a8a5298"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:17:26.232203 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.232174 2560 scope.go:117] "RemoveContainer" containerID="b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f" Jun 12 19:17:26.232610 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:17:26.232586 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f\": container with ID starting with b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f not found: ID does not exist" containerID="b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f" Jun 12 19:17:26.232700 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.232624 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f"} err="failed to get container status \"b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f\": rpc error: code = NotFound desc = could not find container \"b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f\": container with ID starting with b0d809cdef7c79c11822c16e4385035ffdc32b7c746fc665ba3e23f89aaf3c7f not found: ID does not exist" Jun 12 19:17:26.310850 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.310811 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e0240c2-73e4-41ec-9b03-e1509a8a5298-ca-trust-extracted\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:26.310850 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.310841 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-image-registry-private-configuration\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:26.310850 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.310854 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-tls\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:26.311105 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.310863 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnfrd\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-kube-api-access-qnfrd\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:26.311105 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.310873 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-registry-certificates\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:26.311105 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.310881 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e0240c2-73e4-41ec-9b03-e1509a8a5298-installation-pull-secrets\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:26.311105 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.310889 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e0240c2-73e4-41ec-9b03-e1509a8a5298-bound-sa-token\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:26.311105 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.310897 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e0240c2-73e4-41ec-9b03-e1509a8a5298-trusted-ca\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:26.536926 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.536876 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f5558cfc5-vkbgv"] Jun 12 19:17:26.540607 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:26.540575 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f5558cfc5-vkbgv"] Jun 12 19:17:27.787862 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:27.787830 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e0240c2-73e4-41ec-9b03-e1509a8a5298" path="/var/lib/kubelet/pods/4e0240c2-73e4-41ec-9b03-e1509a8a5298/volumes" Jun 12 19:17:49.294732 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.294668 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56695bd6f8-c67sh" podUID="e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" containerName="console" containerID="cri-o://b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90" gracePeriod=15 Jun 12 19:17:49.554068 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.553998 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:17:49.613693 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.613655 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-oauth-config\") pod \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " Jun 12 19:17:49.613891 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.613717 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-config\") pod \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " Jun 12 19:17:49.613891 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.613741 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-serving-cert\") pod \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " Jun 12 19:17:49.613891 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.613786 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-trusted-ca-bundle\") pod \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " Jun 12 19:17:49.613891 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.613808 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5fp8\" (UniqueName: \"kubernetes.io/projected/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-kube-api-access-m5fp8\") pod \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " Jun 12 19:17:49.613891 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.613855 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-service-ca\") pod \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " Jun 12 19:17:49.614163 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.613908 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-oauth-serving-cert\") pod \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\" (UID: \"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8\") " Jun 12 19:17:49.614273 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.614235 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-config" (OuterVolumeSpecName: "console-config") pod "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" (UID: "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:49.614337 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.614270 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" (UID: "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:49.614394 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.614334 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" (UID: "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:49.614533 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.614512 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" (UID: "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:49.616102 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.616080 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" (UID: "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:49.616203 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.616182 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-kube-api-access-m5fp8" (OuterVolumeSpecName: "kube-api-access-m5fp8") pod "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" (UID: "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8"). InnerVolumeSpecName "kube-api-access-m5fp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:17:49.616260 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.616185 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" (UID: "e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:49.715321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.715280 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-trusted-ca-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:49.715321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.715312 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5fp8\" (UniqueName: \"kubernetes.io/projected/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-kube-api-access-m5fp8\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:49.715321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.715323 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-service-ca\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:49.715321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.715332 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-oauth-serving-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:49.715597 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.715340 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-oauth-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:49.715597 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.715349 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:49.715597 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:49.715357 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8-console-serving-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:17:50.317141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:50.317109 2560 generic.go:356] "Generic (PLEG): container finished" podID="e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" containerID="b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90" exitCode=0 Jun 12 19:17:50.317604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:50.317158 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56695bd6f8-c67sh" event={"ID":"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8","Type":"ContainerDied","Data":"b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90"} Jun 12 19:17:50.317604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:50.317193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56695bd6f8-c67sh" event={"ID":"e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8","Type":"ContainerDied","Data":"060c03c4ea20f9d5a836993fc982101f5c3c99b77db8beda1d5bce4d785c12a9"} Jun 12 19:17:50.317604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:50.317213 2560 scope.go:117] "RemoveContainer" containerID="b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90" Jun 12 19:17:50.317604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:50.317157 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56695bd6f8-c67sh" Jun 12 19:17:50.325642 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:50.325624 2560 scope.go:117] "RemoveContainer" containerID="b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90" Jun 12 19:17:50.326036 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:17:50.326008 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90\": container with ID starting with b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90 not found: ID does not exist" containerID="b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90" Jun 12 19:17:50.326142 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:50.326043 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90"} err="failed to get container status \"b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90\": rpc error: code = NotFound desc = could not find container \"b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90\": container with ID starting with b56fe757c2675265e47d242dbbbda446fa735cfe15d8781dc023d5c1bcfe7f90 not found: ID does not exist" Jun 12 19:17:50.334558 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:50.334524 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56695bd6f8-c67sh"] Jun 12 19:17:50.337879 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:50.337852 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56695bd6f8-c67sh"] Jun 12 19:17:51.787806 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:17:51.787768 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" path="/var/lib/kubelet/pods/e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8/volumes" Jun 12 19:18:24.088748 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.088704 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-796f76c886-nbq48"] Jun 12 19:18:24.089459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.089174 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e0240c2-73e4-41ec-9b03-e1509a8a5298" containerName="registry" Jun 12 19:18:24.089459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.089192 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e0240c2-73e4-41ec-9b03-e1509a8a5298" containerName="registry" Jun 12 19:18:24.089459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.089214 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" containerName="console" Jun 12 19:18:24.089459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.089223 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" containerName="console" Jun 12 19:18:24.089459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.089321 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4ed739e-5a69-468b-b6fa-8d7b9b73b0b8" containerName="console" Jun 12 19:18:24.089459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.089336 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e0240c2-73e4-41ec-9b03-e1509a8a5298" containerName="registry" Jun 12 19:18:24.092431 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.092404 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.110007 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.109972 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-796f76c886-nbq48"] Jun 12 19:18:24.200115 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.200072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf8rz\" (UniqueName: \"kubernetes.io/projected/ff7b7a3c-a223-4a25-a102-ab3d691fe683-kube-api-access-qf8rz\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.200300 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.200122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-trusted-ca-bundle\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.200300 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.200176 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-oauth-config\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.200300 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.200212 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-config\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.200300 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.200248 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-serving-cert\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.200300 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.200288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-oauth-serving-cert\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.200488 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.200335 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-service-ca\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.301817 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.301773 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-service-ca\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.302048 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.301846 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf8rz\" (UniqueName: \"kubernetes.io/projected/ff7b7a3c-a223-4a25-a102-ab3d691fe683-kube-api-access-qf8rz\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.302048 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.301872 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-trusted-ca-bundle\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.302048 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.301892 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-oauth-config\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.302048 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.301945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-config\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.302048 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.301970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-serving-cert\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.302048 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.302011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-oauth-serving-cert\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.302619 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.302591 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-service-ca\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.302871 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.302786 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-trusted-ca-bundle\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.302871 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.302786 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-config\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.303018 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.302888 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-oauth-serving-cert\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.304569 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.304548 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-oauth-config\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.304686 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.304668 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-serving-cert\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.313960 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.313907 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf8rz\" (UniqueName: \"kubernetes.io/projected/ff7b7a3c-a223-4a25-a102-ab3d691fe683-kube-api-access-qf8rz\") pod \"console-796f76c886-nbq48\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.402857 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.402819 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:24.548128 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:24.548100 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-796f76c886-nbq48"] Jun 12 19:18:24.550628 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:18:24.550600 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7b7a3c_a223_4a25_a102_ab3d691fe683.slice/crio-1b4231cad515694cb94c56ecef63d023aad2371f441af8f7052436f610451f6e WatchSource:0}: Error finding container 1b4231cad515694cb94c56ecef63d023aad2371f441af8f7052436f610451f6e: Status 404 returned error can't find the container with id 1b4231cad515694cb94c56ecef63d023aad2371f441af8f7052436f610451f6e Jun 12 19:18:25.473081 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:25.473043 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796f76c886-nbq48" event={"ID":"ff7b7a3c-a223-4a25-a102-ab3d691fe683","Type":"ContainerStarted","Data":"682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b"} Jun 12 19:18:25.473486 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:25.473095 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796f76c886-nbq48" event={"ID":"ff7b7a3c-a223-4a25-a102-ab3d691fe683","Type":"ContainerStarted","Data":"1b4231cad515694cb94c56ecef63d023aad2371f441af8f7052436f610451f6e"} Jun 12 19:18:25.493951 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:25.493881 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-796f76c886-nbq48" podStartSLOduration=1.493862764 podStartE2EDuration="1.493862764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:18:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:18:25.491601436 +0000 UTC m=+418.148640577" watchObservedRunningTime="2026-06-12 19:18:25.493862764 +0000 UTC m=+418.150901903" Jun 12 19:18:34.403735 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:34.403687 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:34.404184 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:34.403775 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:34.408749 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:34.408722 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:34.517022 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:34.516992 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:18:34.567114 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:34.567068 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5645c87bd-p5wdv"] Jun 12 19:18:59.592519 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:59.592450 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5645c87bd-p5wdv" podUID="dbdec2ab-3584-4121-973e-af5f26f0577c" containerName="console" containerID="cri-o://4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f" gracePeriod=15 Jun 12 19:18:59.844808 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:18:59.844730 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:19:00.018694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.018657 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-console-config\") pod \"dbdec2ab-3584-4121-973e-af5f26f0577c\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " Jun 12 19:19:00.018906 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.018708 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-serving-cert\") pod \"dbdec2ab-3584-4121-973e-af5f26f0577c\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " Jun 12 19:19:00.018906 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.018733 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-service-ca\") pod \"dbdec2ab-3584-4121-973e-af5f26f0577c\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " Jun 12 19:19:00.018906 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.018763 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnw8l\" (UniqueName: \"kubernetes.io/projected/dbdec2ab-3584-4121-973e-af5f26f0577c-kube-api-access-lnw8l\") pod \"dbdec2ab-3584-4121-973e-af5f26f0577c\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " Jun 12 19:19:00.018906 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.018834 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-trusted-ca-bundle\") pod \"dbdec2ab-3584-4121-973e-af5f26f0577c\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " Jun 12 19:19:00.018906 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.018858 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-oauth-config\") pod \"dbdec2ab-3584-4121-973e-af5f26f0577c\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " Jun 12 19:19:00.018906 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.018891 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-oauth-serving-cert\") pod \"dbdec2ab-3584-4121-973e-af5f26f0577c\" (UID: \"dbdec2ab-3584-4121-973e-af5f26f0577c\") " Jun 12 19:19:00.019216 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.019113 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-console-config" (OuterVolumeSpecName: "console-config") pod "dbdec2ab-3584-4121-973e-af5f26f0577c" (UID: "dbdec2ab-3584-4121-973e-af5f26f0577c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:19:00.019310 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.019274 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-service-ca" (OuterVolumeSpecName: "service-ca") pod "dbdec2ab-3584-4121-973e-af5f26f0577c" (UID: "dbdec2ab-3584-4121-973e-af5f26f0577c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:19:00.019310 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.019305 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-console-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:00.019413 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.019341 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dbdec2ab-3584-4121-973e-af5f26f0577c" (UID: "dbdec2ab-3584-4121-973e-af5f26f0577c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:19:00.019413 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.019361 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dbdec2ab-3584-4121-973e-af5f26f0577c" (UID: "dbdec2ab-3584-4121-973e-af5f26f0577c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:19:00.021319 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.021293 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dbdec2ab-3584-4121-973e-af5f26f0577c" (UID: "dbdec2ab-3584-4121-973e-af5f26f0577c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:19:00.021408 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.021310 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dbdec2ab-3584-4121-973e-af5f26f0577c" (UID: "dbdec2ab-3584-4121-973e-af5f26f0577c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:19:00.021408 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.021310 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbdec2ab-3584-4121-973e-af5f26f0577c-kube-api-access-lnw8l" (OuterVolumeSpecName: "kube-api-access-lnw8l") pod "dbdec2ab-3584-4121-973e-af5f26f0577c" (UID: "dbdec2ab-3584-4121-973e-af5f26f0577c"). InnerVolumeSpecName "kube-api-access-lnw8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:19:00.119987 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.119944 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-serving-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:00.119987 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.119975 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-service-ca\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:00.119987 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.119985 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnw8l\" (UniqueName: \"kubernetes.io/projected/dbdec2ab-3584-4121-973e-af5f26f0577c-kube-api-access-lnw8l\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:00.119987 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.119996 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-trusted-ca-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:00.120338 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.120005 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbdec2ab-3584-4121-973e-af5f26f0577c-console-oauth-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:00.120338 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.120014 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbdec2ab-3584-4121-973e-af5f26f0577c-oauth-serving-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:00.624323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.624290 2560 generic.go:356] "Generic (PLEG): container finished" podID="dbdec2ab-3584-4121-973e-af5f26f0577c" containerID="4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f" exitCode=0 Jun 12 19:19:00.624705 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.624335 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645c87bd-p5wdv" Jun 12 19:19:00.624705 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.624340 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645c87bd-p5wdv" event={"ID":"dbdec2ab-3584-4121-973e-af5f26f0577c","Type":"ContainerDied","Data":"4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f"} Jun 12 19:19:00.624705 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.624465 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645c87bd-p5wdv" event={"ID":"dbdec2ab-3584-4121-973e-af5f26f0577c","Type":"ContainerDied","Data":"16a1283a6e298ab0368702abeb0a4a71c8461f8d98b4d6f96782906d4871e964"} Jun 12 19:19:00.624705 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.624497 2560 scope.go:117] "RemoveContainer" containerID="4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f" Jun 12 19:19:00.633151 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.633132 2560 scope.go:117] "RemoveContainer" containerID="4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f" Jun 12 19:19:00.633474 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:19:00.633453 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f\": container with ID starting with 4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f not found: ID does not exist" containerID="4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f" Jun 12 19:19:00.633546 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.633482 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f"} err="failed to get container status \"4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f\": rpc error: code = NotFound desc = could not find container \"4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f\": container with ID starting with 4c0597964318edc8871317fd3bc2a5181b0ddf6085e4253d6ab9b8bfaf87a75f not found: ID does not exist" Jun 12 19:19:00.645676 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.645640 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5645c87bd-p5wdv"] Jun 12 19:19:00.649648 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:00.649620 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5645c87bd-p5wdv"] Jun 12 19:19:01.787026 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:01.786989 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbdec2ab-3584-4121-973e-af5f26f0577c" path="/var/lib/kubelet/pods/dbdec2ab-3584-4121-973e-af5f26f0577c/volumes" Jun 12 19:19:08.287213 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.287178 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf"] Jun 12 19:19:08.287593 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.287516 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbdec2ab-3584-4121-973e-af5f26f0577c" containerName="console" Jun 12 19:19:08.287593 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.287529 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbdec2ab-3584-4121-973e-af5f26f0577c" containerName="console" Jun 12 19:19:08.287664 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.287615 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbdec2ab-3584-4121-973e-af5f26f0577c" containerName="console" Jun 12 19:19:08.292484 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.292464 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.295579 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.295556 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 19:19:08.295762 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.295750 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 19:19:08.296714 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.296699 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7zsq\"" Jun 12 19:19:08.301690 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.301662 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf"] Jun 12 19:19:08.391473 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.391432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.391639 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.391499 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf787\" (UniqueName: \"kubernetes.io/projected/c85173f1-c858-4274-900b-7ab3a681f7dc-kube-api-access-jf787\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.391639 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.391530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.492755 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.492713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.492963 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.492765 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf787\" (UniqueName: \"kubernetes.io/projected/c85173f1-c858-4274-900b-7ab3a681f7dc-kube-api-access-jf787\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.492963 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.492794 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.493144 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.493124 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.493200 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.493181 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.502354 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.502324 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf787\" (UniqueName: \"kubernetes.io/projected/c85173f1-c858-4274-900b-7ab3a681f7dc-kube-api-access-jf787\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.603072 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.602990 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:08.742291 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:08.742267 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf"] Jun 12 19:19:08.744440 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:19:08.744403 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85173f1_c858_4274_900b_7ab3a681f7dc.slice/crio-14d1b484222783369317187cce760bb62351939a01d3be8441a792111c0f4906 WatchSource:0}: Error finding container 14d1b484222783369317187cce760bb62351939a01d3be8441a792111c0f4906: Status 404 returned error can't find the container with id 14d1b484222783369317187cce760bb62351939a01d3be8441a792111c0f4906 Jun 12 19:19:09.666114 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:09.666075 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" event={"ID":"c85173f1-c858-4274-900b-7ab3a681f7dc","Type":"ContainerStarted","Data":"14d1b484222783369317187cce760bb62351939a01d3be8441a792111c0f4906"} Jun 12 19:19:16.703992 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:16.703947 2560 generic.go:356] "Generic (PLEG): container finished" podID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerID="2516b15ce5190eae4e367c7e3a0fa44f317d1ede550c8181d4f6d0eda66e4bc3" exitCode=0 Jun 12 19:19:16.704355 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:16.704035 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" event={"ID":"c85173f1-c858-4274-900b-7ab3a681f7dc","Type":"ContainerDied","Data":"2516b15ce5190eae4e367c7e3a0fa44f317d1ede550c8181d4f6d0eda66e4bc3"} Jun 12 19:19:19.719506 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:19.719473 2560 generic.go:356] "Generic (PLEG): container finished" podID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerID="3b1bc3f8b1fa4c4e9670495ad714cc55aa794887db8b30dcfca07ee035723f0b" exitCode=0 Jun 12 19:19:19.719887 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:19.719546 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" event={"ID":"c85173f1-c858-4274-900b-7ab3a681f7dc","Type":"ContainerDied","Data":"3b1bc3f8b1fa4c4e9670495ad714cc55aa794887db8b30dcfca07ee035723f0b"} Jun 12 19:19:28.762895 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:28.762860 2560 generic.go:356] "Generic (PLEG): container finished" podID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerID="c7fbca9fb87b2274abd08607946ed6081a9c032800bf2054fd0912737d434d67" exitCode=0 Jun 12 19:19:28.763301 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:28.762944 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" event={"ID":"c85173f1-c858-4274-900b-7ab3a681f7dc","Type":"ContainerDied","Data":"c7fbca9fb87b2274abd08607946ed6081a9c032800bf2054fd0912737d434d67"} Jun 12 19:19:29.904623 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:29.904595 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:29.970877 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:29.970836 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-bundle\") pod \"c85173f1-c858-4274-900b-7ab3a681f7dc\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " Jun 12 19:19:29.970877 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:29.970879 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf787\" (UniqueName: \"kubernetes.io/projected/c85173f1-c858-4274-900b-7ab3a681f7dc-kube-api-access-jf787\") pod \"c85173f1-c858-4274-900b-7ab3a681f7dc\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " Jun 12 19:19:29.971097 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:29.970981 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-util\") pod \"c85173f1-c858-4274-900b-7ab3a681f7dc\" (UID: \"c85173f1-c858-4274-900b-7ab3a681f7dc\") " Jun 12 19:19:29.971586 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:29.971564 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-bundle" (OuterVolumeSpecName: "bundle") pod "c85173f1-c858-4274-900b-7ab3a681f7dc" (UID: "c85173f1-c858-4274-900b-7ab3a681f7dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:19:29.973352 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:29.973327 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c85173f1-c858-4274-900b-7ab3a681f7dc-kube-api-access-jf787" (OuterVolumeSpecName: "kube-api-access-jf787") pod "c85173f1-c858-4274-900b-7ab3a681f7dc" (UID: "c85173f1-c858-4274-900b-7ab3a681f7dc"). InnerVolumeSpecName "kube-api-access-jf787". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:19:29.975643 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:29.975621 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-util" (OuterVolumeSpecName: "util") pod "c85173f1-c858-4274-900b-7ab3a681f7dc" (UID: "c85173f1-c858-4274-900b-7ab3a681f7dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:19:30.072308 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:30.072216 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:30.072308 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:30.072252 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85173f1-c858-4274-900b-7ab3a681f7dc-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:30.072308 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:30.072262 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf787\" (UniqueName: \"kubernetes.io/projected/c85173f1-c858-4274-900b-7ab3a681f7dc-kube-api-access-jf787\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:30.772357 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:30.772323 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" event={"ID":"c85173f1-c858-4274-900b-7ab3a681f7dc","Type":"ContainerDied","Data":"14d1b484222783369317187cce760bb62351939a01d3be8441a792111c0f4906"} Jun 12 19:19:30.772357 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:30.772349 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw57kf" Jun 12 19:19:30.772647 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:30.772379 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14d1b484222783369317187cce760bb62351939a01d3be8441a792111c0f4906" Jun 12 19:19:36.310535 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.310493 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j"] Jun 12 19:19:36.310941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.310805 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerName="util" Jun 12 19:19:36.310941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.310817 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerName="util" Jun 12 19:19:36.310941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.310830 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerName="pull" Jun 12 19:19:36.310941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.310836 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerName="pull" Jun 12 19:19:36.310941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.310844 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerName="extract" Jun 12 19:19:36.310941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.310849 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerName="extract" Jun 12 19:19:36.310941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.310911 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c85173f1-c858-4274-900b-7ab3a681f7dc" containerName="extract" Jun 12 19:19:36.352790 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.352749 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j"] Jun 12 19:19:36.352969 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.352871 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" Jun 12 19:19:36.355826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.355762 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-prmb6\"" Jun 12 19:19:36.356018 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.355833 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 12 19:19:36.356018 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.355883 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:19:36.427792 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.427745 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c5bb727-a952-4683-8897-94e14e8c974d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2n78j\" (UID: \"6c5bb727-a952-4683-8897-94e14e8c974d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" Jun 12 19:19:36.427991 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.427870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rghd\" (UniqueName: \"kubernetes.io/projected/6c5bb727-a952-4683-8897-94e14e8c974d-kube-api-access-5rghd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2n78j\" (UID: \"6c5bb727-a952-4683-8897-94e14e8c974d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" Jun 12 19:19:36.529132 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.529092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rghd\" (UniqueName: \"kubernetes.io/projected/6c5bb727-a952-4683-8897-94e14e8c974d-kube-api-access-5rghd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2n78j\" (UID: \"6c5bb727-a952-4683-8897-94e14e8c974d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" Jun 12 19:19:36.529378 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.529182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c5bb727-a952-4683-8897-94e14e8c974d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2n78j\" (UID: \"6c5bb727-a952-4683-8897-94e14e8c974d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" Jun 12 19:19:36.529540 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.529523 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c5bb727-a952-4683-8897-94e14e8c974d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2n78j\" (UID: \"6c5bb727-a952-4683-8897-94e14e8c974d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" Jun 12 19:19:36.538530 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.538493 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rghd\" (UniqueName: \"kubernetes.io/projected/6c5bb727-a952-4683-8897-94e14e8c974d-kube-api-access-5rghd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2n78j\" (UID: \"6c5bb727-a952-4683-8897-94e14e8c974d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" Jun 12 19:19:36.663037 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.662994 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" Jun 12 19:19:36.826891 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:36.826862 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j"] Jun 12 19:19:36.830088 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:19:36.830058 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c5bb727_a952_4683_8897_94e14e8c974d.slice/crio-6e1cd83bbdc88d9aba41168c37b6c5f7253ffb39ed97aa5f8f98fbcc8a43484b WatchSource:0}: Error finding container 6e1cd83bbdc88d9aba41168c37b6c5f7253ffb39ed97aa5f8f98fbcc8a43484b: Status 404 returned error can't find the container with id 6e1cd83bbdc88d9aba41168c37b6c5f7253ffb39ed97aa5f8f98fbcc8a43484b Jun 12 19:19:37.803462 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:37.803418 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" event={"ID":"6c5bb727-a952-4683-8897-94e14e8c974d","Type":"ContainerStarted","Data":"6e1cd83bbdc88d9aba41168c37b6c5f7253ffb39ed97aa5f8f98fbcc8a43484b"} Jun 12 19:19:38.809978 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:38.809936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" event={"ID":"6c5bb727-a952-4683-8897-94e14e8c974d","Type":"ContainerStarted","Data":"dc19ff3d7acf9ec5da16fd22e58fa462e4330c301f40dda3cedf947643820430"} Jun 12 19:19:40.165382 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.165325 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2n78j" podStartSLOduration=2.339352766 podStartE2EDuration="4.165307485s" totalImagesPullingTime="1.825954719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:19:38.861276364 +0000 UTC m=+491.518315503" watchObservedRunningTime="2026-06-12 19:19:40.165307485 +0000 UTC m=+492.822346627" Jun 12 19:19:40.165776 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.165641 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl"] Jun 12 19:19:40.168121 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.168100 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.170894 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.170867 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 19:19:40.171266 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.171247 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 19:19:40.172310 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.172286 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7zsq\"" Jun 12 19:19:40.178076 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.178054 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl"] Jun 12 19:19:40.262267 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.262226 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzvkw\" (UniqueName: \"kubernetes.io/projected/c87e05ea-004a-4f92-828a-528db0148b22-kube-api-access-vzvkw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.262267 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.262275 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.262491 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.262322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.363763 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.363725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvkw\" (UniqueName: \"kubernetes.io/projected/c87e05ea-004a-4f92-828a-528db0148b22-kube-api-access-vzvkw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.363960 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.363771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.363960 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.363828 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.364277 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.364261 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.364315 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.364287 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.372434 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.372402 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzvkw\" (UniqueName: \"kubernetes.io/projected/c87e05ea-004a-4f92-828a-528db0148b22-kube-api-access-vzvkw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.477849 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.477751 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:40.620127 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.620100 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl"] Jun 12 19:19:40.621806 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:19:40.621777 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87e05ea_004a_4f92_828a_528db0148b22.slice/crio-8aa4227463e56d8712f57d0739298ac8d0b5ea8b74330f5cbc3df3a2916f515b WatchSource:0}: Error finding container 8aa4227463e56d8712f57d0739298ac8d0b5ea8b74330f5cbc3df3a2916f515b: Status 404 returned error can't find the container with id 8aa4227463e56d8712f57d0739298ac8d0b5ea8b74330f5cbc3df3a2916f515b Jun 12 19:19:40.822361 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.822270 2560 generic.go:356] "Generic (PLEG): container finished" podID="c87e05ea-004a-4f92-828a-528db0148b22" containerID="499f2b2a5ba870569ddbd2a739c5e4b88f80b8661174dd71ac1302a224183688" exitCode=0 Jun 12 19:19:40.822517 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.822354 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" event={"ID":"c87e05ea-004a-4f92-828a-528db0148b22","Type":"ContainerDied","Data":"499f2b2a5ba870569ddbd2a739c5e4b88f80b8661174dd71ac1302a224183688"} Jun 12 19:19:40.822517 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:40.822415 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" event={"ID":"c87e05ea-004a-4f92-828a-528db0148b22","Type":"ContainerStarted","Data":"8aa4227463e56d8712f57d0739298ac8d0b5ea8b74330f5cbc3df3a2916f515b"} Jun 12 19:19:42.836258 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:42.836217 2560 generic.go:356] "Generic (PLEG): container finished" podID="c87e05ea-004a-4f92-828a-528db0148b22" containerID="2d6d4eba630c2caab391ca575630a043d890dac9a19c4abe2e8f8d43a1b1055b" exitCode=0 Jun 12 19:19:42.836646 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:42.836301 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" event={"ID":"c87e05ea-004a-4f92-828a-528db0148b22","Type":"ContainerDied","Data":"2d6d4eba630c2caab391ca575630a043d890dac9a19c4abe2e8f8d43a1b1055b"} Jun 12 19:19:43.668891 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.668854 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-bppjg"] Jun 12 19:19:43.671125 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.671104 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:43.673765 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.673727 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gqzp7\"" Jun 12 19:19:43.673974 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.673959 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 19:19:43.674940 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.674912 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 19:19:43.681275 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.681251 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-bppjg"] Jun 12 19:19:43.795462 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.795425 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjjx5\" (UniqueName: \"kubernetes.io/projected/86f9ecc3-c8e6-4576-a8a2-819b5cafd410-kube-api-access-tjjx5\") pod \"cert-manager-webhook-7dc76cbb94-bppjg\" (UID: \"86f9ecc3-c8e6-4576-a8a2-819b5cafd410\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:43.795632 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.795530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86f9ecc3-c8e6-4576-a8a2-819b5cafd410-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-bppjg\" (UID: \"86f9ecc3-c8e6-4576-a8a2-819b5cafd410\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:43.843348 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.843317 2560 generic.go:356] "Generic (PLEG): container finished" podID="c87e05ea-004a-4f92-828a-528db0148b22" containerID="e8c5cb2b4b491e580300eaebe23a84c78572a6c7036aa5d8c3d05afd23848de6" exitCode=0 Jun 12 19:19:43.843720 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.843405 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" event={"ID":"c87e05ea-004a-4f92-828a-528db0148b22","Type":"ContainerDied","Data":"e8c5cb2b4b491e580300eaebe23a84c78572a6c7036aa5d8c3d05afd23848de6"} Jun 12 19:19:43.896790 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.896743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjjx5\" (UniqueName: \"kubernetes.io/projected/86f9ecc3-c8e6-4576-a8a2-819b5cafd410-kube-api-access-tjjx5\") pod \"cert-manager-webhook-7dc76cbb94-bppjg\" (UID: \"86f9ecc3-c8e6-4576-a8a2-819b5cafd410\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:43.897045 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.896963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86f9ecc3-c8e6-4576-a8a2-819b5cafd410-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-bppjg\" (UID: \"86f9ecc3-c8e6-4576-a8a2-819b5cafd410\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:43.905714 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.905673 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86f9ecc3-c8e6-4576-a8a2-819b5cafd410-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-bppjg\" (UID: \"86f9ecc3-c8e6-4576-a8a2-819b5cafd410\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:43.905874 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.905853 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjjx5\" (UniqueName: \"kubernetes.io/projected/86f9ecc3-c8e6-4576-a8a2-819b5cafd410-kube-api-access-tjjx5\") pod \"cert-manager-webhook-7dc76cbb94-bppjg\" (UID: \"86f9ecc3-c8e6-4576-a8a2-819b5cafd410\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:43.988381 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:43.988286 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:44.124688 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:44.124660 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-bppjg"] Jun 12 19:19:44.126968 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:19:44.126939 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86f9ecc3_c8e6_4576_a8a2_819b5cafd410.slice/crio-21971c59a91136d2523f9edd551ae454f7e58e216c20230a9ca6f21bfbb0e538 WatchSource:0}: Error finding container 21971c59a91136d2523f9edd551ae454f7e58e216c20230a9ca6f21bfbb0e538: Status 404 returned error can't find the container with id 21971c59a91136d2523f9edd551ae454f7e58e216c20230a9ca6f21bfbb0e538 Jun 12 19:19:44.850392 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:44.850342 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" event={"ID":"86f9ecc3-c8e6-4576-a8a2-819b5cafd410","Type":"ContainerStarted","Data":"21971c59a91136d2523f9edd551ae454f7e58e216c20230a9ca6f21bfbb0e538"} Jun 12 19:19:44.999773 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:44.999749 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:45.113443 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.113412 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzvkw\" (UniqueName: \"kubernetes.io/projected/c87e05ea-004a-4f92-828a-528db0148b22-kube-api-access-vzvkw\") pod \"c87e05ea-004a-4f92-828a-528db0148b22\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " Jun 12 19:19:45.113642 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.113486 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-util\") pod \"c87e05ea-004a-4f92-828a-528db0148b22\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " Jun 12 19:19:45.113642 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.113553 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-bundle\") pod \"c87e05ea-004a-4f92-828a-528db0148b22\" (UID: \"c87e05ea-004a-4f92-828a-528db0148b22\") " Jun 12 19:19:45.114005 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.113971 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-bundle" (OuterVolumeSpecName: "bundle") pod "c87e05ea-004a-4f92-828a-528db0148b22" (UID: "c87e05ea-004a-4f92-828a-528db0148b22"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:19:45.116101 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.116076 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c87e05ea-004a-4f92-828a-528db0148b22-kube-api-access-vzvkw" (OuterVolumeSpecName: "kube-api-access-vzvkw") pod "c87e05ea-004a-4f92-828a-528db0148b22" (UID: "c87e05ea-004a-4f92-828a-528db0148b22"). InnerVolumeSpecName "kube-api-access-vzvkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:19:45.119713 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.119667 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-util" (OuterVolumeSpecName: "util") pod "c87e05ea-004a-4f92-828a-528db0148b22" (UID: "c87e05ea-004a-4f92-828a-528db0148b22"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:19:45.215018 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.214977 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:45.215018 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.215015 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzvkw\" (UniqueName: \"kubernetes.io/projected/c87e05ea-004a-4f92-828a-528db0148b22-kube-api-access-vzvkw\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:45.215214 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.215031 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87e05ea-004a-4f92-828a-528db0148b22-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:19:45.858405 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.858375 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" Jun 12 19:19:45.858818 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.858380 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqvfl" event={"ID":"c87e05ea-004a-4f92-828a-528db0148b22","Type":"ContainerDied","Data":"8aa4227463e56d8712f57d0739298ac8d0b5ea8b74330f5cbc3df3a2916f515b"} Jun 12 19:19:45.858818 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:45.858527 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8aa4227463e56d8712f57d0739298ac8d0b5ea8b74330f5cbc3df3a2916f515b" Jun 12 19:19:46.864393 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:46.864356 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" event={"ID":"86f9ecc3-c8e6-4576-a8a2-819b5cafd410","Type":"ContainerStarted","Data":"a8173fd70b95c083607ccbf3de901b8ca31310565a7dbeb5a771a3f95ec7aea8"} Jun 12 19:19:46.864758 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:46.864496 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:46.884285 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:46.884234 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" podStartSLOduration=1.401310437 podStartE2EDuration="3.884218882s" totalImagesPullingTime="2.482908445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:19:46.883580279 +0000 UTC m=+499.540619419" watchObservedRunningTime="2026-06-12 19:19:46.884218882 +0000 UTC m=+499.541258020" Jun 12 19:19:52.871297 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.871266 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-bppjg" Jun 12 19:19:52.977489 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.977443 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq"] Jun 12 19:19:52.977858 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.977838 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87e05ea-004a-4f92-828a-528db0148b22" containerName="util" Jun 12 19:19:52.977959 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.977861 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87e05ea-004a-4f92-828a-528db0148b22" containerName="util" Jun 12 19:19:52.977959 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.977877 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87e05ea-004a-4f92-828a-528db0148b22" containerName="extract" Jun 12 19:19:52.977959 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.977885 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87e05ea-004a-4f92-828a-528db0148b22" containerName="extract" Jun 12 19:19:52.977959 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.977937 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87e05ea-004a-4f92-828a-528db0148b22" containerName="pull" Jun 12 19:19:52.977959 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.977947 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87e05ea-004a-4f92-828a-528db0148b22" containerName="pull" Jun 12 19:19:52.978197 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.978040 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c87e05ea-004a-4f92-828a-528db0148b22" containerName="extract" Jun 12 19:19:52.980035 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.980013 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" Jun 12 19:19:52.982934 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.982894 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:19:52.983045 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.982898 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 19:19:52.983045 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.982979 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-d2vc4\"" Jun 12 19:19:52.987757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:52.987724 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq"] Jun 12 19:19:53.083177 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:53.083135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d562778d-b542-4c96-bc58-accaec9d6980-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4j5mq\" (UID: \"d562778d-b542-4c96-bc58-accaec9d6980\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" Jun 12 19:19:53.083374 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:53.083195 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p777l\" (UniqueName: \"kubernetes.io/projected/d562778d-b542-4c96-bc58-accaec9d6980-kube-api-access-p777l\") pod \"openshift-lws-operator-fd8ccff4c-4j5mq\" (UID: \"d562778d-b542-4c96-bc58-accaec9d6980\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" Jun 12 19:19:53.184477 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:53.184347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d562778d-b542-4c96-bc58-accaec9d6980-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4j5mq\" (UID: \"d562778d-b542-4c96-bc58-accaec9d6980\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" Jun 12 19:19:53.184477 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:53.184457 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p777l\" (UniqueName: \"kubernetes.io/projected/d562778d-b542-4c96-bc58-accaec9d6980-kube-api-access-p777l\") pod \"openshift-lws-operator-fd8ccff4c-4j5mq\" (UID: \"d562778d-b542-4c96-bc58-accaec9d6980\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" Jun 12 19:19:53.184798 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:53.184776 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d562778d-b542-4c96-bc58-accaec9d6980-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4j5mq\" (UID: \"d562778d-b542-4c96-bc58-accaec9d6980\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" Jun 12 19:19:53.193226 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:53.193180 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p777l\" (UniqueName: \"kubernetes.io/projected/d562778d-b542-4c96-bc58-accaec9d6980-kube-api-access-p777l\") pod \"openshift-lws-operator-fd8ccff4c-4j5mq\" (UID: \"d562778d-b542-4c96-bc58-accaec9d6980\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" Jun 12 19:19:53.290527 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:53.290476 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" Jun 12 19:19:53.428551 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:53.428524 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq"] Jun 12 19:19:53.430592 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:19:53.430561 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd562778d_b542_4c96_bc58_accaec9d6980.slice/crio-95a9e057376ce29e90d9be1d57181286647454b7e4a572872774eafb81fd517a WatchSource:0}: Error finding container 95a9e057376ce29e90d9be1d57181286647454b7e4a572872774eafb81fd517a: Status 404 returned error can't find the container with id 95a9e057376ce29e90d9be1d57181286647454b7e4a572872774eafb81fd517a Jun 12 19:19:53.898657 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:53.898626 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" event={"ID":"d562778d-b542-4c96-bc58-accaec9d6980","Type":"ContainerStarted","Data":"95a9e057376ce29e90d9be1d57181286647454b7e4a572872774eafb81fd517a"} Jun 12 19:19:54.905430 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:54.905394 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" event={"ID":"d562778d-b542-4c96-bc58-accaec9d6980","Type":"ContainerStarted","Data":"830f4c24a16472d0e5121674b3424a6d7d2a59e32e7b3efa83c1118c51fe327c"} Jun 12 19:19:54.922407 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:54.922215 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4j5mq" podStartSLOduration=1.610636774 podStartE2EDuration="2.92219381s" totalImagesPullingTime="1.311557036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:19:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:19:54.921854682 +0000 UTC m=+507.578893818" watchObservedRunningTime="2026-06-12 19:19:54.92219381 +0000 UTC m=+507.579232948" Jun 12 19:19:58.202780 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.202744 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9"] Jun 12 19:19:58.205269 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.205251 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.208371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.208346 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 19:19:58.209442 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.209417 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7zsq\"" Jun 12 19:19:58.209550 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.209421 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 19:19:58.215077 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.215048 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9"] Jun 12 19:19:58.330161 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.330120 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.330320 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.330199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.330320 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.330245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g568d\" (UniqueName: \"kubernetes.io/projected/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-kube-api-access-g568d\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.431450 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.431411 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g568d\" (UniqueName: \"kubernetes.io/projected/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-kube-api-access-g568d\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.431450 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.431455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.431689 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.431500 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.431823 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.431805 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.431976 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.431895 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.440785 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.440751 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g568d\" (UniqueName: \"kubernetes.io/projected/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-kube-api-access-g568d\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.516201 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.516103 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:19:58.651908 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.651881 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9"] Jun 12 19:19:58.654655 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:19:58.654627 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d094c1_cc6c_459d_b8d9_fb3934d3cbdc.slice/crio-509a423751971510d21286cdf385db4b73840a8d12f2dbfda5f492257a7e068c WatchSource:0}: Error finding container 509a423751971510d21286cdf385db4b73840a8d12f2dbfda5f492257a7e068c: Status 404 returned error can't find the container with id 509a423751971510d21286cdf385db4b73840a8d12f2dbfda5f492257a7e068c Jun 12 19:19:58.926408 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.926371 2560 generic.go:356] "Generic (PLEG): container finished" podID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerID="83b905d56d30db23e8f6d3d705ff6f5bb192ab314c238e11ec2873652e5ec55a" exitCode=0 Jun 12 19:19:58.926611 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.926441 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" event={"ID":"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc","Type":"ContainerDied","Data":"83b905d56d30db23e8f6d3d705ff6f5bb192ab314c238e11ec2873652e5ec55a"} Jun 12 19:19:58.926611 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:58.926485 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" event={"ID":"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc","Type":"ContainerStarted","Data":"509a423751971510d21286cdf385db4b73840a8d12f2dbfda5f492257a7e068c"} Jun 12 19:19:59.933260 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:59.933209 2560 generic.go:356] "Generic (PLEG): container finished" podID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerID="460f52a1651d7c0c09e8a3279227d8cc4e3b6e6a88a8fa3b0b44c1d244f5e282" exitCode=0 Jun 12 19:19:59.933670 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:19:59.933308 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" event={"ID":"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc","Type":"ContainerDied","Data":"460f52a1651d7c0c09e8a3279227d8cc4e3b6e6a88a8fa3b0b44c1d244f5e282"} Jun 12 19:20:00.940524 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:00.940485 2560 generic.go:356] "Generic (PLEG): container finished" podID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerID="bd17a0ddacfe4d578d01497bf26c78beaa6974fe733df0f9dd0dc57b9c15ebc6" exitCode=0 Jun 12 19:20:00.940907 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:00.940562 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" event={"ID":"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc","Type":"ContainerDied","Data":"bd17a0ddacfe4d578d01497bf26c78beaa6974fe733df0f9dd0dc57b9c15ebc6"} Jun 12 19:20:02.077936 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.077896 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:20:02.269568 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.269465 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-bundle\") pod \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " Jun 12 19:20:02.269568 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.269511 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g568d\" (UniqueName: \"kubernetes.io/projected/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-kube-api-access-g568d\") pod \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " Jun 12 19:20:02.269807 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.269578 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-util\") pod \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\" (UID: \"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc\") " Jun 12 19:20:02.270426 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.270397 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-bundle" (OuterVolumeSpecName: "bundle") pod "47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" (UID: "47d094c1-cc6c-459d-b8d9-fb3934d3cbdc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:20:02.271842 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.271819 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-kube-api-access-g568d" (OuterVolumeSpecName: "kube-api-access-g568d") pod "47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" (UID: "47d094c1-cc6c-459d-b8d9-fb3934d3cbdc"). InnerVolumeSpecName "kube-api-access-g568d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:20:02.277605 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.277572 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-util" (OuterVolumeSpecName: "util") pod "47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" (UID: "47d094c1-cc6c-459d-b8d9-fb3934d3cbdc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:20:02.371102 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.371056 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:20:02.371102 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.371088 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:20:02.371102 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.371098 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g568d\" (UniqueName: \"kubernetes.io/projected/47d094c1-cc6c-459d-b8d9-fb3934d3cbdc-kube-api-access-g568d\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:20:02.952419 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.952384 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" event={"ID":"47d094c1-cc6c-459d-b8d9-fb3934d3cbdc","Type":"ContainerDied","Data":"509a423751971510d21286cdf385db4b73840a8d12f2dbfda5f492257a7e068c"} Jun 12 19:20:02.952586 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.952436 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="509a423751971510d21286cdf385db4b73840a8d12f2dbfda5f492257a7e068c" Jun 12 19:20:02.952586 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:02.952398 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp25k9" Jun 12 19:20:10.416220 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.416136 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw"] Jun 12 19:20:10.416604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.416446 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerName="extract" Jun 12 19:20:10.416604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.416457 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerName="extract" Jun 12 19:20:10.416604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.416471 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerName="pull" Jun 12 19:20:10.416604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.416476 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerName="pull" Jun 12 19:20:10.416604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.416482 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerName="util" Jun 12 19:20:10.416604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.416488 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerName="util" Jun 12 19:20:10.416604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.416557 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="47d094c1-cc6c-459d-b8d9-fb3934d3cbdc" containerName="extract" Jun 12 19:20:10.420101 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.420071 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.423139 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.423112 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 19:20:10.423590 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.423570 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 19:20:10.423702 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.423659 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 19:20:10.423792 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.423777 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 19:20:10.423856 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.423808 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q52mx\"" Jun 12 19:20:10.440658 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.440626 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e616a13-1fc1-4913-a643-e965d01961d4-tmp\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.440830 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.440672 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7e616a13-1fc1-4913-a643-e965d01961d4-manifests\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.440830 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.440706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7e616a13-1fc1-4913-a643-e965d01961d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.440830 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.440724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e616a13-1fc1-4913-a643-e965d01961d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.440830 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.440753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk7x4\" (UniqueName: \"kubernetes.io/projected/7e616a13-1fc1-4913-a643-e965d01961d4-kube-api-access-rk7x4\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.446933 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.446887 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw"] Jun 12 19:20:10.541486 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.541434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e616a13-1fc1-4913-a643-e965d01961d4-tmp\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.541486 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.541496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7e616a13-1fc1-4913-a643-e965d01961d4-manifests\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.541746 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.541528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7e616a13-1fc1-4913-a643-e965d01961d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.541746 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.541547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e616a13-1fc1-4913-a643-e965d01961d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.541746 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.541579 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk7x4\" (UniqueName: \"kubernetes.io/projected/7e616a13-1fc1-4913-a643-e965d01961d4-kube-api-access-rk7x4\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.542042 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.542013 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7e616a13-1fc1-4913-a643-e965d01961d4-manifests\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.544250 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.544227 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e616a13-1fc1-4913-a643-e965d01961d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.544425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.544403 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e616a13-1fc1-4913-a643-e965d01961d4-tmp\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.544600 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.544580 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7e616a13-1fc1-4913-a643-e965d01961d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.551826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.551797 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk7x4\" (UniqueName: \"kubernetes.io/projected/7e616a13-1fc1-4913-a643-e965d01961d4-kube-api-access-rk7x4\") pod \"opendatahub-operator-controller-manager-6dc6d65868-jmjvw\" (UID: \"7e616a13-1fc1-4913-a643-e965d01961d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.730955 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.730840 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:10.899145 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.899116 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw"] Jun 12 19:20:10.900758 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:20:10.900700 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e616a13_1fc1_4913_a643_e965d01961d4.slice/crio-1312f482d43090ba4eb0bbf182938669d8db0c2e0009507235196c674c6d469f WatchSource:0}: Error finding container 1312f482d43090ba4eb0bbf182938669d8db0c2e0009507235196c674c6d469f: Status 404 returned error can't find the container with id 1312f482d43090ba4eb0bbf182938669d8db0c2e0009507235196c674c6d469f Jun 12 19:20:10.992574 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:10.992484 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" event={"ID":"7e616a13-1fc1-4913-a643-e965d01961d4","Type":"ContainerStarted","Data":"1312f482d43090ba4eb0bbf182938669d8db0c2e0009507235196c674c6d469f"} Jun 12 19:20:14.011619 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:14.011527 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" event={"ID":"7e616a13-1fc1-4913-a643-e965d01961d4","Type":"ContainerStarted","Data":"3995c27ea7b8e9c9bd5c6d87e1821acf2de8922ea0bb8047435d2f6de7c11930"} Jun 12 19:20:15.018287 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:15.018199 2560 generic.go:356] "Generic (PLEG): container finished" podID="7e616a13-1fc1-4913-a643-e965d01961d4" containerID="3995c27ea7b8e9c9bd5c6d87e1821acf2de8922ea0bb8047435d2f6de7c11930" exitCode=0 Jun 12 19:20:15.018287 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:15.018282 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" event={"ID":"7e616a13-1fc1-4913-a643-e965d01961d4","Type":"ContainerDied","Data":"3995c27ea7b8e9c9bd5c6d87e1821acf2de8922ea0bb8047435d2f6de7c11930"} Jun 12 19:20:16.026673 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:16.026640 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" event={"ID":"7e616a13-1fc1-4913-a643-e965d01961d4","Type":"ContainerStarted","Data":"f37928aac8f40fab0428d64227fd8d725ec31f34cad9ba5501e0dbfc24d62519"} Jun 12 19:20:16.027284 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:16.026806 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:16.052120 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:16.052056 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" podStartSLOduration=1.923712268 podStartE2EDuration="6.052038576s" totalImagesPullingTime="3.132485549s" totalInitContainerRuntime="995.840759ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:20:16.050886824 +0000 UTC m=+528.707925964" watchObservedRunningTime="2026-06-12 19:20:16.052038576 +0000 UTC m=+528.709077716" Jun 12 19:20:27.034535 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:27.034499 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-jmjvw" Jun 12 19:20:30.047603 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.047565 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv"] Jun 12 19:20:30.056006 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.055976 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.058968 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.058940 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 19:20:30.059124 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.058941 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 19:20:30.059124 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.058993 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-np2j8\"" Jun 12 19:20:30.067186 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.067153 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv"] Jun 12 19:20:30.122423 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.122382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebbe81e-8c62-48af-92d4-0707f0bf9722-tls-certs\") pod \"kube-auth-proxy-599d4765f4-b6ldv\" (UID: \"6ebbe81e-8c62-48af-92d4-0707f0bf9722\") " pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.122601 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.122450 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnv99\" (UniqueName: \"kubernetes.io/projected/6ebbe81e-8c62-48af-92d4-0707f0bf9722-kube-api-access-gnv99\") pod \"kube-auth-proxy-599d4765f4-b6ldv\" (UID: \"6ebbe81e-8c62-48af-92d4-0707f0bf9722\") " pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.122601 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.122516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ebbe81e-8c62-48af-92d4-0707f0bf9722-tmp\") pod \"kube-auth-proxy-599d4765f4-b6ldv\" (UID: \"6ebbe81e-8c62-48af-92d4-0707f0bf9722\") " pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.223998 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.223959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ebbe81e-8c62-48af-92d4-0707f0bf9722-tmp\") pod \"kube-auth-proxy-599d4765f4-b6ldv\" (UID: \"6ebbe81e-8c62-48af-92d4-0707f0bf9722\") " pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.224197 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.224044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebbe81e-8c62-48af-92d4-0707f0bf9722-tls-certs\") pod \"kube-auth-proxy-599d4765f4-b6ldv\" (UID: \"6ebbe81e-8c62-48af-92d4-0707f0bf9722\") " pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.224197 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.224085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnv99\" (UniqueName: \"kubernetes.io/projected/6ebbe81e-8c62-48af-92d4-0707f0bf9722-kube-api-access-gnv99\") pod \"kube-auth-proxy-599d4765f4-b6ldv\" (UID: \"6ebbe81e-8c62-48af-92d4-0707f0bf9722\") " pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.226554 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.226527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ebbe81e-8c62-48af-92d4-0707f0bf9722-tmp\") pod \"kube-auth-proxy-599d4765f4-b6ldv\" (UID: \"6ebbe81e-8c62-48af-92d4-0707f0bf9722\") " pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.226677 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.226663 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebbe81e-8c62-48af-92d4-0707f0bf9722-tls-certs\") pod \"kube-auth-proxy-599d4765f4-b6ldv\" (UID: \"6ebbe81e-8c62-48af-92d4-0707f0bf9722\") " pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.272778 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.272739 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-79mw8"] Jun 12 19:20:30.273598 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.273571 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnv99\" (UniqueName: \"kubernetes.io/projected/6ebbe81e-8c62-48af-92d4-0707f0bf9722-kube-api-access-gnv99\") pod \"kube-auth-proxy-599d4765f4-b6ldv\" (UID: \"6ebbe81e-8c62-48af-92d4-0707f0bf9722\") " pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.276888 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.276862 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:30.283398 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.283362 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ngg6x\"" Jun 12 19:20:30.295999 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.295976 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 12 19:20:30.324953 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.324858 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-79mw8"] Jun 12 19:20:30.368816 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.368782 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" Jun 12 19:20:30.402549 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.402512 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm"] Jun 12 19:20:30.406906 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.406875 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.410442 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.410276 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 19:20:30.410442 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.410321 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 19:20:30.410635 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.410592 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7zsq\"" Jun 12 19:20:30.426663 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.426470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs88v\" (UniqueName: \"kubernetes.io/projected/82f90a13-fd37-48b3-8e97-2a7eb835e5da-kube-api-access-vs88v\") pod \"odh-model-controller-6dc94f689f-79mw8\" (UID: \"82f90a13-fd37-48b3-8e97-2a7eb835e5da\") " pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:30.426663 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.426534 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82f90a13-fd37-48b3-8e97-2a7eb835e5da-cert\") pod \"odh-model-controller-6dc94f689f-79mw8\" (UID: \"82f90a13-fd37-48b3-8e97-2a7eb835e5da\") " pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:30.429531 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.429499 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm"] Jun 12 19:20:30.527770 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.527728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.527983 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.527779 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.527983 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.527870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fl4x\" (UniqueName: \"kubernetes.io/projected/62b3277e-38c4-4a02-b1d0-35dc7066450c-kube-api-access-8fl4x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.527983 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.527935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs88v\" (UniqueName: \"kubernetes.io/projected/82f90a13-fd37-48b3-8e97-2a7eb835e5da-kube-api-access-vs88v\") pod \"odh-model-controller-6dc94f689f-79mw8\" (UID: \"82f90a13-fd37-48b3-8e97-2a7eb835e5da\") " pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:30.528173 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.527991 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82f90a13-fd37-48b3-8e97-2a7eb835e5da-cert\") pod \"odh-model-controller-6dc94f689f-79mw8\" (UID: \"82f90a13-fd37-48b3-8e97-2a7eb835e5da\") " pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:30.531079 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.531014 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82f90a13-fd37-48b3-8e97-2a7eb835e5da-cert\") pod \"odh-model-controller-6dc94f689f-79mw8\" (UID: \"82f90a13-fd37-48b3-8e97-2a7eb835e5da\") " pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:30.546547 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.546513 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs88v\" (UniqueName: \"kubernetes.io/projected/82f90a13-fd37-48b3-8e97-2a7eb835e5da-kube-api-access-vs88v\") pod \"odh-model-controller-6dc94f689f-79mw8\" (UID: \"82f90a13-fd37-48b3-8e97-2a7eb835e5da\") " pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:30.552185 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.551976 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv"] Jun 12 19:20:30.554815 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:20:30.554785 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ebbe81e_8c62_48af_92d4_0707f0bf9722.slice/crio-955d3e8cd68f7919910a766b63de57a0656fe658289f58fc821d094cb9ff6a14 WatchSource:0}: Error finding container 955d3e8cd68f7919910a766b63de57a0656fe658289f58fc821d094cb9ff6a14: Status 404 returned error can't find the container with id 955d3e8cd68f7919910a766b63de57a0656fe658289f58fc821d094cb9ff6a14 Jun 12 19:20:30.596496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.596405 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:30.628651 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.628617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.628651 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.628657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.628873 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.628680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fl4x\" (UniqueName: \"kubernetes.io/projected/62b3277e-38c4-4a02-b1d0-35dc7066450c-kube-api-access-8fl4x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.629139 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.629122 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.629195 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.629146 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.656114 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.656069 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fl4x\" (UniqueName: \"kubernetes.io/projected/62b3277e-38c4-4a02-b1d0-35dc7066450c-kube-api-access-8fl4x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.721556 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.721241 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:30.765055 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.765011 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-79mw8"] Jun 12 19:20:30.766658 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:20:30.766630 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f90a13_fd37_48b3_8e97_2a7eb835e5da.slice/crio-16d3ffb382187a7ef0d427b7f76e61e5feafc52977a951c4d673aecf530f1b0e WatchSource:0}: Error finding container 16d3ffb382187a7ef0d427b7f76e61e5feafc52977a951c4d673aecf530f1b0e: Status 404 returned error can't find the container with id 16d3ffb382187a7ef0d427b7f76e61e5feafc52977a951c4d673aecf530f1b0e Jun 12 19:20:30.870851 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:30.870823 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm"] Jun 12 19:20:30.872899 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:20:30.872871 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b3277e_38c4_4a02_b1d0_35dc7066450c.slice/crio-8b7fe2cbe267875185025e2537d3d52b17865a2afd47d740eb740d7f8abb4ab1 WatchSource:0}: Error finding container 8b7fe2cbe267875185025e2537d3d52b17865a2afd47d740eb740d7f8abb4ab1: Status 404 returned error can't find the container with id 8b7fe2cbe267875185025e2537d3d52b17865a2afd47d740eb740d7f8abb4ab1 Jun 12 19:20:31.103707 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.103652 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" event={"ID":"6ebbe81e-8c62-48af-92d4-0707f0bf9722","Type":"ContainerStarted","Data":"955d3e8cd68f7919910a766b63de57a0656fe658289f58fc821d094cb9ff6a14"} Jun 12 19:20:31.105483 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.105445 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" event={"ID":"82f90a13-fd37-48b3-8e97-2a7eb835e5da","Type":"ContainerStarted","Data":"16d3ffb382187a7ef0d427b7f76e61e5feafc52977a951c4d673aecf530f1b0e"} Jun 12 19:20:31.109184 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.108250 2560 generic.go:356] "Generic (PLEG): container finished" podID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerID="61c53e34f0b46368c580d687be7969ba7a95d254044fd4959b7102342056a231" exitCode=0 Jun 12 19:20:31.109184 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.108291 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" event={"ID":"62b3277e-38c4-4a02-b1d0-35dc7066450c","Type":"ContainerDied","Data":"61c53e34f0b46368c580d687be7969ba7a95d254044fd4959b7102342056a231"} Jun 12 19:20:31.109184 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.108329 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" event={"ID":"62b3277e-38c4-4a02-b1d0-35dc7066450c","Type":"ContainerStarted","Data":"8b7fe2cbe267875185025e2537d3d52b17865a2afd47d740eb740d7f8abb4ab1"} Jun 12 19:20:31.222851 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.222751 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-lj48x"] Jun 12 19:20:31.232450 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.232419 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:31.236397 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.235981 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 12 19:20:31.236397 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.236246 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-dphw4\"" Jun 12 19:20:31.239023 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.238885 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-lj48x"] Jun 12 19:20:31.335251 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.335208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c3b5998-8562-4259-a712-6091067c0a57-tls-certs\") pod \"model-serving-api-5dd488fc48-lj48x\" (UID: \"5c3b5998-8562-4259-a712-6091067c0a57\") " pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:31.335458 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.335282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzbg8\" (UniqueName: \"kubernetes.io/projected/5c3b5998-8562-4259-a712-6091067c0a57-kube-api-access-xzbg8\") pod \"model-serving-api-5dd488fc48-lj48x\" (UID: \"5c3b5998-8562-4259-a712-6091067c0a57\") " pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:31.436940 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.436544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c3b5998-8562-4259-a712-6091067c0a57-tls-certs\") pod \"model-serving-api-5dd488fc48-lj48x\" (UID: \"5c3b5998-8562-4259-a712-6091067c0a57\") " pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:31.436940 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.436609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzbg8\" (UniqueName: \"kubernetes.io/projected/5c3b5998-8562-4259-a712-6091067c0a57-kube-api-access-xzbg8\") pod \"model-serving-api-5dd488fc48-lj48x\" (UID: \"5c3b5998-8562-4259-a712-6091067c0a57\") " pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:31.436940 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:20:31.436745 2560 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 12 19:20:31.436940 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:20:31.436810 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c3b5998-8562-4259-a712-6091067c0a57-tls-certs podName:5c3b5998-8562-4259-a712-6091067c0a57 nodeName:}" failed. No retries permitted until 2026-06-12 19:20:31.936789318 +0000 UTC m=+544.593828434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5c3b5998-8562-4259-a712-6091067c0a57-tls-certs") pod "model-serving-api-5dd488fc48-lj48x" (UID: "5c3b5998-8562-4259-a712-6091067c0a57") : secret "model-serving-api-tls" not found Jun 12 19:20:31.453456 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.453417 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzbg8\" (UniqueName: \"kubernetes.io/projected/5c3b5998-8562-4259-a712-6091067c0a57-kube-api-access-xzbg8\") pod \"model-serving-api-5dd488fc48-lj48x\" (UID: \"5c3b5998-8562-4259-a712-6091067c0a57\") " pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:31.942258 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.942218 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c3b5998-8562-4259-a712-6091067c0a57-tls-certs\") pod \"model-serving-api-5dd488fc48-lj48x\" (UID: \"5c3b5998-8562-4259-a712-6091067c0a57\") " pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:31.951538 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:31.951456 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c3b5998-8562-4259-a712-6091067c0a57-tls-certs\") pod \"model-serving-api-5dd488fc48-lj48x\" (UID: \"5c3b5998-8562-4259-a712-6091067c0a57\") " pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:32.130271 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.129246 2560 generic.go:356] "Generic (PLEG): container finished" podID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerID="25b1366894a2199045073d6229338e92f3ec67b433a1984602ec74bb9140c209" exitCode=0 Jun 12 19:20:32.130271 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.129298 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" event={"ID":"62b3277e-38c4-4a02-b1d0-35dc7066450c","Type":"ContainerDied","Data":"25b1366894a2199045073d6229338e92f3ec67b433a1984602ec74bb9140c209"} Jun 12 19:20:32.170297 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.170264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:32.426391 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.426351 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-lj48x"] Jun 12 19:20:32.979158 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.979121 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf"] Jun 12 19:20:32.983930 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.983888 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:32.986675 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.986645 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 19:20:32.987891 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.987831 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 19:20:32.987891 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.987864 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p96q2\"" Jun 12 19:20:32.988099 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.988088 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 19:20:32.994598 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:32.994557 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf"] Jun 12 19:20:33.056785 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.056736 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a6ab9fd-902b-4be5-a139-056fbb97ac16-metrics-cert\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.056785 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.056792 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a6ab9fd-902b-4be5-a139-056fbb97ac16-cert\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.057027 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.056887 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhk2h\" (UniqueName: \"kubernetes.io/projected/0a6ab9fd-902b-4be5-a139-056fbb97ac16-kube-api-access-fhk2h\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.057027 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.056966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a6ab9fd-902b-4be5-a139-056fbb97ac16-manager-config\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.138738 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.138693 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" event={"ID":"62b3277e-38c4-4a02-b1d0-35dc7066450c","Type":"ContainerStarted","Data":"5ffe81b7e1d68b719bce278a89cf0a3d63d3a056984e2cf1511d58c412380b4e"} Jun 12 19:20:33.158280 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.158232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhk2h\" (UniqueName: \"kubernetes.io/projected/0a6ab9fd-902b-4be5-a139-056fbb97ac16-kube-api-access-fhk2h\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.158442 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.158322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a6ab9fd-902b-4be5-a139-056fbb97ac16-manager-config\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.158442 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.158403 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a6ab9fd-902b-4be5-a139-056fbb97ac16-metrics-cert\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.158442 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.158430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a6ab9fd-902b-4be5-a139-056fbb97ac16-cert\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.159240 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.159210 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a6ab9fd-902b-4be5-a139-056fbb97ac16-manager-config\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.161747 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.161713 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a6ab9fd-902b-4be5-a139-056fbb97ac16-metrics-cert\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.162347 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.162320 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a6ab9fd-902b-4be5-a139-056fbb97ac16-cert\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.164957 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.164889 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" podStartSLOduration=2.392685304 podStartE2EDuration="3.164868588s" totalImagesPullingTime="772.183284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:20:33.160528985 +0000 UTC m=+545.817568124" watchObservedRunningTime="2026-06-12 19:20:33.164868588 +0000 UTC m=+545.821907727" Jun 12 19:20:33.175366 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.175336 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhk2h\" (UniqueName: \"kubernetes.io/projected/0a6ab9fd-902b-4be5-a139-056fbb97ac16-kube-api-access-fhk2h\") pod \"lws-controller-manager-7d7db986fb-9vnxf\" (UID: \"0a6ab9fd-902b-4be5-a139-056fbb97ac16\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:33.295395 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:33.295310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:34.147316 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:34.147278 2560 generic.go:356] "Generic (PLEG): container finished" podID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerID="5ffe81b7e1d68b719bce278a89cf0a3d63d3a056984e2cf1511d58c412380b4e" exitCode=0 Jun 12 19:20:34.147806 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:34.147405 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" event={"ID":"62b3277e-38c4-4a02-b1d0-35dc7066450c","Type":"ContainerDied","Data":"5ffe81b7e1d68b719bce278a89cf0a3d63d3a056984e2cf1511d58c412380b4e"} Jun 12 19:20:34.715791 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:20:34.715749 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3b5998_8562_4259_a712_6091067c0a57.slice/crio-66abd4ace49faaf0946bf8d3ae45749ca5fb5a0a2ac4f264ca18b19286274a51 WatchSource:0}: Error finding container 66abd4ace49faaf0946bf8d3ae45749ca5fb5a0a2ac4f264ca18b19286274a51: Status 404 returned error can't find the container with id 66abd4ace49faaf0946bf8d3ae45749ca5fb5a0a2ac4f264ca18b19286274a51 Jun 12 19:20:35.156011 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.155967 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-lj48x" event={"ID":"5c3b5998-8562-4259-a712-6091067c0a57","Type":"ContainerStarted","Data":"66abd4ace49faaf0946bf8d3ae45749ca5fb5a0a2ac4f264ca18b19286274a51"} Jun 12 19:20:35.362498 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.362466 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:35.482137 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.482095 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-bundle\") pod \"62b3277e-38c4-4a02-b1d0-35dc7066450c\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " Jun 12 19:20:35.482369 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.482204 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-util\") pod \"62b3277e-38c4-4a02-b1d0-35dc7066450c\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " Jun 12 19:20:35.482369 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.482294 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fl4x\" (UniqueName: \"kubernetes.io/projected/62b3277e-38c4-4a02-b1d0-35dc7066450c-kube-api-access-8fl4x\") pod \"62b3277e-38c4-4a02-b1d0-35dc7066450c\" (UID: \"62b3277e-38c4-4a02-b1d0-35dc7066450c\") " Jun 12 19:20:35.483343 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.483316 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-bundle" (OuterVolumeSpecName: "bundle") pod "62b3277e-38c4-4a02-b1d0-35dc7066450c" (UID: "62b3277e-38c4-4a02-b1d0-35dc7066450c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:20:35.485723 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.485697 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62b3277e-38c4-4a02-b1d0-35dc7066450c-kube-api-access-8fl4x" (OuterVolumeSpecName: "kube-api-access-8fl4x") pod "62b3277e-38c4-4a02-b1d0-35dc7066450c" (UID: "62b3277e-38c4-4a02-b1d0-35dc7066450c"). InnerVolumeSpecName "kube-api-access-8fl4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:20:35.487289 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.487266 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-util" (OuterVolumeSpecName: "util") pod "62b3277e-38c4-4a02-b1d0-35dc7066450c" (UID: "62b3277e-38c4-4a02-b1d0-35dc7066450c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:20:35.501578 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.501549 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf"] Jun 12 19:20:35.504719 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:20:35.504687 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6ab9fd_902b_4be5_a139_056fbb97ac16.slice/crio-8aba7bb6191f21591db1e49c841e9c8234c746762738570cd107fbb11ba2547d WatchSource:0}: Error finding container 8aba7bb6191f21591db1e49c841e9c8234c746762738570cd107fbb11ba2547d: Status 404 returned error can't find the container with id 8aba7bb6191f21591db1e49c841e9c8234c746762738570cd107fbb11ba2547d Jun 12 19:20:35.583327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.583293 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:20:35.583327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.583325 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fl4x\" (UniqueName: \"kubernetes.io/projected/62b3277e-38c4-4a02-b1d0-35dc7066450c-kube-api-access-8fl4x\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:20:35.583327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:35.583336 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b3277e-38c4-4a02-b1d0-35dc7066450c-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:20:36.163815 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:36.163774 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" event={"ID":"6ebbe81e-8c62-48af-92d4-0707f0bf9722","Type":"ContainerStarted","Data":"54c3499d061501e2cbf4258f8c9cd3570249a5bdc660e75c2cab24a16e6e60b4"} Jun 12 19:20:36.165909 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:36.165870 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" event={"ID":"82f90a13-fd37-48b3-8e97-2a7eb835e5da","Type":"ContainerStarted","Data":"342202f5a97c1b233dcb544bc475fb7d4fb33e25991b9670cebbea616a59edc8"} Jun 12 19:20:36.166104 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:36.166068 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:36.167498 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:36.167467 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" event={"ID":"0a6ab9fd-902b-4be5-a139-056fbb97ac16","Type":"ContainerStarted","Data":"8aba7bb6191f21591db1e49c841e9c8234c746762738570cd107fbb11ba2547d"} Jun 12 19:20:36.169594 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:36.169567 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" event={"ID":"62b3277e-38c4-4a02-b1d0-35dc7066450c","Type":"ContainerDied","Data":"8b7fe2cbe267875185025e2537d3d52b17865a2afd47d740eb740d7f8abb4ab1"} Jun 12 19:20:36.169687 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:36.169613 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b7fe2cbe267875185025e2537d3d52b17865a2afd47d740eb740d7f8abb4ab1" Jun 12 19:20:36.169687 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:36.169608 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062nchm" Jun 12 19:20:36.188536 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:36.188471 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-599d4765f4-b6ldv" podStartSLOduration=1.395396165 podStartE2EDuration="6.188452185s" totalImagesPullingTime="4.79305602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:20:36.187646361 +0000 UTC m=+548.844685502" watchObservedRunningTime="2026-06-12 19:20:36.188452185 +0000 UTC m=+548.845491324" Jun 12 19:20:36.210965 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:36.210423 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" podStartSLOduration=1.628168315 podStartE2EDuration="6.210381009s" totalImagesPullingTime="4.582212694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:20:36.208155653 +0000 UTC m=+548.865194794" watchObservedRunningTime="2026-06-12 19:20:36.210381009 +0000 UTC m=+548.867420149" Jun 12 19:20:37.177995 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:37.177950 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-lj48x" event={"ID":"5c3b5998-8562-4259-a712-6091067c0a57","Type":"ContainerStarted","Data":"81a5e2973a616ff795b1f157c4edd2deaa5efb37df6cfa11d6fdd85f2b96be3c"} Jun 12 19:20:37.178474 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:37.178174 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:37.180500 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:37.180242 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" event={"ID":"0a6ab9fd-902b-4be5-a139-056fbb97ac16","Type":"ContainerStarted","Data":"0dcacab895e791e2fbb78b946e1f223ebcea2c892f3cd267a037c51e6cca099c"} Jun 12 19:20:37.201510 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:37.201452 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-lj48x" podStartSLOduration=3.858788056 podStartE2EDuration="6.20143388s" totalImagesPullingTime="2.342645824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:20:37.20077631 +0000 UTC m=+549.857815448" watchObservedRunningTime="2026-06-12 19:20:37.20143388 +0000 UTC m=+549.858473019" Jun 12 19:20:37.220361 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:37.220290 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" podStartSLOduration=3.6646177250000003 podStartE2EDuration="5.220258693s" totalImagesPullingTime="1.555640968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:20:37.217607739 +0000 UTC m=+549.874646878" watchObservedRunningTime="2026-06-12 19:20:37.220258693 +0000 UTC m=+549.877297836" Jun 12 19:20:38.185043 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:38.185000 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:44.639701 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.639656 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b"] Jun 12 19:20:44.640248 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.640226 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerName="extract" Jun 12 19:20:44.640327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.640251 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerName="extract" Jun 12 19:20:44.640327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.640282 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerName="pull" Jun 12 19:20:44.640327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.640290 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerName="pull" Jun 12 19:20:44.640327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.640302 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerName="util" Jun 12 19:20:44.640327 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.640310 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerName="util" Jun 12 19:20:44.640585 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.640416 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="62b3277e-38c4-4a02-b1d0-35dc7066450c" containerName="extract" Jun 12 19:20:44.725310 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.725269 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b"] Jun 12 19:20:44.725526 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.725400 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:44.749209 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.749179 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 19:20:44.749411 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.749225 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 19:20:44.749411 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.749288 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7zsq\"" Jun 12 19:20:44.767543 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.767510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:44.767727 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.767552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:44.767727 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.767578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lrcw\" (UniqueName: \"kubernetes.io/projected/6f15dac2-136a-4d08-81de-13585a054848-kube-api-access-4lrcw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:44.868611 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.868573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:44.868611 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.868610 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:44.868857 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.868631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lrcw\" (UniqueName: \"kubernetes.io/projected/6f15dac2-136a-4d08-81de-13585a054848-kube-api-access-4lrcw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:44.869032 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.869009 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:44.869111 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.869041 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:44.939897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:44.939804 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lrcw\" (UniqueName: \"kubernetes.io/projected/6f15dac2-136a-4d08-81de-13585a054848-kube-api-access-4lrcw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:45.035352 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:45.035312 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:45.236023 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:45.235994 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b"] Jun 12 19:20:45.238038 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:20:45.238008 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f15dac2_136a_4d08_81de_13585a054848.slice/crio-d35bdc43ad7c4cdd5a502e2346651a3aca114aff09060d9c1b172ed9e9a04f13 WatchSource:0}: Error finding container d35bdc43ad7c4cdd5a502e2346651a3aca114aff09060d9c1b172ed9e9a04f13: Status 404 returned error can't find the container with id d35bdc43ad7c4cdd5a502e2346651a3aca114aff09060d9c1b172ed9e9a04f13 Jun 12 19:20:46.231456 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:46.231348 2560 generic.go:356] "Generic (PLEG): container finished" podID="6f15dac2-136a-4d08-81de-13585a054848" containerID="46e7088b2a9b141ccd22e22550f813dfd5e9b3227f3a0ecd5ba5fa2e20343457" exitCode=0 Jun 12 19:20:46.231881 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:46.231451 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" event={"ID":"6f15dac2-136a-4d08-81de-13585a054848","Type":"ContainerDied","Data":"46e7088b2a9b141ccd22e22550f813dfd5e9b3227f3a0ecd5ba5fa2e20343457"} Jun 12 19:20:46.231881 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:46.231605 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" event={"ID":"6f15dac2-136a-4d08-81de-13585a054848","Type":"ContainerStarted","Data":"d35bdc43ad7c4cdd5a502e2346651a3aca114aff09060d9c1b172ed9e9a04f13"} Jun 12 19:20:47.183052 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:47.183025 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-79mw8" Jun 12 19:20:47.238163 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:47.238130 2560 generic.go:356] "Generic (PLEG): container finished" podID="6f15dac2-136a-4d08-81de-13585a054848" containerID="c7d11bff93440f30c894ca6c35956d5019d626035d58dbe95d63ac5fb5a76c2e" exitCode=0 Jun 12 19:20:47.238544 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:47.238192 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" event={"ID":"6f15dac2-136a-4d08-81de-13585a054848","Type":"ContainerDied","Data":"c7d11bff93440f30c894ca6c35956d5019d626035d58dbe95d63ac5fb5a76c2e"} Jun 12 19:20:48.189209 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:48.189177 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-lj48x" Jun 12 19:20:48.245705 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:48.245663 2560 generic.go:356] "Generic (PLEG): container finished" podID="6f15dac2-136a-4d08-81de-13585a054848" containerID="7d9c9c20f5ae6f56f8ac3c3e66cae9318207a050bc630639da49120237ef69b2" exitCode=0 Jun 12 19:20:48.246075 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:48.245738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" event={"ID":"6f15dac2-136a-4d08-81de-13585a054848","Type":"ContainerDied","Data":"7d9c9c20f5ae6f56f8ac3c3e66cae9318207a050bc630639da49120237ef69b2"} Jun 12 19:20:49.193072 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.193042 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-9vnxf" Jun 12 19:20:49.391618 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.391590 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:49.409389 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.409355 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-bundle\") pod \"6f15dac2-136a-4d08-81de-13585a054848\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " Jun 12 19:20:49.409590 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.409409 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-util\") pod \"6f15dac2-136a-4d08-81de-13585a054848\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " Jun 12 19:20:49.409590 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.409440 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lrcw\" (UniqueName: \"kubernetes.io/projected/6f15dac2-136a-4d08-81de-13585a054848-kube-api-access-4lrcw\") pod \"6f15dac2-136a-4d08-81de-13585a054848\" (UID: \"6f15dac2-136a-4d08-81de-13585a054848\") " Jun 12 19:20:49.410360 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.410339 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-bundle" (OuterVolumeSpecName: "bundle") pod "6f15dac2-136a-4d08-81de-13585a054848" (UID: "6f15dac2-136a-4d08-81de-13585a054848"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:20:49.411854 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.411831 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f15dac2-136a-4d08-81de-13585a054848-kube-api-access-4lrcw" (OuterVolumeSpecName: "kube-api-access-4lrcw") pod "6f15dac2-136a-4d08-81de-13585a054848" (UID: "6f15dac2-136a-4d08-81de-13585a054848"). InnerVolumeSpecName "kube-api-access-4lrcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:20:49.415250 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.415220 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-util" (OuterVolumeSpecName: "util") pod "6f15dac2-136a-4d08-81de-13585a054848" (UID: "6f15dac2-136a-4d08-81de-13585a054848"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:20:49.510537 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.510428 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:20:49.510537 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.510468 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f15dac2-136a-4d08-81de-13585a054848-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:20:49.510537 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:49.510477 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lrcw\" (UniqueName: \"kubernetes.io/projected/6f15dac2-136a-4d08-81de-13585a054848-kube-api-access-4lrcw\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:20:50.258758 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:50.258729 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" Jun 12 19:20:50.258906 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:50.258761 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acmp9b" event={"ID":"6f15dac2-136a-4d08-81de-13585a054848","Type":"ContainerDied","Data":"d35bdc43ad7c4cdd5a502e2346651a3aca114aff09060d9c1b172ed9e9a04f13"} Jun 12 19:20:50.258906 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:20:50.258808 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d35bdc43ad7c4cdd5a502e2346651a3aca114aff09060d9c1b172ed9e9a04f13" Jun 12 19:21:27.771055 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:27.771022 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:21:27.771552 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:27.771287 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:21:46.492087 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.492005 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8"] Jun 12 19:21:46.494323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.492402 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f15dac2-136a-4d08-81de-13585a054848" containerName="util" Jun 12 19:21:46.494323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.492414 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f15dac2-136a-4d08-81de-13585a054848" containerName="util" Jun 12 19:21:46.494323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.492423 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f15dac2-136a-4d08-81de-13585a054848" containerName="pull" Jun 12 19:21:46.494323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.492428 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f15dac2-136a-4d08-81de-13585a054848" containerName="pull" Jun 12 19:21:46.494323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.492435 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f15dac2-136a-4d08-81de-13585a054848" containerName="extract" Jun 12 19:21:46.494323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.492440 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f15dac2-136a-4d08-81de-13585a054848" containerName="extract" Jun 12 19:21:46.494323 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.492501 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f15dac2-136a-4d08-81de-13585a054848" containerName="extract" Jun 12 19:21:46.495580 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.495564 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.498346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.498320 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 19:21:46.499350 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.499327 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 19:21:46.499454 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.499392 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7f9z8\"" Jun 12 19:21:46.504793 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.504771 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8"] Jun 12 19:21:46.527067 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.527031 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.527247 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.527090 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.527247 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.527214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfkzk\" (UniqueName: \"kubernetes.io/projected/07890a39-6c52-473c-9c13-bb649eabf8d8-kube-api-access-hfkzk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.628116 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.628080 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfkzk\" (UniqueName: \"kubernetes.io/projected/07890a39-6c52-473c-9c13-bb649eabf8d8-kube-api-access-hfkzk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.628302 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.628140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.628302 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.628187 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.628548 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.628527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.628598 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.628566 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.637205 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.637176 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfkzk\" (UniqueName: \"kubernetes.io/projected/07890a39-6c52-473c-9c13-bb649eabf8d8-kube-api-access-hfkzk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.805797 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.805709 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:46.951514 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:46.951486 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8"] Jun 12 19:21:46.953026 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:21:46.952995 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07890a39_6c52_473c_9c13_bb649eabf8d8.slice/crio-7e7bb1b0adbee4eeb4e2e9e07ccfc9616536c53c95eb8bf33ba820fb55075535 WatchSource:0}: Error finding container 7e7bb1b0adbee4eeb4e2e9e07ccfc9616536c53c95eb8bf33ba820fb55075535: Status 404 returned error can't find the container with id 7e7bb1b0adbee4eeb4e2e9e07ccfc9616536c53c95eb8bf33ba820fb55075535 Jun 12 19:21:47.058027 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.057946 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx"] Jun 12 19:21:47.062099 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.062069 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.072583 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.072550 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx"] Jun 12 19:21:47.133801 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.133767 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.133990 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.133818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.133990 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.133840 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfd47\" (UniqueName: \"kubernetes.io/projected/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-kube-api-access-sfd47\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.234968 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.234893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.235167 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.234994 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.235167 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.235025 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfd47\" (UniqueName: \"kubernetes.io/projected/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-kube-api-access-sfd47\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.235288 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.235268 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.235357 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.235338 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.245332 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.245304 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfd47\" (UniqueName: \"kubernetes.io/projected/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-kube-api-access-sfd47\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.427037 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.427000 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:47.554508 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.554475 2560 generic.go:356] "Generic (PLEG): container finished" podID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerID="e3f4129273fb30a999b40e617cf7d6f70118e9f2366ce831207aaedd3e136558" exitCode=0 Jun 12 19:21:47.554898 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.554550 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" event={"ID":"07890a39-6c52-473c-9c13-bb649eabf8d8","Type":"ContainerDied","Data":"e3f4129273fb30a999b40e617cf7d6f70118e9f2366ce831207aaedd3e136558"} Jun 12 19:21:47.554898 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.554606 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" event={"ID":"07890a39-6c52-473c-9c13-bb649eabf8d8","Type":"ContainerStarted","Data":"7e7bb1b0adbee4eeb4e2e9e07ccfc9616536c53c95eb8bf33ba820fb55075535"} Jun 12 19:21:47.567903 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.567879 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx"] Jun 12 19:21:47.569762 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:21:47.569726 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdf61d3_2d1b_48ea_9f62_d7ddf0a65ef4.slice/crio-0dc88baeca41a010a25e98b32f8c1e8da37cb01b7b11293b098b00038966b4b9 WatchSource:0}: Error finding container 0dc88baeca41a010a25e98b32f8c1e8da37cb01b7b11293b098b00038966b4b9: Status 404 returned error can't find the container with id 0dc88baeca41a010a25e98b32f8c1e8da37cb01b7b11293b098b00038966b4b9 Jun 12 19:21:47.641711 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.641675 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq"] Jun 12 19:21:47.646502 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.646479 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.656633 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.656600 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq"] Jun 12 19:21:47.741854 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.741808 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4fc2\" (UniqueName: \"kubernetes.io/projected/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-kube-api-access-j4fc2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.742053 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.741907 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.742053 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.742018 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.843453 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.843412 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4fc2\" (UniqueName: \"kubernetes.io/projected/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-kube-api-access-j4fc2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.843626 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.843483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.843626 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.843528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.843880 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.843863 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.843974 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.843954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.860700 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.860657 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4fc2\" (UniqueName: \"kubernetes.io/projected/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-kube-api-access-j4fc2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:47.962978 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:47.962895 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:48.043528 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.043493 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn"] Jun 12 19:21:48.047702 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.047671 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.063954 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.063900 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn"] Jun 12 19:21:48.126668 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.126638 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq"] Jun 12 19:21:48.145841 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.145805 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.145841 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.145844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.146084 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.145875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrtw5\" (UniqueName: \"kubernetes.io/projected/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-kube-api-access-jrtw5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.147982 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:21:48.147954 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01dec74f_5be0_46e9_8cf6_8344b4a8bce8.slice/crio-b45652256ffd33777b211858502c340245793f1e136fb4d3721e4bf33f95aa18 WatchSource:0}: Error finding container b45652256ffd33777b211858502c340245793f1e136fb4d3721e4bf33f95aa18: Status 404 returned error can't find the container with id b45652256ffd33777b211858502c340245793f1e136fb4d3721e4bf33f95aa18 Jun 12 19:21:48.247308 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.247214 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.247308 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.247259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.247308 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.247295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrtw5\" (UniqueName: \"kubernetes.io/projected/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-kube-api-access-jrtw5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.247685 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.247660 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.247739 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.247720 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.257617 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.257584 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrtw5\" (UniqueName: \"kubernetes.io/projected/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-kube-api-access-jrtw5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.360096 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.360055 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:48.510511 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.510486 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn"] Jun 12 19:21:48.512466 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:21:48.512436 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e62e2b_8e5a_4736_992d_040ae8d1e8b2.slice/crio-e2065f7426532f6c498e116a577ff15fdeba9bf7569edeebe6e59b2073f87028 WatchSource:0}: Error finding container e2065f7426532f6c498e116a577ff15fdeba9bf7569edeebe6e59b2073f87028: Status 404 returned error can't find the container with id e2065f7426532f6c498e116a577ff15fdeba9bf7569edeebe6e59b2073f87028 Jun 12 19:21:48.564775 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.564746 2560 generic.go:356] "Generic (PLEG): container finished" podID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerID="ac35fb234468a840ec5a86db92ed6b6aebd5df410fc99fb8a5abde7da2bf72a8" exitCode=0 Jun 12 19:21:48.565193 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.564829 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" event={"ID":"07890a39-6c52-473c-9c13-bb649eabf8d8","Type":"ContainerDied","Data":"ac35fb234468a840ec5a86db92ed6b6aebd5df410fc99fb8a5abde7da2bf72a8"} Jun 12 19:21:48.566385 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.566273 2560 generic.go:356] "Generic (PLEG): container finished" podID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerID="8a72ee4bdbb8103ec481db88a4cad8a002645db2b2cd4c31572011a74d14a6a3" exitCode=0 Jun 12 19:21:48.566385 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.566332 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" event={"ID":"01dec74f-5be0-46e9-8cf6-8344b4a8bce8","Type":"ContainerDied","Data":"8a72ee4bdbb8103ec481db88a4cad8a002645db2b2cd4c31572011a74d14a6a3"} Jun 12 19:21:48.566385 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.566362 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" event={"ID":"01dec74f-5be0-46e9-8cf6-8344b4a8bce8","Type":"ContainerStarted","Data":"b45652256ffd33777b211858502c340245793f1e136fb4d3721e4bf33f95aa18"} Jun 12 19:21:48.568052 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.568031 2560 generic.go:356] "Generic (PLEG): container finished" podID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerID="befac348f7a9d63bdd84758b56bcb594fdc547b8d80e15078d99ff636a9e63d6" exitCode=0 Jun 12 19:21:48.568163 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.568118 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" event={"ID":"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4","Type":"ContainerDied","Data":"befac348f7a9d63bdd84758b56bcb594fdc547b8d80e15078d99ff636a9e63d6"} Jun 12 19:21:48.568233 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.568187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" event={"ID":"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4","Type":"ContainerStarted","Data":"0dc88baeca41a010a25e98b32f8c1e8da37cb01b7b11293b098b00038966b4b9"} Jun 12 19:21:48.569947 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:48.569791 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" event={"ID":"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2","Type":"ContainerStarted","Data":"e2065f7426532f6c498e116a577ff15fdeba9bf7569edeebe6e59b2073f87028"} Jun 12 19:21:49.577486 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:49.577452 2560 generic.go:356] "Generic (PLEG): container finished" podID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerID="716ea72e5a30a7c6a6acde21f4b5a09a1419c952fd9ca496ea3ce0f5c5fb97cb" exitCode=0 Jun 12 19:21:49.577935 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:49.577544 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" event={"ID":"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2","Type":"ContainerDied","Data":"716ea72e5a30a7c6a6acde21f4b5a09a1419c952fd9ca496ea3ce0f5c5fb97cb"} Jun 12 19:21:49.579867 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:49.579848 2560 generic.go:356] "Generic (PLEG): container finished" podID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerID="b60ebdb5d76d995c81489a49ef09c6abccbb1cb6aa2fd722f097d438d276a185" exitCode=0 Jun 12 19:21:49.579987 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:49.579961 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" event={"ID":"07890a39-6c52-473c-9c13-bb649eabf8d8","Type":"ContainerDied","Data":"b60ebdb5d76d995c81489a49ef09c6abccbb1cb6aa2fd722f097d438d276a185"} Jun 12 19:21:49.581634 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:49.581612 2560 generic.go:356] "Generic (PLEG): container finished" podID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerID="0f9f8a8e0f012d19db9bebcc50d0cd56bcef25b6c6aaf1c103fed790b2954765" exitCode=0 Jun 12 19:21:49.581725 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:49.581673 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" event={"ID":"01dec74f-5be0-46e9-8cf6-8344b4a8bce8","Type":"ContainerDied","Data":"0f9f8a8e0f012d19db9bebcc50d0cd56bcef25b6c6aaf1c103fed790b2954765"} Jun 12 19:21:49.583590 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:49.583567 2560 generic.go:356] "Generic (PLEG): container finished" podID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerID="c0929037772cca41f7d9dd758ac6d700b9d1e5652b25cefcd174928f164aa82e" exitCode=0 Jun 12 19:21:49.583706 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:49.583643 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" event={"ID":"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4","Type":"ContainerDied","Data":"c0929037772cca41f7d9dd758ac6d700b9d1e5652b25cefcd174928f164aa82e"} Jun 12 19:21:50.591309 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.591273 2560 generic.go:356] "Generic (PLEG): container finished" podID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerID="2562e1022c0e7d78fcd35cad72ffd7ddd4f86527700d944193a8865dfb777a20" exitCode=0 Jun 12 19:21:50.591738 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.591359 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" event={"ID":"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2","Type":"ContainerDied","Data":"2562e1022c0e7d78fcd35cad72ffd7ddd4f86527700d944193a8865dfb777a20"} Jun 12 19:21:50.593888 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.593863 2560 generic.go:356] "Generic (PLEG): container finished" podID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerID="8cb5681624283938767c7875c128b7b1a2d741db3baa35b6e8ec22d8c46e2be6" exitCode=0 Jun 12 19:21:50.594000 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.593966 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" event={"ID":"01dec74f-5be0-46e9-8cf6-8344b4a8bce8","Type":"ContainerDied","Data":"8cb5681624283938767c7875c128b7b1a2d741db3baa35b6e8ec22d8c46e2be6"} Jun 12 19:21:50.596128 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.596105 2560 generic.go:356] "Generic (PLEG): container finished" podID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerID="02704f7555f235b5e58cc81b510b8e40471dbcd0a883a89a137e73086c265611" exitCode=0 Jun 12 19:21:50.596253 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.596239 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" event={"ID":"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4","Type":"ContainerDied","Data":"02704f7555f235b5e58cc81b510b8e40471dbcd0a883a89a137e73086c265611"} Jun 12 19:21:50.807332 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.807305 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:50.871838 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.871812 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-bundle\") pod \"07890a39-6c52-473c-9c13-bb649eabf8d8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " Jun 12 19:21:50.872012 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.871867 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-util\") pod \"07890a39-6c52-473c-9c13-bb649eabf8d8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " Jun 12 19:21:50.872012 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.871907 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfkzk\" (UniqueName: \"kubernetes.io/projected/07890a39-6c52-473c-9c13-bb649eabf8d8-kube-api-access-hfkzk\") pod \"07890a39-6c52-473c-9c13-bb649eabf8d8\" (UID: \"07890a39-6c52-473c-9c13-bb649eabf8d8\") " Jun 12 19:21:50.872484 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.872445 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-bundle" (OuterVolumeSpecName: "bundle") pod "07890a39-6c52-473c-9c13-bb649eabf8d8" (UID: "07890a39-6c52-473c-9c13-bb649eabf8d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:21:50.874360 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.874337 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07890a39-6c52-473c-9c13-bb649eabf8d8-kube-api-access-hfkzk" (OuterVolumeSpecName: "kube-api-access-hfkzk") pod "07890a39-6c52-473c-9c13-bb649eabf8d8" (UID: "07890a39-6c52-473c-9c13-bb649eabf8d8"). InnerVolumeSpecName "kube-api-access-hfkzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:21:50.880241 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.880192 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-util" (OuterVolumeSpecName: "util") pod "07890a39-6c52-473c-9c13-bb649eabf8d8" (UID: "07890a39-6c52-473c-9c13-bb649eabf8d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:21:50.973171 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.973136 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfkzk\" (UniqueName: \"kubernetes.io/projected/07890a39-6c52-473c-9c13-bb649eabf8d8-kube-api-access-hfkzk\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:50.973171 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.973166 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:50.973171 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:50.973176 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07890a39-6c52-473c-9c13-bb649eabf8d8-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:51.608821 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.608782 2560 generic.go:356] "Generic (PLEG): container finished" podID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerID="d1358220cfa9c709231737116f664638b56fa722e52cfbd2df533444f7edd7eb" exitCode=0 Jun 12 19:21:51.609233 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.608872 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" event={"ID":"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2","Type":"ContainerDied","Data":"d1358220cfa9c709231737116f664638b56fa722e52cfbd2df533444f7edd7eb"} Jun 12 19:21:51.610856 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.610833 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" Jun 12 19:21:51.610856 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.610844 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8" event={"ID":"07890a39-6c52-473c-9c13-bb649eabf8d8","Type":"ContainerDied","Data":"7e7bb1b0adbee4eeb4e2e9e07ccfc9616536c53c95eb8bf33ba820fb55075535"} Jun 12 19:21:51.611041 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.610884 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e7bb1b0adbee4eeb4e2e9e07ccfc9616536c53c95eb8bf33ba820fb55075535" Jun 12 19:21:51.761434 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.761405 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:51.792372 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.792348 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:51.886000 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.885962 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-bundle\") pod \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " Jun 12 19:21:51.886000 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.886013 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfd47\" (UniqueName: \"kubernetes.io/projected/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-kube-api-access-sfd47\") pod \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " Jun 12 19:21:51.886276 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.886059 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-util\") pod \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " Jun 12 19:21:51.886276 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.886080 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4fc2\" (UniqueName: \"kubernetes.io/projected/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-kube-api-access-j4fc2\") pod \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " Jun 12 19:21:51.886276 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.886123 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-util\") pod \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\" (UID: \"01dec74f-5be0-46e9-8cf6-8344b4a8bce8\") " Jun 12 19:21:51.886276 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.886170 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-bundle\") pod \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\" (UID: \"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4\") " Jun 12 19:21:51.886597 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.886572 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-bundle" (OuterVolumeSpecName: "bundle") pod "01dec74f-5be0-46e9-8cf6-8344b4a8bce8" (UID: "01dec74f-5be0-46e9-8cf6-8344b4a8bce8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:21:51.886759 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.886714 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-bundle" (OuterVolumeSpecName: "bundle") pod "fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" (UID: "fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:21:51.888423 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.888390 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-kube-api-access-j4fc2" (OuterVolumeSpecName: "kube-api-access-j4fc2") pod "01dec74f-5be0-46e9-8cf6-8344b4a8bce8" (UID: "01dec74f-5be0-46e9-8cf6-8344b4a8bce8"). InnerVolumeSpecName "kube-api-access-j4fc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:21:51.888678 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.888656 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-kube-api-access-sfd47" (OuterVolumeSpecName: "kube-api-access-sfd47") pod "fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" (UID: "fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4"). InnerVolumeSpecName "kube-api-access-sfd47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:21:51.892524 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.892486 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-util" (OuterVolumeSpecName: "util") pod "01dec74f-5be0-46e9-8cf6-8344b4a8bce8" (UID: "01dec74f-5be0-46e9-8cf6-8344b4a8bce8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:21:51.894425 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.894400 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-util" (OuterVolumeSpecName: "util") pod "fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" (UID: "fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:21:51.987376 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.987331 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:51.987376 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.987366 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4fc2\" (UniqueName: \"kubernetes.io/projected/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-kube-api-access-j4fc2\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:51.987376 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.987375 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:51.987376 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.987383 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:51.987376 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.987391 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01dec74f-5be0-46e9-8cf6-8344b4a8bce8-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:51.987673 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:51.987399 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfd47\" (UniqueName: \"kubernetes.io/projected/fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4-kube-api-access-sfd47\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:52.618311 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.618283 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" Jun 12 19:21:52.618789 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.618281 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq" event={"ID":"01dec74f-5be0-46e9-8cf6-8344b4a8bce8","Type":"ContainerDied","Data":"b45652256ffd33777b211858502c340245793f1e136fb4d3721e4bf33f95aa18"} Jun 12 19:21:52.618789 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.618420 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b45652256ffd33777b211858502c340245793f1e136fb4d3721e4bf33f95aa18" Jun 12 19:21:52.620492 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.620459 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" Jun 12 19:21:52.620602 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.620487 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx" event={"ID":"fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4","Type":"ContainerDied","Data":"0dc88baeca41a010a25e98b32f8c1e8da37cb01b7b11293b098b00038966b4b9"} Jun 12 19:21:52.620602 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.620538 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dc88baeca41a010a25e98b32f8c1e8da37cb01b7b11293b098b00038966b4b9" Jun 12 19:21:52.762270 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.762237 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:52.794933 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.794822 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-util\") pod \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " Jun 12 19:21:52.795132 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.794977 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-bundle\") pod \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " Jun 12 19:21:52.795132 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.795071 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrtw5\" (UniqueName: \"kubernetes.io/projected/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-kube-api-access-jrtw5\") pod \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\" (UID: \"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2\") " Jun 12 19:21:52.795495 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.795464 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-bundle" (OuterVolumeSpecName: "bundle") pod "c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" (UID: "c7e62e2b-8e5a-4736-992d-040ae8d1e8b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:21:52.797602 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.797573 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-kube-api-access-jrtw5" (OuterVolumeSpecName: "kube-api-access-jrtw5") pod "c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" (UID: "c7e62e2b-8e5a-4736-992d-040ae8d1e8b2"). InnerVolumeSpecName "kube-api-access-jrtw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:21:52.803774 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.803732 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-util" (OuterVolumeSpecName: "util") pod "c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" (UID: "c7e62e2b-8e5a-4736-992d-040ae8d1e8b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:21:52.896053 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.895955 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrtw5\" (UniqueName: \"kubernetes.io/projected/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-kube-api-access-jrtw5\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:52.896053 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.895991 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:52.896053 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:52.896001 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7e62e2b-8e5a-4736-992d-040ae8d1e8b2-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:21:53.628556 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:53.628526 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" Jun 12 19:21:53.628956 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:53.628556 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn" event={"ID":"c7e62e2b-8e5a-4736-992d-040ae8d1e8b2","Type":"ContainerDied","Data":"e2065f7426532f6c498e116a577ff15fdeba9bf7569edeebe6e59b2073f87028"} Jun 12 19:21:53.628956 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:21:53.628603 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2065f7426532f6c498e116a577ff15fdeba9bf7569edeebe6e59b2073f87028" Jun 12 19:22:20.718663 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.718615 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8"] Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719072 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerName="util" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719087 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerName="util" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719097 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerName="pull" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719103 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerName="pull" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719113 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerName="extract" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719119 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerName="extract" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719127 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerName="util" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719132 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerName="util" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719139 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerName="util" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719147 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerName="util" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719158 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerName="util" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719163 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerName="util" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719172 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerName="pull" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719178 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerName="pull" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719183 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerName="extract" Jun 12 19:22:20.719180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719188 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerName="extract" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719196 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerName="extract" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719201 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerName="extract" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719207 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerName="extract" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719213 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerName="extract" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719229 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerName="pull" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719237 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerName="pull" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719248 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerName="pull" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719252 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerName="pull" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719317 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="07890a39-6c52-473c-9c13-bb649eabf8d8" containerName="extract" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719328 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="01dec74f-5be0-46e9-8cf6-8344b4a8bce8" containerName="extract" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719333 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7e62e2b-8e5a-4736-992d-040ae8d1e8b2" containerName="extract" Jun 12 19:22:20.719729 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.719340 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4" containerName="extract" Jun 12 19:22:20.722724 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.722696 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:20.725456 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.725429 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 19:22:20.725652 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.725530 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 12 19:22:20.725737 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.725671 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 19:22:20.725805 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.725780 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 12 19:22:20.726631 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.726616 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7f9z8\"" Jun 12 19:22:20.740788 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.740754 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8"] Jun 12 19:22:20.754828 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.754798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89dc665f-6c69-4be2-8325-1f32fa2732ca-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:20.755070 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.754833 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89dc665f-6c69-4be2-8325-1f32fa2732ca-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:20.755070 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.754936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxcsm\" (UniqueName: \"kubernetes.io/projected/89dc665f-6c69-4be2-8325-1f32fa2732ca-kube-api-access-vxcsm\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:20.855449 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.855399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89dc665f-6c69-4be2-8325-1f32fa2732ca-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:20.855449 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.855453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89dc665f-6c69-4be2-8325-1f32fa2732ca-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:20.855748 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.855518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxcsm\" (UniqueName: \"kubernetes.io/projected/89dc665f-6c69-4be2-8325-1f32fa2732ca-kube-api-access-vxcsm\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:20.855748 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:22:20.855560 2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 12 19:22:20.855748 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:22:20.855639 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89dc665f-6c69-4be2-8325-1f32fa2732ca-plugin-serving-cert podName:89dc665f-6c69-4be2-8325-1f32fa2732ca nodeName:}" failed. No retries permitted until 2026-06-12 19:22:21.355618124 +0000 UTC m=+654.012657244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/89dc665f-6c69-4be2-8325-1f32fa2732ca-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-r5bs8" (UID: "89dc665f-6c69-4be2-8325-1f32fa2732ca") : secret "plugin-serving-cert" not found Jun 12 19:22:20.856239 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.856213 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89dc665f-6c69-4be2-8325-1f32fa2732ca-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:20.867062 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:20.867032 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxcsm\" (UniqueName: \"kubernetes.io/projected/89dc665f-6c69-4be2-8325-1f32fa2732ca-kube-api-access-vxcsm\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:21.360153 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:21.360108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89dc665f-6c69-4be2-8325-1f32fa2732ca-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:21.363197 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:21.363161 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89dc665f-6c69-4be2-8325-1f32fa2732ca-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r5bs8\" (UID: \"89dc665f-6c69-4be2-8325-1f32fa2732ca\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:21.633892 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:21.633854 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" Jun 12 19:22:21.776413 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:21.776378 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8"] Jun 12 19:22:21.777727 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:22:21.777699 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89dc665f_6c69_4be2_8325_1f32fa2732ca.slice/crio-6d46b2ea2b2a5fda5537c1cec8c8ace372e323a7e5e527eeb12ad6023e2a3183 WatchSource:0}: Error finding container 6d46b2ea2b2a5fda5537c1cec8c8ace372e323a7e5e527eeb12ad6023e2a3183: Status 404 returned error can't find the container with id 6d46b2ea2b2a5fda5537c1cec8c8ace372e323a7e5e527eeb12ad6023e2a3183 Jun 12 19:22:21.779200 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:21.779177 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:22:21.793904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:21.793865 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" event={"ID":"89dc665f-6c69-4be2-8325-1f32fa2732ca","Type":"ContainerStarted","Data":"6d46b2ea2b2a5fda5537c1cec8c8ace372e323a7e5e527eeb12ad6023e2a3183"} Jun 12 19:22:32.382672 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:32.382627 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-796f76c886-nbq48"] Jun 12 19:22:43.951668 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:43.951629 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" event={"ID":"89dc665f-6c69-4be2-8325-1f32fa2732ca","Type":"ContainerStarted","Data":"561db66063e3c30991a254dfe6e6b46169b950133a29216e90e396f4a59e3172"} Jun 12 19:22:43.973204 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:43.973151 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r5bs8" podStartSLOduration=2.466289934 podStartE2EDuration="23.973136098s" totalImagesPullingTime="21.506846164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:43.972178599 +0000 UTC m=+676.629217739" watchObservedRunningTime="2026-06-12 19:22:43.973136098 +0000 UTC m=+676.630175236" Jun 12 19:22:57.411439 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.411392 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-796f76c886-nbq48" podUID="ff7b7a3c-a223-4a25-a102-ab3d691fe683" containerName="console" containerID="cri-o://682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b" gracePeriod=15 Jun 12 19:22:57.676604 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.676538 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:22:57.820548 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.820508 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf8rz\" (UniqueName: \"kubernetes.io/projected/ff7b7a3c-a223-4a25-a102-ab3d691fe683-kube-api-access-qf8rz\") pod \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " Jun 12 19:22:57.820757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.820563 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-oauth-config\") pod \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " Jun 12 19:22:57.820757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.820587 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-oauth-serving-cert\") pod \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " Jun 12 19:22:57.820757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.820640 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-trusted-ca-bundle\") pod \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " Jun 12 19:22:57.820757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.820657 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-service-ca\") pod \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " Jun 12 19:22:57.820757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.820689 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-config\") pod \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " Jun 12 19:22:57.820757 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.820725 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-serving-cert\") pod \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\" (UID: \"ff7b7a3c-a223-4a25-a102-ab3d691fe683\") " Jun 12 19:22:57.821118 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.821081 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff7b7a3c-a223-4a25-a102-ab3d691fe683" (UID: "ff7b7a3c-a223-4a25-a102-ab3d691fe683"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:22:57.821173 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.821141 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-config" (OuterVolumeSpecName: "console-config") pod "ff7b7a3c-a223-4a25-a102-ab3d691fe683" (UID: "ff7b7a3c-a223-4a25-a102-ab3d691fe683"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:22:57.821173 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.821156 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff7b7a3c-a223-4a25-a102-ab3d691fe683" (UID: "ff7b7a3c-a223-4a25-a102-ab3d691fe683"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:22:57.821173 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.821145 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ff7b7a3c-a223-4a25-a102-ab3d691fe683" (UID: "ff7b7a3c-a223-4a25-a102-ab3d691fe683"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:22:57.823083 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.823057 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff7b7a3c-a223-4a25-a102-ab3d691fe683" (UID: "ff7b7a3c-a223-4a25-a102-ab3d691fe683"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:22:57.823083 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.823069 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7b7a3c-a223-4a25-a102-ab3d691fe683-kube-api-access-qf8rz" (OuterVolumeSpecName: "kube-api-access-qf8rz") pod "ff7b7a3c-a223-4a25-a102-ab3d691fe683" (UID: "ff7b7a3c-a223-4a25-a102-ab3d691fe683"). InnerVolumeSpecName "kube-api-access-qf8rz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:22:57.823083 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.823074 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff7b7a3c-a223-4a25-a102-ab3d691fe683" (UID: "ff7b7a3c-a223-4a25-a102-ab3d691fe683"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:22:57.921853 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.921811 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf8rz\" (UniqueName: \"kubernetes.io/projected/ff7b7a3c-a223-4a25-a102-ab3d691fe683-kube-api-access-qf8rz\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:22:57.921853 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.921844 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-oauth-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:22:57.921853 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.921857 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-oauth-serving-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:22:57.922141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.921871 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-trusted-ca-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:22:57.922141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.921883 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-service-ca\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:22:57.922141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.921894 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-config\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:22:57.922141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:57.921904 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7b7a3c-a223-4a25-a102-ab3d691fe683-console-serving-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:22:58.030717 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:58.030631 2560 generic.go:356] "Generic (PLEG): container finished" podID="ff7b7a3c-a223-4a25-a102-ab3d691fe683" containerID="682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b" exitCode=0 Jun 12 19:22:58.030717 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:58.030681 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796f76c886-nbq48" Jun 12 19:22:58.030913 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:58.030717 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796f76c886-nbq48" event={"ID":"ff7b7a3c-a223-4a25-a102-ab3d691fe683","Type":"ContainerDied","Data":"682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b"} Jun 12 19:22:58.030913 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:58.030774 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796f76c886-nbq48" event={"ID":"ff7b7a3c-a223-4a25-a102-ab3d691fe683","Type":"ContainerDied","Data":"1b4231cad515694cb94c56ecef63d023aad2371f441af8f7052436f610451f6e"} Jun 12 19:22:58.030913 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:58.030803 2560 scope.go:117] "RemoveContainer" containerID="682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b" Jun 12 19:22:58.042605 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:58.042574 2560 scope.go:117] "RemoveContainer" containerID="682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b" Jun 12 19:22:58.043044 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:22:58.043019 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b\": container with ID starting with 682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b not found: ID does not exist" containerID="682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b" Jun 12 19:22:58.043127 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:58.043053 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b"} err="failed to get container status \"682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b\": rpc error: code = NotFound desc = could not find container \"682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b\": container with ID starting with 682ce36fdd109afebcdb3ed0a0e51c1fce5e8cc27cfa9d008cf0dad1a909a28b not found: ID does not exist" Jun 12 19:22:58.054191 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:58.054159 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-796f76c886-nbq48"] Jun 12 19:22:58.058544 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:58.058516 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-796f76c886-nbq48"] Jun 12 19:22:59.789862 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:22:59.789828 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7b7a3c-a223-4a25-a102-ab3d691fe683" path="/var/lib/kubelet/pods/ff7b7a3c-a223-4a25-a102-ab3d691fe683/volumes" Jun 12 19:23:15.836629 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.836593 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-t792f"] Jun 12 19:23:15.837038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.836962 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7b7a3c-a223-4a25-a102-ab3d691fe683" containerName="console" Jun 12 19:23:15.837038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.836976 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7b7a3c-a223-4a25-a102-ab3d691fe683" containerName="console" Jun 12 19:23:15.837113 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.837052 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7b7a3c-a223-4a25-a102-ab3d691fe683" containerName="console" Jun 12 19:23:15.876698 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.876655 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t792f"] Jun 12 19:23:15.876877 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.876714 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t792f" Jun 12 19:23:15.879508 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.879491 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kn8qv\"" Jun 12 19:23:15.973311 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.973254 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kl427"] Jun 12 19:23:15.976810 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.976789 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kl427" Jun 12 19:23:15.977549 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.977527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd968\" (UniqueName: \"kubernetes.io/projected/359e931b-b4c7-4417-9e27-776df7a6fe75-kube-api-access-dd968\") pod \"authorino-58cd955675-t792f\" (UID: \"359e931b-b4c7-4417-9e27-776df7a6fe75\") " pod="kuadrant-system/authorino-58cd955675-t792f" Jun 12 19:23:15.983699 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:15.983673 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kl427"] Jun 12 19:23:16.078603 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:16.078559 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m8xp\" (UniqueName: \"kubernetes.io/projected/97bb9909-f93a-4ae6-bd13-155ca3d84513-kube-api-access-9m8xp\") pod \"authorino-75d556bd77-kl427\" (UID: \"97bb9909-f93a-4ae6-bd13-155ca3d84513\") " pod="kuadrant-system/authorino-75d556bd77-kl427" Jun 12 19:23:16.078800 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:16.078674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd968\" (UniqueName: \"kubernetes.io/projected/359e931b-b4c7-4417-9e27-776df7a6fe75-kube-api-access-dd968\") pod \"authorino-58cd955675-t792f\" (UID: \"359e931b-b4c7-4417-9e27-776df7a6fe75\") " pod="kuadrant-system/authorino-58cd955675-t792f" Jun 12 19:23:16.089674 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:16.089596 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd968\" (UniqueName: \"kubernetes.io/projected/359e931b-b4c7-4417-9e27-776df7a6fe75-kube-api-access-dd968\") pod \"authorino-58cd955675-t792f\" (UID: \"359e931b-b4c7-4417-9e27-776df7a6fe75\") " pod="kuadrant-system/authorino-58cd955675-t792f" Jun 12 19:23:16.179864 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:16.179817 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8xp\" (UniqueName: \"kubernetes.io/projected/97bb9909-f93a-4ae6-bd13-155ca3d84513-kube-api-access-9m8xp\") pod \"authorino-75d556bd77-kl427\" (UID: \"97bb9909-f93a-4ae6-bd13-155ca3d84513\") " pod="kuadrant-system/authorino-75d556bd77-kl427" Jun 12 19:23:16.185829 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:16.185792 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t792f" Jun 12 19:23:16.194778 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:16.194748 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m8xp\" (UniqueName: \"kubernetes.io/projected/97bb9909-f93a-4ae6-bd13-155ca3d84513-kube-api-access-9m8xp\") pod \"authorino-75d556bd77-kl427\" (UID: \"97bb9909-f93a-4ae6-bd13-155ca3d84513\") " pod="kuadrant-system/authorino-75d556bd77-kl427" Jun 12 19:23:16.287407 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:16.287368 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kl427" Jun 12 19:23:16.331296 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:16.331262 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t792f"] Jun 12 19:23:16.333095 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:23:16.333058 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod359e931b_b4c7_4417_9e27_776df7a6fe75.slice/crio-20cca59dda028aa33d223a9140d7147e4190bc08dab08c24c48bc87e205f8895 WatchSource:0}: Error finding container 20cca59dda028aa33d223a9140d7147e4190bc08dab08c24c48bc87e205f8895: Status 404 returned error can't find the container with id 20cca59dda028aa33d223a9140d7147e4190bc08dab08c24c48bc87e205f8895 Jun 12 19:23:16.432961 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:16.432906 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kl427"] Jun 12 19:23:16.434695 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:23:16.434665 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97bb9909_f93a_4ae6_bd13_155ca3d84513.slice/crio-68db461547ad77b54a2960fe1a80ca136fd10f76041e5f60ba306936ae3607f2 WatchSource:0}: Error finding container 68db461547ad77b54a2960fe1a80ca136fd10f76041e5f60ba306936ae3607f2: Status 404 returned error can't find the container with id 68db461547ad77b54a2960fe1a80ca136fd10f76041e5f60ba306936ae3607f2 Jun 12 19:23:17.149768 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:17.149665 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kl427" event={"ID":"97bb9909-f93a-4ae6-bd13-155ca3d84513","Type":"ContainerStarted","Data":"68db461547ad77b54a2960fe1a80ca136fd10f76041e5f60ba306936ae3607f2"} Jun 12 19:23:17.153313 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:17.153231 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t792f" event={"ID":"359e931b-b4c7-4417-9e27-776df7a6fe75","Type":"ContainerStarted","Data":"20cca59dda028aa33d223a9140d7147e4190bc08dab08c24c48bc87e205f8895"} Jun 12 19:23:20.175958 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:20.175823 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kl427" event={"ID":"97bb9909-f93a-4ae6-bd13-155ca3d84513","Type":"ContainerStarted","Data":"80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4"} Jun 12 19:23:20.177486 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:20.177459 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t792f" event={"ID":"359e931b-b4c7-4417-9e27-776df7a6fe75","Type":"ContainerStarted","Data":"ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77"} Jun 12 19:23:20.192970 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:20.192900 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kl427" podStartSLOduration=1.7458363380000002 podStartE2EDuration="5.192883934s" totalImagesPullingTime="3.447047596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:20.190526059 +0000 UTC m=+712.847565200" watchObservedRunningTime="2026-06-12 19:23:20.192883934 +0000 UTC m=+712.849923074" Jun 12 19:23:20.206599 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:20.206535 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-t792f" podStartSLOduration=1.643704294 podStartE2EDuration="5.206511238s" totalImagesPullingTime="3.562806944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:20.205732158 +0000 UTC m=+712.862771507" watchObservedRunningTime="2026-06-12 19:23:20.206511238 +0000 UTC m=+712.863550378" Jun 12 19:23:20.215865 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:20.215818 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t792f"] Jun 12 19:23:22.187970 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:22.187909 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-t792f" podUID="359e931b-b4c7-4417-9e27-776df7a6fe75" containerName="authorino" containerID="cri-o://ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77" gracePeriod=30 Jun 12 19:23:22.450860 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:22.450797 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t792f" Jun 12 19:23:22.543280 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:22.543244 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd968\" (UniqueName: \"kubernetes.io/projected/359e931b-b4c7-4417-9e27-776df7a6fe75-kube-api-access-dd968\") pod \"359e931b-b4c7-4417-9e27-776df7a6fe75\" (UID: \"359e931b-b4c7-4417-9e27-776df7a6fe75\") " Jun 12 19:23:22.545602 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:22.545559 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/359e931b-b4c7-4417-9e27-776df7a6fe75-kube-api-access-dd968" (OuterVolumeSpecName: "kube-api-access-dd968") pod "359e931b-b4c7-4417-9e27-776df7a6fe75" (UID: "359e931b-b4c7-4417-9e27-776df7a6fe75"). InnerVolumeSpecName "kube-api-access-dd968". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:23:22.644133 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:22.644096 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd968\" (UniqueName: \"kubernetes.io/projected/359e931b-b4c7-4417-9e27-776df7a6fe75-kube-api-access-dd968\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:23:23.194908 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.194871 2560 generic.go:356] "Generic (PLEG): container finished" podID="359e931b-b4c7-4417-9e27-776df7a6fe75" containerID="ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77" exitCode=0 Jun 12 19:23:23.195336 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.194912 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t792f" Jun 12 19:23:23.195336 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.194942 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t792f" event={"ID":"359e931b-b4c7-4417-9e27-776df7a6fe75","Type":"ContainerDied","Data":"ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77"} Jun 12 19:23:23.195336 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.195051 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t792f" event={"ID":"359e931b-b4c7-4417-9e27-776df7a6fe75","Type":"ContainerDied","Data":"20cca59dda028aa33d223a9140d7147e4190bc08dab08c24c48bc87e205f8895"} Jun 12 19:23:23.195336 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.195070 2560 scope.go:117] "RemoveContainer" containerID="ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77" Jun 12 19:23:23.204903 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.204882 2560 scope.go:117] "RemoveContainer" containerID="ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77" Jun 12 19:23:23.205258 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:23:23.205232 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77\": container with ID starting with ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77 not found: ID does not exist" containerID="ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77" Jun 12 19:23:23.205347 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.205277 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77"} err="failed to get container status \"ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77\": rpc error: code = NotFound desc = could not find container \"ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77\": container with ID starting with ddd87bdafbb5f79faa14f815bcfffb5cd3c39789aaa51796309eb0af73858d77 not found: ID does not exist" Jun 12 19:23:23.216431 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.216395 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t792f"] Jun 12 19:23:23.220310 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.220278 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-t792f"] Jun 12 19:23:23.788859 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:23.788823 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="359e931b-b4c7-4417-9e27-776df7a6fe75" path="/var/lib/kubelet/pods/359e931b-b4c7-4417-9e27-776df7a6fe75/volumes" Jun 12 19:23:44.367997 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.367961 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc"] Jun 12 19:23:44.368572 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.368519 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="359e931b-b4c7-4417-9e27-776df7a6fe75" containerName="authorino" Jun 12 19:23:44.368572 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.368539 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="359e931b-b4c7-4417-9e27-776df7a6fe75" containerName="authorino" Jun 12 19:23:44.368695 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.368673 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="359e931b-b4c7-4417-9e27-776df7a6fe75" containerName="authorino" Jun 12 19:23:44.372122 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.372098 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.375362 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.375337 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 19:23:44.375362 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.375359 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7zsq\"" Jun 12 19:23:44.375583 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.375366 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 19:23:44.383167 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.383138 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc"] Jun 12 19:23:44.544664 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.544626 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5x4l\" (UniqueName: \"kubernetes.io/projected/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-kube-api-access-t5x4l\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.544848 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.544739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.544848 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.544772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.645681 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.645586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5x4l\" (UniqueName: \"kubernetes.io/projected/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-kube-api-access-t5x4l\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.645832 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.645686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.645832 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.645708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.646184 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.646161 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.646230 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.646176 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.658458 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.658432 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5x4l\" (UniqueName: \"kubernetes.io/projected/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-kube-api-access-t5x4l\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.683020 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.682985 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:44.831650 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:44.831617 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc"] Jun 12 19:23:44.832380 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:23:44.832352 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode421ef30_4ad5_410e_9d84_b6c2b84e4acd.slice/crio-407d38a2448cba44b7956a4a61562e11c1283ca9deb48a3b42316822c634704a WatchSource:0}: Error finding container 407d38a2448cba44b7956a4a61562e11c1283ca9deb48a3b42316822c634704a: Status 404 returned error can't find the container with id 407d38a2448cba44b7956a4a61562e11c1283ca9deb48a3b42316822c634704a Jun 12 19:23:45.320910 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:45.320814 2560 generic.go:356] "Generic (PLEG): container finished" podID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerID="64e735c86d4379e153614349daf7371f809f76d17eb756a32c53434fd88cfc03" exitCode=0 Jun 12 19:23:45.321081 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:45.320908 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" event={"ID":"e421ef30-4ad5-410e-9d84-b6c2b84e4acd","Type":"ContainerDied","Data":"64e735c86d4379e153614349daf7371f809f76d17eb756a32c53434fd88cfc03"} Jun 12 19:23:45.321081 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:45.320995 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" event={"ID":"e421ef30-4ad5-410e-9d84-b6c2b84e4acd","Type":"ContainerStarted","Data":"407d38a2448cba44b7956a4a61562e11c1283ca9deb48a3b42316822c634704a"} Jun 12 19:23:46.329317 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:46.329284 2560 generic.go:356] "Generic (PLEG): container finished" podID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerID="5ebaa855e96c9cdfddf323465138284dbad695c8be37d8833f1b94f219d41240" exitCode=0 Jun 12 19:23:46.329711 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:46.329383 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" event={"ID":"e421ef30-4ad5-410e-9d84-b6c2b84e4acd","Type":"ContainerDied","Data":"5ebaa855e96c9cdfddf323465138284dbad695c8be37d8833f1b94f219d41240"} Jun 12 19:23:47.338682 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:47.338651 2560 generic.go:356] "Generic (PLEG): container finished" podID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerID="e2e4b025f5bdc4215f21f02956a0025e5d45943194b85804c824e5c3fcce5f73" exitCode=0 Jun 12 19:23:47.339095 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:47.338728 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" event={"ID":"e421ef30-4ad5-410e-9d84-b6c2b84e4acd","Type":"ContainerDied","Data":"e2e4b025f5bdc4215f21f02956a0025e5d45943194b85804c824e5c3fcce5f73"} Jun 12 19:23:48.489671 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.489640 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:48.583295 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.583252 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-bundle\") pod \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " Jun 12 19:23:48.583295 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.583302 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5x4l\" (UniqueName: \"kubernetes.io/projected/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-kube-api-access-t5x4l\") pod \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " Jun 12 19:23:48.583525 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.583325 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-util\") pod \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\" (UID: \"e421ef30-4ad5-410e-9d84-b6c2b84e4acd\") " Jun 12 19:23:48.583962 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.583899 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-bundle" (OuterVolumeSpecName: "bundle") pod "e421ef30-4ad5-410e-9d84-b6c2b84e4acd" (UID: "e421ef30-4ad5-410e-9d84-b6c2b84e4acd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:23:48.585658 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.585632 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-kube-api-access-t5x4l" (OuterVolumeSpecName: "kube-api-access-t5x4l") pod "e421ef30-4ad5-410e-9d84-b6c2b84e4acd" (UID: "e421ef30-4ad5-410e-9d84-b6c2b84e4acd"). InnerVolumeSpecName "kube-api-access-t5x4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:23:48.592707 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.592669 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-util" (OuterVolumeSpecName: "util") pod "e421ef30-4ad5-410e-9d84-b6c2b84e4acd" (UID: "e421ef30-4ad5-410e-9d84-b6c2b84e4acd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:23:48.684156 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.684121 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-bundle\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:23:48.684156 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.684151 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5x4l\" (UniqueName: \"kubernetes.io/projected/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-kube-api-access-t5x4l\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:23:48.684156 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:48.684162 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e421ef30-4ad5-410e-9d84-b6c2b84e4acd-util\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:23:49.352136 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:49.352099 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" Jun 12 19:23:49.352291 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:49.352108 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484jmvc" event={"ID":"e421ef30-4ad5-410e-9d84-b6c2b84e4acd","Type":"ContainerDied","Data":"407d38a2448cba44b7956a4a61562e11c1283ca9deb48a3b42316822c634704a"} Jun 12 19:23:49.352291 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:23:49.352235 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="407d38a2448cba44b7956a4a61562e11c1283ca9deb48a3b42316822c634704a" Jun 12 19:24:07.036146 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.036102 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:24:07.036636 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.036482 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerName="pull" Jun 12 19:24:07.036636 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.036495 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerName="pull" Jun 12 19:24:07.036636 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.036517 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerName="util" Jun 12 19:24:07.036636 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.036522 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerName="util" Jun 12 19:24:07.036636 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.036530 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerName="extract" Jun 12 19:24:07.036636 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.036535 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerName="extract" Jun 12 19:24:07.036636 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.036595 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e421ef30-4ad5-410e-9d84-b6c2b84e4acd" containerName="extract" Jun 12 19:24:07.040965 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.040946 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:24:07.043685 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.043660 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 19:24:07.043685 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.043661 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 19:24:07.043875 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.043660 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lr2gl\"" Jun 12 19:24:07.044933 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.044899 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 19:24:07.048858 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.048560 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:24:07.153535 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.153494 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qmh9\" (UniqueName: \"kubernetes.io/projected/66bd5837-54f9-4051-9ae2-d26710f53742-kube-api-access-5qmh9\") pod \"maas-keycloak-0\" (UID: \"66bd5837-54f9-4051-9ae2-d26710f53742\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:24:07.254353 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.254318 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qmh9\" (UniqueName: \"kubernetes.io/projected/66bd5837-54f9-4051-9ae2-d26710f53742-kube-api-access-5qmh9\") pod \"maas-keycloak-0\" (UID: \"66bd5837-54f9-4051-9ae2-d26710f53742\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:24:07.265063 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.265032 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qmh9\" (UniqueName: \"kubernetes.io/projected/66bd5837-54f9-4051-9ae2-d26710f53742-kube-api-access-5qmh9\") pod \"maas-keycloak-0\" (UID: \"66bd5837-54f9-4051-9ae2-d26710f53742\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:24:07.352120 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.352006 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:24:07.496681 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:07.496651 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:24:07.498010 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:24:07.497984 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66bd5837_54f9_4051_9ae2_d26710f53742.slice/crio-74d93e30b81458e31ba3c5a22d216e3f0021e4b3b79dfffd33b1a1561096ed36 WatchSource:0}: Error finding container 74d93e30b81458e31ba3c5a22d216e3f0021e4b3b79dfffd33b1a1561096ed36: Status 404 returned error can't find the container with id 74d93e30b81458e31ba3c5a22d216e3f0021e4b3b79dfffd33b1a1561096ed36 Jun 12 19:24:08.486096 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:08.486045 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66bd5837-54f9-4051-9ae2-d26710f53742","Type":"ContainerStarted","Data":"74d93e30b81458e31ba3c5a22d216e3f0021e4b3b79dfffd33b1a1561096ed36"} Jun 12 19:24:12.514428 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:12.514382 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66bd5837-54f9-4051-9ae2-d26710f53742","Type":"ContainerStarted","Data":"4e408bf80299d31a780557fc48dd6b815fdbae6caf1bad0afc9c04cef8c98e0a"} Jun 12 19:24:12.544315 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:12.544243 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.011144926 podStartE2EDuration="5.544217286s" totalImagesPullingTime="4.53307236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:24:12.53877206 +0000 UTC m=+765.195811197" watchObservedRunningTime="2026-06-12 19:24:12.544217286 +0000 UTC m=+765.201256430" Jun 12 19:24:13.353118 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:13.352976 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 19:24:13.354732 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:13.354686 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:14.353206 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:14.353150 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:15.353065 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:15.353011 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:16.353042 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:16.352986 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:17.352853 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:17.352169 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 19:24:17.353554 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:17.353515 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:18.353181 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:18.353129 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:19.353343 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:19.353276 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:20.353243 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:20.353187 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:21.352938 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:21.352867 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:22.353578 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:22.353524 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:23.353511 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:23.353459 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:24.353229 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:24.353176 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:25.352941 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:25.352870 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 19:24:26.482494 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:26.482445 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 19:24:26.501660 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:26.501588 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 19:24:36.490120 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:36.490074 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 19:24:37.393259 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.393217 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zfw8g"] Jun 12 19:24:37.401304 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.401265 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" Jun 12 19:24:37.403679 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.403650 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zfw8g"] Jun 12 19:24:37.475857 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.475820 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dssdx\" (UniqueName: \"kubernetes.io/projected/c7933844-61af-44b2-8d80-ceefd4fe6a84-kube-api-access-dssdx\") pod \"authorino-5d4b67c446-zfw8g\" (UID: \"c7933844-61af-44b2-8d80-ceefd4fe6a84\") " pod="kuadrant-system/authorino-5d4b67c446-zfw8g" Jun 12 19:24:37.576863 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.576824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dssdx\" (UniqueName: \"kubernetes.io/projected/c7933844-61af-44b2-8d80-ceefd4fe6a84-kube-api-access-dssdx\") pod \"authorino-5d4b67c446-zfw8g\" (UID: \"c7933844-61af-44b2-8d80-ceefd4fe6a84\") " pod="kuadrant-system/authorino-5d4b67c446-zfw8g" Jun 12 19:24:37.585078 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.585049 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dssdx\" (UniqueName: \"kubernetes.io/projected/c7933844-61af-44b2-8d80-ceefd4fe6a84-kube-api-access-dssdx\") pod \"authorino-5d4b67c446-zfw8g\" (UID: \"c7933844-61af-44b2-8d80-ceefd4fe6a84\") " pod="kuadrant-system/authorino-5d4b67c446-zfw8g" Jun 12 19:24:37.642639 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.642597 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zfw8g"] Jun 12 19:24:37.642958 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.642934 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" Jun 12 19:24:37.669674 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.669642 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f97c78d56-gzb52"] Jun 12 19:24:37.672558 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.672537 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:24:37.675733 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.675713 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 12 19:24:37.684232 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.684203 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f97c78d56-gzb52"] Jun 12 19:24:37.778565 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.778527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68sp\" (UniqueName: \"kubernetes.io/projected/00b6c53b-f189-43ae-a257-fec6b0ff47d7-kube-api-access-x68sp\") pod \"authorino-6f97c78d56-gzb52\" (UID: \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\") " pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:24:37.778751 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.778612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00b6c53b-f189-43ae-a257-fec6b0ff47d7-tls-cert\") pod \"authorino-6f97c78d56-gzb52\" (UID: \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\") " pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:24:37.789514 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:24:37.789486 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7933844_61af_44b2_8d80_ceefd4fe6a84.slice/crio-0565f4657eb14e94298204ab75ed459d3cb31ae986d133e654317a0ab0334045 WatchSource:0}: Error finding container 0565f4657eb14e94298204ab75ed459d3cb31ae986d133e654317a0ab0334045: Status 404 returned error can't find the container with id 0565f4657eb14e94298204ab75ed459d3cb31ae986d133e654317a0ab0334045 Jun 12 19:24:37.789842 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.789822 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zfw8g"] Jun 12 19:24:37.879360 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.879314 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68sp\" (UniqueName: \"kubernetes.io/projected/00b6c53b-f189-43ae-a257-fec6b0ff47d7-kube-api-access-x68sp\") pod \"authorino-6f97c78d56-gzb52\" (UID: \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\") " pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:24:37.879567 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.879413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00b6c53b-f189-43ae-a257-fec6b0ff47d7-tls-cert\") pod \"authorino-6f97c78d56-gzb52\" (UID: \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\") " pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:24:37.882205 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.882178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00b6c53b-f189-43ae-a257-fec6b0ff47d7-tls-cert\") pod \"authorino-6f97c78d56-gzb52\" (UID: \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\") " pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:24:37.888696 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.888667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68sp\" (UniqueName: \"kubernetes.io/projected/00b6c53b-f189-43ae-a257-fec6b0ff47d7-kube-api-access-x68sp\") pod \"authorino-6f97c78d56-gzb52\" (UID: \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\") " pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:24:37.983702 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:37.983610 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:24:38.130397 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.130367 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f97c78d56-gzb52"] Jun 12 19:24:38.130956 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:24:38.130902 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00b6c53b_f189_43ae_a257_fec6b0ff47d7.slice/crio-cfd2c3ce83774b6712e6df698ce90d1231dc3654cbb042e56205c085dc649fe9 WatchSource:0}: Error finding container cfd2c3ce83774b6712e6df698ce90d1231dc3654cbb042e56205c085dc649fe9: Status 404 returned error can't find the container with id cfd2c3ce83774b6712e6df698ce90d1231dc3654cbb042e56205c085dc649fe9 Jun 12 19:24:38.718507 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.718403 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f97c78d56-gzb52" event={"ID":"00b6c53b-f189-43ae-a257-fec6b0ff47d7","Type":"ContainerStarted","Data":"ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7"} Jun 12 19:24:38.718507 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.718458 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f97c78d56-gzb52" event={"ID":"00b6c53b-f189-43ae-a257-fec6b0ff47d7","Type":"ContainerStarted","Data":"cfd2c3ce83774b6712e6df698ce90d1231dc3654cbb042e56205c085dc649fe9"} Jun 12 19:24:38.720045 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.720021 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" event={"ID":"c7933844-61af-44b2-8d80-ceefd4fe6a84","Type":"ContainerStarted","Data":"bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc"} Jun 12 19:24:38.720143 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.720059 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" event={"ID":"c7933844-61af-44b2-8d80-ceefd4fe6a84","Type":"ContainerStarted","Data":"0565f4657eb14e94298204ab75ed459d3cb31ae986d133e654317a0ab0334045"} Jun 12 19:24:38.720143 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.720100 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" podUID="c7933844-61af-44b2-8d80-ceefd4fe6a84" containerName="authorino" containerID="cri-o://bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc" gracePeriod=30 Jun 12 19:24:38.738343 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.738294 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f97c78d56-gzb52" podStartSLOduration=1.428040786 podStartE2EDuration="1.73827698s" totalImagesPullingTime="310.236194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:24:38.736587692 +0000 UTC m=+791.393626831" watchObservedRunningTime="2026-06-12 19:24:38.73827698 +0000 UTC m=+791.395316118" Jun 12 19:24:38.776912 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.776844 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" podStartSLOduration=1.451880124 podStartE2EDuration="1.776820132s" totalImagesPullingTime="324.940008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:24:38.757757278 +0000 UTC m=+791.414796431" watchObservedRunningTime="2026-06-12 19:24:38.776820132 +0000 UTC m=+791.433859272" Jun 12 19:24:38.778812 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.778787 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kl427"] Jun 12 19:24:38.779063 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:38.779031 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kl427" podUID="97bb9909-f93a-4ae6-bd13-155ca3d84513" containerName="authorino" containerID="cri-o://80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4" gracePeriod=30 Jun 12 19:24:39.049564 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.049539 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" Jun 12 19:24:39.052628 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.052603 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kl427" Jun 12 19:24:39.192955 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.192905 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m8xp\" (UniqueName: \"kubernetes.io/projected/97bb9909-f93a-4ae6-bd13-155ca3d84513-kube-api-access-9m8xp\") pod \"97bb9909-f93a-4ae6-bd13-155ca3d84513\" (UID: \"97bb9909-f93a-4ae6-bd13-155ca3d84513\") " Jun 12 19:24:39.193159 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.192981 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dssdx\" (UniqueName: \"kubernetes.io/projected/c7933844-61af-44b2-8d80-ceefd4fe6a84-kube-api-access-dssdx\") pod \"c7933844-61af-44b2-8d80-ceefd4fe6a84\" (UID: \"c7933844-61af-44b2-8d80-ceefd4fe6a84\") " Jun 12 19:24:39.195496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.195456 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7933844-61af-44b2-8d80-ceefd4fe6a84-kube-api-access-dssdx" (OuterVolumeSpecName: "kube-api-access-dssdx") pod "c7933844-61af-44b2-8d80-ceefd4fe6a84" (UID: "c7933844-61af-44b2-8d80-ceefd4fe6a84"). InnerVolumeSpecName "kube-api-access-dssdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:24:39.195639 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.195539 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97bb9909-f93a-4ae6-bd13-155ca3d84513-kube-api-access-9m8xp" (OuterVolumeSpecName: "kube-api-access-9m8xp") pod "97bb9909-f93a-4ae6-bd13-155ca3d84513" (UID: "97bb9909-f93a-4ae6-bd13-155ca3d84513"). InnerVolumeSpecName "kube-api-access-9m8xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:24:39.294359 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.294268 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m8xp\" (UniqueName: \"kubernetes.io/projected/97bb9909-f93a-4ae6-bd13-155ca3d84513-kube-api-access-9m8xp\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:24:39.294359 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.294298 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dssdx\" (UniqueName: \"kubernetes.io/projected/c7933844-61af-44b2-8d80-ceefd4fe6a84-kube-api-access-dssdx\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:24:39.726447 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.726413 2560 generic.go:356] "Generic (PLEG): container finished" podID="97bb9909-f93a-4ae6-bd13-155ca3d84513" containerID="80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4" exitCode=0 Jun 12 19:24:39.726897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.726455 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kl427" Jun 12 19:24:39.726897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.726490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kl427" event={"ID":"97bb9909-f93a-4ae6-bd13-155ca3d84513","Type":"ContainerDied","Data":"80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4"} Jun 12 19:24:39.726897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.726532 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kl427" event={"ID":"97bb9909-f93a-4ae6-bd13-155ca3d84513","Type":"ContainerDied","Data":"68db461547ad77b54a2960fe1a80ca136fd10f76041e5f60ba306936ae3607f2"} Jun 12 19:24:39.726897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.726553 2560 scope.go:117] "RemoveContainer" containerID="80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4" Jun 12 19:24:39.728041 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.728018 2560 generic.go:356] "Generic (PLEG): container finished" podID="c7933844-61af-44b2-8d80-ceefd4fe6a84" containerID="bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc" exitCode=0 Jun 12 19:24:39.728141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.728053 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" Jun 12 19:24:39.728141 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.728103 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" event={"ID":"c7933844-61af-44b2-8d80-ceefd4fe6a84","Type":"ContainerDied","Data":"bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc"} Jun 12 19:24:39.728253 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.728145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zfw8g" event={"ID":"c7933844-61af-44b2-8d80-ceefd4fe6a84","Type":"ContainerDied","Data":"0565f4657eb14e94298204ab75ed459d3cb31ae986d133e654317a0ab0334045"} Jun 12 19:24:39.736322 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.736299 2560 scope.go:117] "RemoveContainer" containerID="80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4" Jun 12 19:24:39.736628 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:24:39.736601 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4\": container with ID starting with 80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4 not found: ID does not exist" containerID="80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4" Jun 12 19:24:39.736741 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.736639 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4"} err="failed to get container status \"80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4\": rpc error: code = NotFound desc = could not find container \"80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4\": container with ID starting with 80c75179d55079559afaffeea12c7865949ec6da511fe527172f315730eb2bf4 not found: ID does not exist" Jun 12 19:24:39.736741 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.736665 2560 scope.go:117] "RemoveContainer" containerID="bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc" Jun 12 19:24:39.745680 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.745663 2560 scope.go:117] "RemoveContainer" containerID="bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc" Jun 12 19:24:39.746013 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:24:39.745978 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc\": container with ID starting with bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc not found: ID does not exist" containerID="bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc" Jun 12 19:24:39.746089 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.746023 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc"} err="failed to get container status \"bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc\": rpc error: code = NotFound desc = could not find container \"bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc\": container with ID starting with bf6c5f1aa553cdbbbc37f3f7ec0daa970ec86228d73faee215b05e72ca7b31bc not found: ID does not exist" Jun 12 19:24:39.752528 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.752497 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kl427"] Jun 12 19:24:39.758939 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.758898 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kl427"] Jun 12 19:24:39.770095 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.770065 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zfw8g"] Jun 12 19:24:39.774169 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.774147 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zfw8g"] Jun 12 19:24:39.788094 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.788068 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97bb9909-f93a-4ae6-bd13-155ca3d84513" path="/var/lib/kubelet/pods/97bb9909-f93a-4ae6-bd13-155ca3d84513/volumes" Jun 12 19:24:39.788402 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:39.788390 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7933844-61af-44b2-8d80-ceefd4fe6a84" path="/var/lib/kubelet/pods/c7933844-61af-44b2-8d80-ceefd4fe6a84/volumes" Jun 12 19:24:42.299346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.299305 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c87cdd8d8-wtmbj"] Jun 12 19:24:42.299790 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.299773 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7933844-61af-44b2-8d80-ceefd4fe6a84" containerName="authorino" Jun 12 19:24:42.299790 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.299791 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7933844-61af-44b2-8d80-ceefd4fe6a84" containerName="authorino" Jun 12 19:24:42.299872 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.299807 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97bb9909-f93a-4ae6-bd13-155ca3d84513" containerName="authorino" Jun 12 19:24:42.299872 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.299813 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="97bb9909-f93a-4ae6-bd13-155ca3d84513" containerName="authorino" Jun 12 19:24:42.299872 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.299867 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="97bb9909-f93a-4ae6-bd13-155ca3d84513" containerName="authorino" Jun 12 19:24:42.299985 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.299877 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7933844-61af-44b2-8d80-ceefd4fe6a84" containerName="authorino" Jun 12 19:24:42.301908 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.301884 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:42.304694 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.304671 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 19:24:42.305849 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.305829 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8rrh9\"" Jun 12 19:24:42.305983 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.305830 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 19:24:42.313456 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.313430 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c87cdd8d8-wtmbj"] Jun 12 19:24:42.423303 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.423266 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/623ee436-f00a-45a0-9540-e56d5c3a4add-webhook-cert\") pod \"maas-controller-c87cdd8d8-wtmbj\" (UID: \"623ee436-f00a-45a0-9540-e56d5c3a4add\") " pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:42.423303 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.423312 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbl9x\" (UniqueName: \"kubernetes.io/projected/623ee436-f00a-45a0-9540-e56d5c3a4add-kube-api-access-qbl9x\") pod \"maas-controller-c87cdd8d8-wtmbj\" (UID: \"623ee436-f00a-45a0-9540-e56d5c3a4add\") " pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:42.475092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.475054 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f567dbd8b-ssklx"] Jun 12 19:24:42.477986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.477960 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:42.495201 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.495163 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f567dbd8b-ssklx"] Jun 12 19:24:42.524363 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.524321 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/623ee436-f00a-45a0-9540-e56d5c3a4add-webhook-cert\") pod \"maas-controller-c87cdd8d8-wtmbj\" (UID: \"623ee436-f00a-45a0-9540-e56d5c3a4add\") " pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:42.524363 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.524367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbl9x\" (UniqueName: \"kubernetes.io/projected/623ee436-f00a-45a0-9540-e56d5c3a4add-kube-api-access-qbl9x\") pod \"maas-controller-c87cdd8d8-wtmbj\" (UID: \"623ee436-f00a-45a0-9540-e56d5c3a4add\") " pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:42.526966 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.526939 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/623ee436-f00a-45a0-9540-e56d5c3a4add-webhook-cert\") pod \"maas-controller-c87cdd8d8-wtmbj\" (UID: \"623ee436-f00a-45a0-9540-e56d5c3a4add\") " pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:42.533677 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.533646 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbl9x\" (UniqueName: \"kubernetes.io/projected/623ee436-f00a-45a0-9540-e56d5c3a4add-kube-api-access-qbl9x\") pod \"maas-controller-c87cdd8d8-wtmbj\" (UID: \"623ee436-f00a-45a0-9540-e56d5c3a4add\") " pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:42.612970 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.612902 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:42.625743 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.625704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9ht9\" (UniqueName: \"kubernetes.io/projected/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-kube-api-access-s9ht9\") pod \"maas-controller-f567dbd8b-ssklx\" (UID: \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\") " pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:42.625962 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.625932 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-webhook-cert\") pod \"maas-controller-f567dbd8b-ssklx\" (UID: \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\") " pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:42.727352 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.727316 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-webhook-cert\") pod \"maas-controller-f567dbd8b-ssklx\" (UID: \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\") " pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:42.727352 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.727360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9ht9\" (UniqueName: \"kubernetes.io/projected/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-kube-api-access-s9ht9\") pod \"maas-controller-f567dbd8b-ssklx\" (UID: \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\") " pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:42.730237 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.730200 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-webhook-cert\") pod \"maas-controller-f567dbd8b-ssklx\" (UID: \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\") " pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:42.737347 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.737313 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9ht9\" (UniqueName: \"kubernetes.io/projected/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-kube-api-access-s9ht9\") pod \"maas-controller-f567dbd8b-ssklx\" (UID: \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\") " pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:42.758133 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.758106 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c87cdd8d8-wtmbj"] Jun 12 19:24:42.758772 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:24:42.758746 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623ee436_f00a_45a0_9540_e56d5c3a4add.slice/crio-dcfba91afddbbd1f37fb9814558b1ba84324b5a201f65822c5c207ba11ebead7 WatchSource:0}: Error finding container dcfba91afddbbd1f37fb9814558b1ba84324b5a201f65822c5c207ba11ebead7: Status 404 returned error can't find the container with id dcfba91afddbbd1f37fb9814558b1ba84324b5a201f65822c5c207ba11ebead7 Jun 12 19:24:42.796760 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.796717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:42.940731 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:42.940706 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f567dbd8b-ssklx"] Jun 12 19:24:42.942229 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:24:42.942195 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d8e0ab_9b1e_4c05_810b_2f5eebf06a86.slice/crio-42e201edd91df9bf34c631cca350e0ceaa10965587a98b499ec2c6540afb4602 WatchSource:0}: Error finding container 42e201edd91df9bf34c631cca350e0ceaa10965587a98b499ec2c6540afb4602: Status 404 returned error can't find the container with id 42e201edd91df9bf34c631cca350e0ceaa10965587a98b499ec2c6540afb4602 Jun 12 19:24:43.761459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:43.761419 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f567dbd8b-ssklx" event={"ID":"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86","Type":"ContainerStarted","Data":"42e201edd91df9bf34c631cca350e0ceaa10965587a98b499ec2c6540afb4602"} Jun 12 19:24:43.764597 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:43.764552 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" event={"ID":"623ee436-f00a-45a0-9540-e56d5c3a4add","Type":"ContainerStarted","Data":"dcfba91afddbbd1f37fb9814558b1ba84324b5a201f65822c5c207ba11ebead7"} Jun 12 19:24:45.779508 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:45.779396 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" event={"ID":"623ee436-f00a-45a0-9540-e56d5c3a4add","Type":"ContainerStarted","Data":"d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf"} Jun 12 19:24:45.779508 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:45.779488 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:45.781076 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:45.781051 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f567dbd8b-ssklx" event={"ID":"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86","Type":"ContainerStarted","Data":"236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356"} Jun 12 19:24:45.781183 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:45.781171 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:45.848507 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:45.848448 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" podStartSLOduration=1.102737668 podStartE2EDuration="3.848428902s" totalImagesPullingTime="2.745691234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:24:45.835898509 +0000 UTC m=+798.492937645" watchObservedRunningTime="2026-06-12 19:24:45.848428902 +0000 UTC m=+798.505468062" Jun 12 19:24:45.912884 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:45.912824 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f567dbd8b-ssklx" podStartSLOduration=1.338100262 podStartE2EDuration="3.912804921s" totalImagesPullingTime="2.574704659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:24:45.912355303 +0000 UTC m=+798.569394470" watchObservedRunningTime="2026-06-12 19:24:45.912804921 +0000 UTC m=+798.569844120" Jun 12 19:24:56.792430 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:56.792394 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:56.792878 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:56.792464 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:24:56.858558 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:56.858495 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c87cdd8d8-wtmbj"] Jun 12 19:24:56.858748 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:56.858703 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" podUID="623ee436-f00a-45a0-9540-e56d5c3a4add" containerName="manager" containerID="cri-o://d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf" gracePeriod=30 Jun 12 19:24:57.110818 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.110793 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:57.164746 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.164709 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbl9x\" (UniqueName: \"kubernetes.io/projected/623ee436-f00a-45a0-9540-e56d5c3a4add-kube-api-access-qbl9x\") pod \"623ee436-f00a-45a0-9540-e56d5c3a4add\" (UID: \"623ee436-f00a-45a0-9540-e56d5c3a4add\") " Jun 12 19:24:57.164929 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.164756 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/623ee436-f00a-45a0-9540-e56d5c3a4add-webhook-cert\") pod \"623ee436-f00a-45a0-9540-e56d5c3a4add\" (UID: \"623ee436-f00a-45a0-9540-e56d5c3a4add\") " Jun 12 19:24:57.167091 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.167064 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/623ee436-f00a-45a0-9540-e56d5c3a4add-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "623ee436-f00a-45a0-9540-e56d5c3a4add" (UID: "623ee436-f00a-45a0-9540-e56d5c3a4add"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:24:57.167204 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.167098 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623ee436-f00a-45a0-9540-e56d5c3a4add-kube-api-access-qbl9x" (OuterVolumeSpecName: "kube-api-access-qbl9x") pod "623ee436-f00a-45a0-9540-e56d5c3a4add" (UID: "623ee436-f00a-45a0-9540-e56d5c3a4add"). InnerVolumeSpecName "kube-api-access-qbl9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:24:57.265549 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.265509 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbl9x\" (UniqueName: \"kubernetes.io/projected/623ee436-f00a-45a0-9540-e56d5c3a4add-kube-api-access-qbl9x\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:24:57.265549 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.265542 2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/623ee436-f00a-45a0-9540-e56d5c3a4add-webhook-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:24:57.856465 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.856432 2560 generic.go:356] "Generic (PLEG): container finished" podID="623ee436-f00a-45a0-9540-e56d5c3a4add" containerID="d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf" exitCode=0 Jun 12 19:24:57.856948 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.856478 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" Jun 12 19:24:57.856948 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.856523 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" event={"ID":"623ee436-f00a-45a0-9540-e56d5c3a4add","Type":"ContainerDied","Data":"d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf"} Jun 12 19:24:57.856948 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.856576 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c87cdd8d8-wtmbj" event={"ID":"623ee436-f00a-45a0-9540-e56d5c3a4add","Type":"ContainerDied","Data":"dcfba91afddbbd1f37fb9814558b1ba84324b5a201f65822c5c207ba11ebead7"} Jun 12 19:24:57.856948 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.856598 2560 scope.go:117] "RemoveContainer" containerID="d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf" Jun 12 19:24:57.866895 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.866707 2560 scope.go:117] "RemoveContainer" containerID="d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf" Jun 12 19:24:57.867043 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:24:57.867024 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf\": container with ID starting with d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf not found: ID does not exist" containerID="d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf" Jun 12 19:24:57.867087 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.867054 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf"} err="failed to get container status \"d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf\": rpc error: code = NotFound desc = could not find container \"d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf\": container with ID starting with d0dc51d3722f5a4942557e86c2083c433671b65be906509af223bb1a700856cf not found: ID does not exist" Jun 12 19:24:57.875723 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.875693 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c87cdd8d8-wtmbj"] Jun 12 19:24:57.882719 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:57.882691 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c87cdd8d8-wtmbj"] Jun 12 19:24:59.788047 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:24:59.788014 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="623ee436-f00a-45a0-9540-e56d5c3a4add" path="/var/lib/kubelet/pods/623ee436-f00a-45a0-9540-e56d5c3a4add/volumes" Jun 12 19:25:16.779889 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.779845 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-c54fb98fc-g272s"] Jun 12 19:25:16.780448 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.780431 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623ee436-f00a-45a0-9540-e56d5c3a4add" containerName="manager" Jun 12 19:25:16.780493 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.780451 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="623ee436-f00a-45a0-9540-e56d5c3a4add" containerName="manager" Jun 12 19:25:16.780568 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.780557 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="623ee436-f00a-45a0-9540-e56d5c3a4add" containerName="manager" Jun 12 19:25:16.784292 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.784264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:16.786995 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.786969 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 12 19:25:16.787139 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.786978 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hzd7j\"" Jun 12 19:25:16.793671 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.793643 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-c54fb98fc-g272s"] Jun 12 19:25:16.815509 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.815466 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0102096-bf36-43f8-8c7e-8e96a240b5df-openshift-service-ca\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:16.815509 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.815502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr8ww\" (UniqueName: \"kubernetes.io/projected/c0102096-bf36-43f8-8c7e-8e96a240b5df-kube-api-access-tr8ww\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:16.815734 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.815621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0102096-bf36-43f8-8c7e-8e96a240b5df-maas-api-tls\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:16.916632 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.916595 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0102096-bf36-43f8-8c7e-8e96a240b5df-openshift-service-ca\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:16.916789 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.916637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr8ww\" (UniqueName: \"kubernetes.io/projected/c0102096-bf36-43f8-8c7e-8e96a240b5df-kube-api-access-tr8ww\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:16.916789 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.916738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0102096-bf36-43f8-8c7e-8e96a240b5df-maas-api-tls\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:16.916909 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:25:16.916839 2560 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 12 19:25:16.916970 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:25:16.916910 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0102096-bf36-43f8-8c7e-8e96a240b5df-maas-api-tls podName:c0102096-bf36-43f8-8c7e-8e96a240b5df nodeName:}" failed. No retries permitted until 2026-06-12 19:25:17.416891809 +0000 UTC m=+830.073930927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c0102096-bf36-43f8-8c7e-8e96a240b5df-maas-api-tls") pod "maas-api-c54fb98fc-g272s" (UID: "c0102096-bf36-43f8-8c7e-8e96a240b5df") : secret "maas-api-serving-cert" not found Jun 12 19:25:16.917335 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.917303 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0102096-bf36-43f8-8c7e-8e96a240b5df-openshift-service-ca\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:16.926121 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:16.926094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr8ww\" (UniqueName: \"kubernetes.io/projected/c0102096-bf36-43f8-8c7e-8e96a240b5df-kube-api-access-tr8ww\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:17.421855 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.421782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0102096-bf36-43f8-8c7e-8e96a240b5df-maas-api-tls\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:17.424662 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.424629 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0102096-bf36-43f8-8c7e-8e96a240b5df-maas-api-tls\") pod \"maas-api-c54fb98fc-g272s\" (UID: \"c0102096-bf36-43f8-8c7e-8e96a240b5df\") " pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:17.462582 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.462534 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cpghg"] Jun 12 19:25:17.466250 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.466227 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" Jun 12 19:25:17.468760 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.468738 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fbh8d\"" Jun 12 19:25:17.468868 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.468740 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 19:25:17.476475 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.476448 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cpghg"] Jun 12 19:25:17.522476 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.522439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5srw\" (UniqueName: \"kubernetes.io/projected/05ff9ff6-3b20-4e1a-9dab-005e13c37686-kube-api-access-s5srw\") pod \"payload-pre-processing-579785bc64-cpghg\" (UID: \"05ff9ff6-3b20-4e1a-9dab-005e13c37686\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" Jun 12 19:25:17.624013 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.623967 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5srw\" (UniqueName: \"kubernetes.io/projected/05ff9ff6-3b20-4e1a-9dab-005e13c37686-kube-api-access-s5srw\") pod \"payload-pre-processing-579785bc64-cpghg\" (UID: \"05ff9ff6-3b20-4e1a-9dab-005e13c37686\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" Jun 12 19:25:17.633541 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.633513 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5srw\" (UniqueName: \"kubernetes.io/projected/05ff9ff6-3b20-4e1a-9dab-005e13c37686-kube-api-access-s5srw\") pod \"payload-pre-processing-579785bc64-cpghg\" (UID: \"05ff9ff6-3b20-4e1a-9dab-005e13c37686\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" Jun 12 19:25:17.697371 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.697275 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:17.778315 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.778283 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" Jun 12 19:25:17.855879 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.855839 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-c54fb98fc-g272s"] Jun 12 19:25:17.857801 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:25:17.857763 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0102096_bf36_43f8_8c7e_8e96a240b5df.slice/crio-fc7e969658efac02d1e7c592691a45220156d09626b3d3dd196cf00642ae78b8 WatchSource:0}: Error finding container fc7e969658efac02d1e7c592691a45220156d09626b3d3dd196cf00642ae78b8: Status 404 returned error can't find the container with id fc7e969658efac02d1e7c592691a45220156d09626b3d3dd196cf00642ae78b8 Jun 12 19:25:17.941954 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.941912 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cpghg"] Jun 12 19:25:17.943850 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:25:17.943822 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ff9ff6_3b20_4e1a_9dab_005e13c37686.slice/crio-f9b0628807a68af92b8005fb06fb3240818977dc4a188a2772f394689ed929dc WatchSource:0}: Error finding container f9b0628807a68af92b8005fb06fb3240818977dc4a188a2772f394689ed929dc: Status 404 returned error can't find the container with id f9b0628807a68af92b8005fb06fb3240818977dc4a188a2772f394689ed929dc Jun 12 19:25:17.976817 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.976778 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c54fb98fc-g272s" event={"ID":"c0102096-bf36-43f8-8c7e-8e96a240b5df","Type":"ContainerStarted","Data":"fc7e969658efac02d1e7c592691a45220156d09626b3d3dd196cf00642ae78b8"} Jun 12 19:25:17.978147 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:17.978122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" event={"ID":"05ff9ff6-3b20-4e1a-9dab-005e13c37686","Type":"ContainerStarted","Data":"f9b0628807a68af92b8005fb06fb3240818977dc4a188a2772f394689ed929dc"} Jun 12 19:25:21.000370 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:21.000327 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c54fb98fc-g272s" event={"ID":"c0102096-bf36-43f8-8c7e-8e96a240b5df","Type":"ContainerStarted","Data":"9fdffbe896bcf85fa8f97c33bcd3c3e9d5fceb0b92fca87ca1f5bbdd39aa2ece"} Jun 12 19:25:21.000843 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:21.000446 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:21.001988 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:21.001962 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" event={"ID":"05ff9ff6-3b20-4e1a-9dab-005e13c37686","Type":"ContainerStarted","Data":"abedb168622c6d857b97c5a25f1bd8c91d9b6233d53671cafeafaaadd128131e"} Jun 12 19:25:21.002094 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:21.002006 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" Jun 12 19:25:21.020320 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:21.020265 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-c54fb98fc-g272s" podStartSLOduration=2.360043963 podStartE2EDuration="5.02024701s" totalImagesPullingTime="2.660203047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:25:21.016590908 +0000 UTC m=+833.673630048" watchObservedRunningTime="2026-06-12 19:25:21.02024701 +0000 UTC m=+833.677286150" Jun 12 19:25:21.034835 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:21.034785 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" podStartSLOduration=1.461498888 podStartE2EDuration="4.034771006s" totalImagesPullingTime="2.573272118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:25:21.033396482 +0000 UTC m=+833.690435624" watchObservedRunningTime="2026-06-12 19:25:21.034771006 +0000 UTC m=+833.691810144" Jun 12 19:25:27.013837 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:27.013790 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-c54fb98fc-g272s" Jun 12 19:25:28.220684 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:28.220572 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:25:28.221228 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:28.220836 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" containerID="cri-o://4e408bf80299d31a780557fc48dd6b815fdbae6caf1bad0afc9c04cef8c98e0a" gracePeriod=30 Jun 12 19:25:30.056198 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:30.056109 2560 generic.go:356] "Generic (PLEG): container finished" podID="66bd5837-54f9-4051-9ae2-d26710f53742" containerID="4e408bf80299d31a780557fc48dd6b815fdbae6caf1bad0afc9c04cef8c98e0a" exitCode=143 Jun 12 19:25:30.056198 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:30.056181 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66bd5837-54f9-4051-9ae2-d26710f53742","Type":"ContainerDied","Data":"4e408bf80299d31a780557fc48dd6b815fdbae6caf1bad0afc9c04cef8c98e0a"} Jun 12 19:25:30.293143 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:30.293114 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:30.351606 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:30.351342 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qmh9\" (UniqueName: \"kubernetes.io/projected/66bd5837-54f9-4051-9ae2-d26710f53742-kube-api-access-5qmh9\") pod \"66bd5837-54f9-4051-9ae2-d26710f53742\" (UID: \"66bd5837-54f9-4051-9ae2-d26710f53742\") " Jun 12 19:25:30.353859 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:30.353809 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66bd5837-54f9-4051-9ae2-d26710f53742-kube-api-access-5qmh9" (OuterVolumeSpecName: "kube-api-access-5qmh9") pod "66bd5837-54f9-4051-9ae2-d26710f53742" (UID: "66bd5837-54f9-4051-9ae2-d26710f53742"). InnerVolumeSpecName "kube-api-access-5qmh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:25:30.452810 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:30.452755 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qmh9\" (UniqueName: \"kubernetes.io/projected/66bd5837-54f9-4051-9ae2-d26710f53742-kube-api-access-5qmh9\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:25:31.063140 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.063098 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66bd5837-54f9-4051-9ae2-d26710f53742","Type":"ContainerDied","Data":"74d93e30b81458e31ba3c5a22d216e3f0021e4b3b79dfffd33b1a1561096ed36"} Jun 12 19:25:31.063140 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.063140 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:31.063663 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.063166 2560 scope.go:117] "RemoveContainer" containerID="4e408bf80299d31a780557fc48dd6b815fdbae6caf1bad0afc9c04cef8c98e0a" Jun 12 19:25:31.106230 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.106187 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:25:31.110294 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.110265 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:25:31.145465 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.145425 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:25:31.145864 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.145847 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" Jun 12 19:25:31.145904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.145868 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" Jun 12 19:25:31.145993 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.145982 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" containerName="keycloak" Jun 12 19:25:31.150637 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.150611 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:31.153557 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.153531 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lr2gl\"" Jun 12 19:25:31.154747 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.154728 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 19:25:31.154954 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.154910 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 12 19:25:31.154954 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.154951 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 19:25:31.155135 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.155063 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 19:25:31.169706 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.169673 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:25:31.260433 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.260389 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5586d628-afb5-4e7f-a1b2-131b1dd89d4f-test-realms\") pod \"maas-keycloak-0\" (UID: \"5586d628-afb5-4e7f-a1b2-131b1dd89d4f\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:31.260622 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.260457 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99pcq\" (UniqueName: \"kubernetes.io/projected/5586d628-afb5-4e7f-a1b2-131b1dd89d4f-kube-api-access-99pcq\") pod \"maas-keycloak-0\" (UID: \"5586d628-afb5-4e7f-a1b2-131b1dd89d4f\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:31.361865 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.361834 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5586d628-afb5-4e7f-a1b2-131b1dd89d4f-test-realms\") pod \"maas-keycloak-0\" (UID: \"5586d628-afb5-4e7f-a1b2-131b1dd89d4f\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:31.362092 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.361900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99pcq\" (UniqueName: \"kubernetes.io/projected/5586d628-afb5-4e7f-a1b2-131b1dd89d4f-kube-api-access-99pcq\") pod \"maas-keycloak-0\" (UID: \"5586d628-afb5-4e7f-a1b2-131b1dd89d4f\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:31.362626 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.362599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5586d628-afb5-4e7f-a1b2-131b1dd89d4f-test-realms\") pod \"maas-keycloak-0\" (UID: \"5586d628-afb5-4e7f-a1b2-131b1dd89d4f\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:31.371650 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.371623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99pcq\" (UniqueName: \"kubernetes.io/projected/5586d628-afb5-4e7f-a1b2-131b1dd89d4f-kube-api-access-99pcq\") pod \"maas-keycloak-0\" (UID: \"5586d628-afb5-4e7f-a1b2-131b1dd89d4f\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:31.461057 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.461011 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:31.638140 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.638108 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:25:31.639256 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:25:31.639223 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5586d628_afb5_4e7f_a1b2_131b1dd89d4f.slice/crio-f4a9f9662b36d220d3494cef76815ebfe5359a822a8a2d9e96dbe1ab8532886e WatchSource:0}: Error finding container f4a9f9662b36d220d3494cef76815ebfe5359a822a8a2d9e96dbe1ab8532886e: Status 404 returned error can't find the container with id f4a9f9662b36d220d3494cef76815ebfe5359a822a8a2d9e96dbe1ab8532886e Jun 12 19:25:31.788935 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:31.788894 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66bd5837-54f9-4051-9ae2-d26710f53742" path="/var/lib/kubelet/pods/66bd5837-54f9-4051-9ae2-d26710f53742/volumes" Jun 12 19:25:32.010676 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:32.010641 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-cpghg" Jun 12 19:25:32.072311 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:32.072273 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5586d628-afb5-4e7f-a1b2-131b1dd89d4f","Type":"ContainerStarted","Data":"f4a9f9662b36d220d3494cef76815ebfe5359a822a8a2d9e96dbe1ab8532886e"} Jun 12 19:25:33.083619 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:33.083562 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5586d628-afb5-4e7f-a1b2-131b1dd89d4f","Type":"ContainerStarted","Data":"969ce011b6a7c7214ec233d06596cd1dafa0c56502b0616031ccd79d11ffac41"} Jun 12 19:25:33.105287 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:33.105233 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.742061583 podStartE2EDuration="2.105215404s" totalImagesPullingTime="363.153821ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:25:33.10258197 +0000 UTC m=+845.759621109" watchObservedRunningTime="2026-06-12 19:25:33.105215404 +0000 UTC m=+845.762254543" Jun 12 19:25:33.461479 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:33.461428 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:33.463469 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:33.463423 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:34.461568 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:34.461513 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:35.462360 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:35.462309 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:36.462483 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:36.462423 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:37.462548 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:37.462493 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:38.461622 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:38.461574 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:39.461510 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:39.461460 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:40.462396 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:40.462345 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:41.461506 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:41.461459 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:41.461846 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:41.461809 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:42.462376 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:42.462316 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:43.462514 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:43.462456 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:44.462206 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:44.462150 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:45.462436 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:45.462382 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 12 19:25:46.594025 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:46.593981 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 19:25:46.612451 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:46.612391 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="5586d628-afb5-4e7f-a1b2-131b1dd89d4f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 19:25:56.600426 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:25:56.600381 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 19:26:07.292967 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.292912 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84565d4874-gzdw4"] Jun 12 19:26:07.300346 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.300321 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.303261 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.303240 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 12 19:26:07.308393 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.308363 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84565d4874-gzdw4"] Jun 12 19:26:07.430843 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.430799 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjwj\" (UniqueName: \"kubernetes.io/projected/12f8afd9-eb29-403f-a608-d61afe3ebfe3-kube-api-access-nwjwj\") pod \"authorino-84565d4874-gzdw4\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.431065 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.430861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/12f8afd9-eb29-403f-a608-d61afe3ebfe3-oidc-ca\") pod \"authorino-84565d4874-gzdw4\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.431065 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.431023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12f8afd9-eb29-403f-a608-d61afe3ebfe3-tls-cert\") pod \"authorino-84565d4874-gzdw4\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.532535 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.532490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12f8afd9-eb29-403f-a608-d61afe3ebfe3-tls-cert\") pod \"authorino-84565d4874-gzdw4\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.532705 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.532550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjwj\" (UniqueName: \"kubernetes.io/projected/12f8afd9-eb29-403f-a608-d61afe3ebfe3-kube-api-access-nwjwj\") pod \"authorino-84565d4874-gzdw4\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.532705 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.532577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/12f8afd9-eb29-403f-a608-d61afe3ebfe3-oidc-ca\") pod \"authorino-84565d4874-gzdw4\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.533282 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.533212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/12f8afd9-eb29-403f-a608-d61afe3ebfe3-oidc-ca\") pod \"authorino-84565d4874-gzdw4\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.535053 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.535032 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12f8afd9-eb29-403f-a608-d61afe3ebfe3-tls-cert\") pod \"authorino-84565d4874-gzdw4\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.540905 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.540886 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjwj\" (UniqueName: \"kubernetes.io/projected/12f8afd9-eb29-403f-a608-d61afe3ebfe3-kube-api-access-nwjwj\") pod \"authorino-84565d4874-gzdw4\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.633072 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.633026 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:26:07.779585 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:07.779557 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84565d4874-gzdw4"] Jun 12 19:26:07.780884 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:26:07.780860 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12f8afd9_eb29_403f_a608_d61afe3ebfe3.slice/crio-56e38ef603b0d51c3524c788d44f5924c9669ed89f07deb91bca8d0db9b2a85c WatchSource:0}: Error finding container 56e38ef603b0d51c3524c788d44f5924c9669ed89f07deb91bca8d0db9b2a85c: Status 404 returned error can't find the container with id 56e38ef603b0d51c3524c788d44f5924c9669ed89f07deb91bca8d0db9b2a85c Jun 12 19:26:08.360880 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.360845 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84565d4874-gzdw4" event={"ID":"12f8afd9-eb29-403f-a608-d61afe3ebfe3","Type":"ContainerStarted","Data":"0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec"} Jun 12 19:26:08.360880 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.360886 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84565d4874-gzdw4" event={"ID":"12f8afd9-eb29-403f-a608-d61afe3ebfe3","Type":"ContainerStarted","Data":"56e38ef603b0d51c3524c788d44f5924c9669ed89f07deb91bca8d0db9b2a85c"} Jun 12 19:26:08.379559 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.379505 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84565d4874-gzdw4" podStartSLOduration=0.975566291 podStartE2EDuration="1.379488695s" totalImagesPullingTime="403.922404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:26:08.377492622 +0000 UTC m=+881.034531773" watchObservedRunningTime="2026-06-12 19:26:08.379488695 +0000 UTC m=+881.036527854" Jun 12 19:26:08.409707 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.409667 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f97c78d56-gzb52"] Jun 12 19:26:08.409903 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.409863 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6f97c78d56-gzb52" podUID="00b6c53b-f189-43ae-a257-fec6b0ff47d7" containerName="authorino" containerID="cri-o://ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7" gracePeriod=30 Jun 12 19:26:08.673848 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.673815 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:26:08.746138 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.746094 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x68sp\" (UniqueName: \"kubernetes.io/projected/00b6c53b-f189-43ae-a257-fec6b0ff47d7-kube-api-access-x68sp\") pod \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\" (UID: \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\") " Jun 12 19:26:08.746315 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.746145 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00b6c53b-f189-43ae-a257-fec6b0ff47d7-tls-cert\") pod \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\" (UID: \"00b6c53b-f189-43ae-a257-fec6b0ff47d7\") " Jun 12 19:26:08.748402 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.748374 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b6c53b-f189-43ae-a257-fec6b0ff47d7-kube-api-access-x68sp" (OuterVolumeSpecName: "kube-api-access-x68sp") pod "00b6c53b-f189-43ae-a257-fec6b0ff47d7" (UID: "00b6c53b-f189-43ae-a257-fec6b0ff47d7"). InnerVolumeSpecName "kube-api-access-x68sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:26:08.759605 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.759575 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00b6c53b-f189-43ae-a257-fec6b0ff47d7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "00b6c53b-f189-43ae-a257-fec6b0ff47d7" (UID: "00b6c53b-f189-43ae-a257-fec6b0ff47d7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:26:08.847873 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.847762 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x68sp\" (UniqueName: \"kubernetes.io/projected/00b6c53b-f189-43ae-a257-fec6b0ff47d7-kube-api-access-x68sp\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:26:08.847873 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:08.847805 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00b6c53b-f189-43ae-a257-fec6b0ff47d7-tls-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:26:09.368359 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.368327 2560 generic.go:356] "Generic (PLEG): container finished" podID="00b6c53b-f189-43ae-a257-fec6b0ff47d7" containerID="ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7" exitCode=0 Jun 12 19:26:09.368777 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.368372 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f97c78d56-gzb52" Jun 12 19:26:09.368777 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.368421 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f97c78d56-gzb52" event={"ID":"00b6c53b-f189-43ae-a257-fec6b0ff47d7","Type":"ContainerDied","Data":"ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7"} Jun 12 19:26:09.368777 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.368460 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f97c78d56-gzb52" event={"ID":"00b6c53b-f189-43ae-a257-fec6b0ff47d7","Type":"ContainerDied","Data":"cfd2c3ce83774b6712e6df698ce90d1231dc3654cbb042e56205c085dc649fe9"} Jun 12 19:26:09.368777 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.368478 2560 scope.go:117] "RemoveContainer" containerID="ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7" Jun 12 19:26:09.378375 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.378349 2560 scope.go:117] "RemoveContainer" containerID="ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7" Jun 12 19:26:09.378690 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:26:09.378667 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7\": container with ID starting with ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7 not found: ID does not exist" containerID="ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7" Jun 12 19:26:09.378763 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.378705 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7"} err="failed to get container status \"ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7\": rpc error: code = NotFound desc = could not find container \"ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7\": container with ID starting with ac6d032a6fc188ec0e32bd6f2e2e56d98f5c3cd93fdbddc441897dfca8ffa6e7 not found: ID does not exist" Jun 12 19:26:09.401954 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.401901 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f97c78d56-gzb52"] Jun 12 19:26:09.411291 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.411261 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f97c78d56-gzb52"] Jun 12 19:26:09.790162 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:09.790132 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b6c53b-f189-43ae-a257-fec6b0ff47d7" path="/var/lib/kubelet/pods/00b6c53b-f189-43ae-a257-fec6b0ff47d7/volumes" Jun 12 19:26:27.812835 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:27.812803 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:26:27.813279 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:27.813086 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:26:41.144509 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.144464 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2"] Jun 12 19:26:41.145030 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.144866 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b6c53b-f189-43ae-a257-fec6b0ff47d7" containerName="authorino" Jun 12 19:26:41.145030 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.144878 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b6c53b-f189-43ae-a257-fec6b0ff47d7" containerName="authorino" Jun 12 19:26:41.145030 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.144984 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b6c53b-f189-43ae-a257-fec6b0ff47d7" containerName="authorino" Jun 12 19:26:41.149670 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.149648 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.153429 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.153407 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 12 19:26:41.153567 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.153447 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 19:26:41.153567 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.153407 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x5hqk\"" Jun 12 19:26:41.153567 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.153408 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 19:26:41.158606 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.158579 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2"] Jun 12 19:26:41.243003 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.242961 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.243178 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.243030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4lft\" (UniqueName: \"kubernetes.io/projected/033c1bf7-f9f8-4bff-98ad-387d0558c76c-kube-api-access-b4lft\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.243178 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.243068 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/033c1bf7-f9f8-4bff-98ad-387d0558c76c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.243178 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.243118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.243294 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.243190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.243294 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.243216 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.344564 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.344523 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.344762 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.344588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4lft\" (UniqueName: \"kubernetes.io/projected/033c1bf7-f9f8-4bff-98ad-387d0558c76c-kube-api-access-b4lft\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.344762 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.344627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/033c1bf7-f9f8-4bff-98ad-387d0558c76c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.344762 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.344642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.344762 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.344680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.345011 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.344835 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.345068 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.345054 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.345125 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.345104 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.345269 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.345246 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.347129 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.347100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/033c1bf7-f9f8-4bff-98ad-387d0558c76c-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.347297 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.347281 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/033c1bf7-f9f8-4bff-98ad-387d0558c76c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.352746 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.352718 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4lft\" (UniqueName: \"kubernetes.io/projected/033c1bf7-f9f8-4bff-98ad-387d0558c76c-kube-api-access-b4lft\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2\" (UID: \"033c1bf7-f9f8-4bff-98ad-387d0558c76c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.462000 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.461851 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:41.610649 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:41.610622 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2"] Jun 12 19:26:41.611475 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:26:41.611446 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033c1bf7_f9f8_4bff_98ad_387d0558c76c.slice/crio-fc50ea25c77222789570b3bbf2d80f2fd133da1d0b461aaf15b64e2d72c38843 WatchSource:0}: Error finding container fc50ea25c77222789570b3bbf2d80f2fd133da1d0b461aaf15b64e2d72c38843: Status 404 returned error can't find the container with id fc50ea25c77222789570b3bbf2d80f2fd133da1d0b461aaf15b64e2d72c38843 Jun 12 19:26:42.580613 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:42.580564 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" event={"ID":"033c1bf7-f9f8-4bff-98ad-387d0558c76c","Type":"ContainerStarted","Data":"fc50ea25c77222789570b3bbf2d80f2fd133da1d0b461aaf15b64e2d72c38843"} Jun 12 19:26:45.603632 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:45.603591 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" event={"ID":"033c1bf7-f9f8-4bff-98ad-387d0558c76c","Type":"ContainerStarted","Data":"cd935d7a2fd7340337aa81973cd59803cffd8382f6232624d7e025e9e2fa1ea2"} Jun 12 19:26:46.611362 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:46.611317 2560 generic.go:356] "Generic (PLEG): container finished" podID="033c1bf7-f9f8-4bff-98ad-387d0558c76c" containerID="cd935d7a2fd7340337aa81973cd59803cffd8382f6232624d7e025e9e2fa1ea2" exitCode=0 Jun 12 19:26:46.622056 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:46.611391 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" event={"ID":"033c1bf7-f9f8-4bff-98ad-387d0558c76c","Type":"ContainerDied","Data":"cd935d7a2fd7340337aa81973cd59803cffd8382f6232624d7e025e9e2fa1ea2"} Jun 12 19:26:48.625816 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:48.625773 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" event={"ID":"033c1bf7-f9f8-4bff-98ad-387d0558c76c","Type":"ContainerStarted","Data":"d93807f3526b0adee4715359d8f138bf9341b369dd375d8880e8dbed1e2f8a94"} Jun 12 19:26:48.645529 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:48.645470 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" podStartSLOduration=1.984948126 podStartE2EDuration="7.645451879s" totalImagesPullingTime="4.269869658s" totalInitContainerRuntime="1.390634095s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:26:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:26:48.64439231 +0000 UTC m=+921.301431449" watchObservedRunningTime="2026-06-12 19:26:48.645451879 +0000 UTC m=+921.302491018" Jun 12 19:26:51.462150 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:51.462101 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:51.462613 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:51.462180 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:51.475293 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:51.475265 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:26:51.655008 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:26:51.654979 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2" Jun 12 19:27:21.240456 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.240416 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r"] Jun 12 19:27:21.244164 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.244140 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.246801 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.246778 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 12 19:27:21.255796 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.255631 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r"] Jun 12 19:27:21.317504 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.317445 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.317504 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.317510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhlls\" (UniqueName: \"kubernetes.io/projected/11f0d875-339e-44d5-9fc7-018874201445-kube-api-access-mhlls\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.317737 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.317549 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f0d875-339e-44d5-9fc7-018874201445-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.317737 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.317570 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.317737 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.317612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.317737 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.317654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.418611 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.418573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f0d875-339e-44d5-9fc7-018874201445-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.418611 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.418613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.418897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.418659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.418897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.418688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.418897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.418715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.418897 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.418747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhlls\" (UniqueName: \"kubernetes.io/projected/11f0d875-339e-44d5-9fc7-018874201445-kube-api-access-mhlls\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.419244 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.419216 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.419368 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.419266 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.419368 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.419313 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.421458 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.421426 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f0d875-339e-44d5-9fc7-018874201445-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.421662 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.421647 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f0d875-339e-44d5-9fc7-018874201445-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.432105 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.432070 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhlls\" (UniqueName: \"kubernetes.io/projected/11f0d875-339e-44d5-9fc7-018874201445-kube-api-access-mhlls\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-p4s5r\" (UID: \"11f0d875-339e-44d5-9fc7-018874201445\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.554469 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.554374 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:21.703512 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.703468 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r"] Jun 12 19:27:21.704428 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:27:21.704401 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f0d875_339e_44d5_9fc7_018874201445.slice/crio-f6958ba3ade12b88b1b26c6791631913aaaf4280a5ecdc2dc0642ec010d7e32a WatchSource:0}: Error finding container f6958ba3ade12b88b1b26c6791631913aaaf4280a5ecdc2dc0642ec010d7e32a: Status 404 returned error can't find the container with id f6958ba3ade12b88b1b26c6791631913aaaf4280a5ecdc2dc0642ec010d7e32a Jun 12 19:27:21.828246 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.828133 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" event={"ID":"11f0d875-339e-44d5-9fc7-018874201445","Type":"ContainerStarted","Data":"22145cc19606a26893f31fd9771715a549f4fe07c61bc88e204fe7e02273cb85"} Jun 12 19:27:21.828246 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:21.828202 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" event={"ID":"11f0d875-339e-44d5-9fc7-018874201445","Type":"ContainerStarted","Data":"f6958ba3ade12b88b1b26c6791631913aaaf4280a5ecdc2dc0642ec010d7e32a"} Jun 12 19:27:23.842553 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:23.842517 2560 generic.go:356] "Generic (PLEG): container finished" podID="11f0d875-339e-44d5-9fc7-018874201445" containerID="22145cc19606a26893f31fd9771715a549f4fe07c61bc88e204fe7e02273cb85" exitCode=0 Jun 12 19:27:23.842986 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:23.842591 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" event={"ID":"11f0d875-339e-44d5-9fc7-018874201445","Type":"ContainerDied","Data":"22145cc19606a26893f31fd9771715a549f4fe07c61bc88e204fe7e02273cb85"} Jun 12 19:27:23.843204 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:23.843187 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:27:24.851856 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:24.851820 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" event={"ID":"11f0d875-339e-44d5-9fc7-018874201445","Type":"ContainerStarted","Data":"8f7911dafd7eb880eef99c9835fb8844e7d95bb2e4a66cd8f757d561582c0dd0"} Jun 12 19:27:24.870658 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:24.870603 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" podStartSLOduration=2.384718005 podStartE2EDuration="3.870586851s" totalImagesPullingTime="193.761081ms" totalInitContainerRuntime="1.292107765s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:27:24.869849324 +0000 UTC m=+957.526888464" watchObservedRunningTime="2026-06-12 19:27:24.870586851 +0000 UTC m=+957.527625989" Jun 12 19:27:31.554731 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:31.554692 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:31.555232 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:31.554748 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:31.568365 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:31.568331 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:27:31.910429 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:27:31.910394 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-p4s5r" Jun 12 19:28:22.084355 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.084316 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58dc8cd9f-wfnm2"] Jun 12 19:28:22.088315 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.088290 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.093708 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.093675 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58dc8cd9f-wfnm2"] Jun 12 19:28:22.175832 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.175800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f90bcc3-2382-4d18-83ff-43609bbb657b-tls-cert\") pod \"authorino-58dc8cd9f-wfnm2\" (UID: \"5f90bcc3-2382-4d18-83ff-43609bbb657b\") " pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.175832 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.175842 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f90bcc3-2382-4d18-83ff-43609bbb657b-oidc-ca\") pod \"authorino-58dc8cd9f-wfnm2\" (UID: \"5f90bcc3-2382-4d18-83ff-43609bbb657b\") " pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.176087 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.175966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr89t\" (UniqueName: \"kubernetes.io/projected/5f90bcc3-2382-4d18-83ff-43609bbb657b-kube-api-access-hr89t\") pod \"authorino-58dc8cd9f-wfnm2\" (UID: \"5f90bcc3-2382-4d18-83ff-43609bbb657b\") " pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.277142 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.277089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr89t\" (UniqueName: \"kubernetes.io/projected/5f90bcc3-2382-4d18-83ff-43609bbb657b-kube-api-access-hr89t\") pod \"authorino-58dc8cd9f-wfnm2\" (UID: \"5f90bcc3-2382-4d18-83ff-43609bbb657b\") " pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.277336 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.277174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f90bcc3-2382-4d18-83ff-43609bbb657b-tls-cert\") pod \"authorino-58dc8cd9f-wfnm2\" (UID: \"5f90bcc3-2382-4d18-83ff-43609bbb657b\") " pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.277336 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.277213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f90bcc3-2382-4d18-83ff-43609bbb657b-oidc-ca\") pod \"authorino-58dc8cd9f-wfnm2\" (UID: \"5f90bcc3-2382-4d18-83ff-43609bbb657b\") " pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.278045 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.278011 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f90bcc3-2382-4d18-83ff-43609bbb657b-oidc-ca\") pod \"authorino-58dc8cd9f-wfnm2\" (UID: \"5f90bcc3-2382-4d18-83ff-43609bbb657b\") " pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.279772 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.279748 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f90bcc3-2382-4d18-83ff-43609bbb657b-tls-cert\") pod \"authorino-58dc8cd9f-wfnm2\" (UID: \"5f90bcc3-2382-4d18-83ff-43609bbb657b\") " pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.285547 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.285521 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr89t\" (UniqueName: \"kubernetes.io/projected/5f90bcc3-2382-4d18-83ff-43609bbb657b-kube-api-access-hr89t\") pod \"authorino-58dc8cd9f-wfnm2\" (UID: \"5f90bcc3-2382-4d18-83ff-43609bbb657b\") " pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.400234 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.400185 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" Jun 12 19:28:22.547450 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:22.547420 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58dc8cd9f-wfnm2"] Jun 12 19:28:22.548526 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:28:22.548497 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f90bcc3_2382_4d18_83ff_43609bbb657b.slice/crio-ceb78d462774fc70bd6b25db9ea0cc83190c98131430418a35308714820e9966 WatchSource:0}: Error finding container ceb78d462774fc70bd6b25db9ea0cc83190c98131430418a35308714820e9966: Status 404 returned error can't find the container with id ceb78d462774fc70bd6b25db9ea0cc83190c98131430418a35308714820e9966 Jun 12 19:28:23.211872 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.211828 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" event={"ID":"5f90bcc3-2382-4d18-83ff-43609bbb657b","Type":"ContainerStarted","Data":"71b06e1801e16351a7dbae4af2995b2e8b75b6ea410bc8b2652ea3180e80ec78"} Jun 12 19:28:23.212509 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.211958 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" event={"ID":"5f90bcc3-2382-4d18-83ff-43609bbb657b","Type":"ContainerStarted","Data":"ceb78d462774fc70bd6b25db9ea0cc83190c98131430418a35308714820e9966"} Jun 12 19:28:23.230038 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.229986 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58dc8cd9f-wfnm2" podStartSLOduration=0.718227541 podStartE2EDuration="1.229967704s" totalImagesPullingTime="511.740163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:28:23.227303315 +0000 UTC m=+1015.884342454" watchObservedRunningTime="2026-06-12 19:28:23.229967704 +0000 UTC m=+1015.887006847" Jun 12 19:28:23.255595 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.255555 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84565d4874-gzdw4"] Jun 12 19:28:23.255796 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.255744 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-84565d4874-gzdw4" podUID="12f8afd9-eb29-403f-a608-d61afe3ebfe3" containerName="authorino" containerID="cri-o://0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec" gracePeriod=30 Jun 12 19:28:23.544160 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.544121 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:28:23.590697 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.590577 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwjwj\" (UniqueName: \"kubernetes.io/projected/12f8afd9-eb29-403f-a608-d61afe3ebfe3-kube-api-access-nwjwj\") pod \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " Jun 12 19:28:23.590697 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.590639 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12f8afd9-eb29-403f-a608-d61afe3ebfe3-tls-cert\") pod \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " Jun 12 19:28:23.590981 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.590760 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/12f8afd9-eb29-403f-a608-d61afe3ebfe3-oidc-ca\") pod \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\" (UID: \"12f8afd9-eb29-403f-a608-d61afe3ebfe3\") " Jun 12 19:28:23.593633 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.593589 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12f8afd9-eb29-403f-a608-d61afe3ebfe3-kube-api-access-nwjwj" (OuterVolumeSpecName: "kube-api-access-nwjwj") pod "12f8afd9-eb29-403f-a608-d61afe3ebfe3" (UID: "12f8afd9-eb29-403f-a608-d61afe3ebfe3"). InnerVolumeSpecName "kube-api-access-nwjwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:28:23.599065 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.599031 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12f8afd9-eb29-403f-a608-d61afe3ebfe3-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "12f8afd9-eb29-403f-a608-d61afe3ebfe3" (UID: "12f8afd9-eb29-403f-a608-d61afe3ebfe3"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:28:23.604115 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.604079 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12f8afd9-eb29-403f-a608-d61afe3ebfe3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "12f8afd9-eb29-403f-a608-d61afe3ebfe3" (UID: "12f8afd9-eb29-403f-a608-d61afe3ebfe3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:28:23.692111 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.692072 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwjwj\" (UniqueName: \"kubernetes.io/projected/12f8afd9-eb29-403f-a608-d61afe3ebfe3-kube-api-access-nwjwj\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:28:23.692364 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.692345 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12f8afd9-eb29-403f-a608-d61afe3ebfe3-tls-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:28:23.692459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:23.692447 2560 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/12f8afd9-eb29-403f-a608-d61afe3ebfe3-oidc-ca\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:28:24.221669 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:24.221636 2560 generic.go:356] "Generic (PLEG): container finished" podID="12f8afd9-eb29-403f-a608-d61afe3ebfe3" containerID="0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec" exitCode=0 Jun 12 19:28:24.222180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:24.221702 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84565d4874-gzdw4" Jun 12 19:28:24.222180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:24.221727 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84565d4874-gzdw4" event={"ID":"12f8afd9-eb29-403f-a608-d61afe3ebfe3","Type":"ContainerDied","Data":"0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec"} Jun 12 19:28:24.222180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:24.221782 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84565d4874-gzdw4" event={"ID":"12f8afd9-eb29-403f-a608-d61afe3ebfe3","Type":"ContainerDied","Data":"56e38ef603b0d51c3524c788d44f5924c9669ed89f07deb91bca8d0db9b2a85c"} Jun 12 19:28:24.222180 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:24.221805 2560 scope.go:117] "RemoveContainer" containerID="0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec" Jun 12 19:28:24.232122 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:24.232102 2560 scope.go:117] "RemoveContainer" containerID="0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec" Jun 12 19:28:24.232476 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:28:24.232454 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec\": container with ID starting with 0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec not found: ID does not exist" containerID="0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec" Jun 12 19:28:24.232533 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:24.232484 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec"} err="failed to get container status \"0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec\": rpc error: code = NotFound desc = could not find container \"0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec\": container with ID starting with 0dd82c37c82d658fee99cab3dc6df9e55b01d120cb93d9bac65f201c511be8ec not found: ID does not exist" Jun 12 19:28:24.241118 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:24.241084 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84565d4874-gzdw4"] Jun 12 19:28:24.243970 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:24.243904 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84565d4874-gzdw4"] Jun 12 19:28:25.790005 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:28:25.789974 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12f8afd9-eb29-403f-a608-d61afe3ebfe3" path="/var/lib/kubelet/pods/12f8afd9-eb29-403f-a608-d61afe3ebfe3/volumes" Jun 12 19:29:50.156728 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.156687 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f567dbd8b-ssklx"] Jun 12 19:29:50.157321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.156977 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f567dbd8b-ssklx" podUID="08d8e0ab-9b1e-4c05-810b-2f5eebf06a86" containerName="manager" containerID="cri-o://236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356" gracePeriod=30 Jun 12 19:29:50.410201 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.410129 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:29:50.498800 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.498764 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9ht9\" (UniqueName: \"kubernetes.io/projected/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-kube-api-access-s9ht9\") pod \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\" (UID: \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\") " Jun 12 19:29:50.499024 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.498817 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-webhook-cert\") pod \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\" (UID: \"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86\") " Jun 12 19:29:50.501209 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.501174 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-kube-api-access-s9ht9" (OuterVolumeSpecName: "kube-api-access-s9ht9") pod "08d8e0ab-9b1e-4c05-810b-2f5eebf06a86" (UID: "08d8e0ab-9b1e-4c05-810b-2f5eebf06a86"). InnerVolumeSpecName "kube-api-access-s9ht9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:29:50.501351 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.501208 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "08d8e0ab-9b1e-4c05-810b-2f5eebf06a86" (UID: "08d8e0ab-9b1e-4c05-810b-2f5eebf06a86"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:29:50.600126 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.600088 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9ht9\" (UniqueName: \"kubernetes.io/projected/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-kube-api-access-s9ht9\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:29:50.600126 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.600119 2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86-webhook-cert\") on node \"ip-10-0-133-180.ec2.internal\" DevicePath \"\"" Jun 12 19:29:50.768455 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.768361 2560 generic.go:356] "Generic (PLEG): container finished" podID="08d8e0ab-9b1e-4c05-810b-2f5eebf06a86" containerID="236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356" exitCode=0 Jun 12 19:29:50.768455 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.768413 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f567dbd8b-ssklx" event={"ID":"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86","Type":"ContainerDied","Data":"236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356"} Jun 12 19:29:50.768455 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.768423 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f567dbd8b-ssklx" Jun 12 19:29:50.768692 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.768490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f567dbd8b-ssklx" event={"ID":"08d8e0ab-9b1e-4c05-810b-2f5eebf06a86","Type":"ContainerDied","Data":"42e201edd91df9bf34c631cca350e0ceaa10965587a98b499ec2c6540afb4602"} Jun 12 19:29:50.768692 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.768514 2560 scope.go:117] "RemoveContainer" containerID="236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356" Jun 12 19:29:50.780813 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.780788 2560 scope.go:117] "RemoveContainer" containerID="236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356" Jun 12 19:29:50.781356 ip-10-0-133-180 kubenswrapper[2560]: E0612 19:29:50.781321 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356\": container with ID starting with 236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356 not found: ID does not exist" containerID="236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356" Jun 12 19:29:50.781433 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.781370 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356"} err="failed to get container status \"236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356\": rpc error: code = NotFound desc = could not find container \"236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356\": container with ID starting with 236eeb009194c488e42c3a5d9318e5760a525cdf365cdbd339fce2e4bff44356 not found: ID does not exist" Jun 12 19:29:50.792707 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.792668 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f567dbd8b-ssklx"] Jun 12 19:29:50.797614 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:50.797579 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f567dbd8b-ssklx"] Jun 12 19:29:51.788546 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:29:51.788507 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08d8e0ab-9b1e-4c05-810b-2f5eebf06a86" path="/var/lib/kubelet/pods/08d8e0ab-9b1e-4c05-810b-2f5eebf06a86/volumes" Jun 12 19:31:27.853167 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:31:27.853137 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:31:27.854994 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:31:27.854969 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:36:27.893619 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:36:27.893590 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:36:27.896568 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:36:27.896544 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:41:27.934585 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:41:27.934558 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:41:27.941181 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:41:27.941147 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:46:27.987982 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:46:27.987944 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:46:27.996743 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:46:27.996718 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:50:54.300509 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:50:54.300472 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58dc8cd9f-wfnm2_5f90bcc3-2382-4d18-83ff-43609bbb657b/authorino/0.log" Jun 12 19:50:59.133031 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:50:59.132993 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-c54fb98fc-g272s_c0102096-bf36-43f8-8c7e-8e96a240b5df/maas-api/0.log" Jun 12 19:50:59.586140 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:50:59.586018 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-lj48x_5c3b5998-8562-4259-a712-6091067c0a57/server/0.log" Jun 12 19:50:59.699939 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:50:59.699887 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-79mw8_82f90a13-fd37-48b3-8e97-2a7eb835e5da/manager/0.log" Jun 12 19:51:00.050262 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:00.050224 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6d65868-jmjvw_7e616a13-1fc1-4913-a643-e965d01961d4/manager/0.log" Jun 12 19:51:00.059804 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:00.059777 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6d65868-jmjvw_7e616a13-1fc1-4913-a643-e965d01961d4/copy-manifests/0.log" Jun 12 19:51:00.907279 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:00.907242 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq_01dec74f-5be0-46e9-8cf6-8344b4a8bce8/util/0.log" Jun 12 19:51:00.913410 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:00.913379 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq_01dec74f-5be0-46e9-8cf6-8344b4a8bce8/pull/0.log" Jun 12 19:51:00.921195 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:00.921162 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq_01dec74f-5be0-46e9-8cf6-8344b4a8bce8/extract/0.log" Jun 12 19:51:01.030329 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.030287 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn_c7e62e2b-8e5a-4736-992d-040ae8d1e8b2/util/0.log" Jun 12 19:51:01.036055 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.036028 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn_c7e62e2b-8e5a-4736-992d-040ae8d1e8b2/pull/0.log" Jun 12 19:51:01.041834 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.041812 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn_c7e62e2b-8e5a-4736-992d-040ae8d1e8b2/extract/0.log" Jun 12 19:51:01.158032 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.157942 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8_07890a39-6c52-473c-9c13-bb649eabf8d8/util/0.log" Jun 12 19:51:01.185213 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.185141 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8_07890a39-6c52-473c-9c13-bb649eabf8d8/pull/0.log" Jun 12 19:51:01.209219 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.209181 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8_07890a39-6c52-473c-9c13-bb649eabf8d8/extract/0.log" Jun 12 19:51:01.318527 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.318493 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx_fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4/util/0.log" Jun 12 19:51:01.324627 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.324582 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx_fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4/pull/0.log" Jun 12 19:51:01.330904 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.330879 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx_fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4/extract/0.log" Jun 12 19:51:01.442005 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.441907 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58dc8cd9f-wfnm2_5f90bcc3-2382-4d18-83ff-43609bbb657b/authorino/0.log" Jun 12 19:51:01.793972 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:01.793857 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r5bs8_89dc665f-6c69-4be2-8325-1f32fa2732ca/kuadrant-console-plugin/0.log" Jun 12 19:51:02.979122 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:02.979085 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-599d4765f4-b6ldv_6ebbe81e-8c62-48af-92d4-0707f0bf9722/kube-auth-proxy/0.log" Jun 12 19:51:03.207195 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:03.207160 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpghg_05ff9ff6-3b20-4e1a-9dab-005e13c37686/payload-pre-processing/0.log" Jun 12 19:51:03.421131 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:03.421100 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6849884d84-7q7hb_6eaed572-c30c-45ab-9671-c57af5246ff5/router/0.log" Jun 12 19:51:03.972706 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:03.972666 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2_033c1bf7-f9f8-4bff-98ad-387d0558c76c/storage-initializer/0.log" Jun 12 19:51:03.979389 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:03.979356 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-ddbp2_033c1bf7-f9f8-4bff-98ad-387d0558c76c/main/0.log" Jun 12 19:51:04.315300 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:04.315216 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-p4s5r_11f0d875-339e-44d5-9fc7-018874201445/storage-initializer/0.log" Jun 12 19:51:04.321822 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:04.321789 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-p4s5r_11f0d875-339e-44d5-9fc7-018874201445/main/0.log" Jun 12 19:51:12.129088 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:12.129058 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zs6dg_576a70c6-3818-4726-b649-dbe1059ef0eb/global-pull-secret-syncer/0.log" Jun 12 19:51:12.249893 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:12.249856 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rq288_f07ac7dd-089a-47e8-8fb1-cc9686102d27/konnectivity-agent/0.log" Jun 12 19:51:12.304929 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:12.304878 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-180.ec2.internal_45c7ccf2d22eca00a3939e23b3e78371/haproxy/0.log" Jun 12 19:51:16.821001 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:16.820974 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq_01dec74f-5be0-46e9-8cf6-8344b4a8bce8/extract/0.log" Jun 12 19:51:16.843043 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:16.843011 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq_01dec74f-5be0-46e9-8cf6-8344b4a8bce8/util/0.log" Jun 12 19:51:16.866027 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:16.865993 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gpsvq_01dec74f-5be0-46e9-8cf6-8344b4a8bce8/pull/0.log" Jun 12 19:51:16.897373 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:16.897341 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn_c7e62e2b-8e5a-4736-992d-040ae8d1e8b2/extract/0.log" Jun 12 19:51:16.917434 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:16.917406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn_c7e62e2b-8e5a-4736-992d-040ae8d1e8b2/util/0.log" Jun 12 19:51:16.937890 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:16.937844 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j4pvn_c7e62e2b-8e5a-4736-992d-040ae8d1e8b2/pull/0.log" Jun 12 19:51:16.963217 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:16.963139 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8_07890a39-6c52-473c-9c13-bb649eabf8d8/extract/0.log" Jun 12 19:51:16.984934 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:16.984895 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8_07890a39-6c52-473c-9c13-bb649eabf8d8/util/0.log" Jun 12 19:51:17.006329 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:17.006299 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73npvz8_07890a39-6c52-473c-9c13-bb649eabf8d8/pull/0.log" Jun 12 19:51:17.034209 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:17.034183 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx_fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4/extract/0.log" Jun 12 19:51:17.057460 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:17.057426 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx_fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4/util/0.log" Jun 12 19:51:17.080062 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:17.080030 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xc4dx_fcdf61d3-2d1b-48ea-9f62-d7ddf0a65ef4/pull/0.log" Jun 12 19:51:17.301183 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:17.301049 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58dc8cd9f-wfnm2_5f90bcc3-2382-4d18-83ff-43609bbb657b/authorino/0.log" Jun 12 19:51:17.403360 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:17.403329 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r5bs8_89dc665f-6c69-4be2-8325-1f32fa2732ca/kuadrant-console-plugin/0.log" Jun 12 19:51:19.151291 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.151264 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aba5ab42-e9b8-41cc-8abc-a3821d90756f/alertmanager/0.log" Jun 12 19:51:19.173081 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.173052 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aba5ab42-e9b8-41cc-8abc-a3821d90756f/config-reloader/0.log" Jun 12 19:51:19.192755 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.192731 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aba5ab42-e9b8-41cc-8abc-a3821d90756f/kube-rbac-proxy-web/0.log" Jun 12 19:51:19.212668 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.212641 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aba5ab42-e9b8-41cc-8abc-a3821d90756f/kube-rbac-proxy/0.log" Jun 12 19:51:19.233212 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.233182 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aba5ab42-e9b8-41cc-8abc-a3821d90756f/kube-rbac-proxy-metric/0.log" Jun 12 19:51:19.256407 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.256381 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aba5ab42-e9b8-41cc-8abc-a3821d90756f/prom-label-proxy/0.log" Jun 12 19:51:19.278813 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.278787 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aba5ab42-e9b8-41cc-8abc-a3821d90756f/init-config-reloader/0.log" Jun 12 19:51:19.313459 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.313423 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-gjkvs_267d10fa-9a18-411e-a497-18a537cbb40d/cluster-monitoring-operator/0.log" Jun 12 19:51:19.421629 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.421552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b8fb556fb-6q55j_7367c7b5-03bb-481c-be78-d42db435a3b6/metrics-server/0.log" Jun 12 19:51:19.446058 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.446029 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-9cglf_19f25b67-066c-4b30-8dca-b634f6865fe2/monitoring-plugin/0.log" Jun 12 19:51:19.670758 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.670727 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ff7wz_fef58b6a-b923-42b8-974c-28d2dca4c07b/node-exporter/0.log" Jun 12 19:51:19.697743 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.697664 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ff7wz_fef58b6a-b923-42b8-974c-28d2dca4c07b/kube-rbac-proxy/0.log" Jun 12 19:51:19.718487 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:19.718459 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ff7wz_fef58b6a-b923-42b8-974c-28d2dca4c07b/init-textfile/0.log" Jun 12 19:51:20.138326 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:20.138294 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd6f64cb-c9v69_58eee837-58e7-4069-8521-40a02dd23f8c/telemeter-client/0.log" Jun 12 19:51:20.160196 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:20.160167 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd6f64cb-c9v69_58eee837-58e7-4069-8521-40a02dd23f8c/reload/0.log" Jun 12 19:51:20.188948 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:20.188903 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd6f64cb-c9v69_58eee837-58e7-4069-8521-40a02dd23f8c/kube-rbac-proxy/0.log" Jun 12 19:51:22.311826 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:22.311797 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:51:22.317542 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:22.317499 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/2.log" Jun 12 19:51:22.952593 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:22.952565 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-csbvk_0e40fbb1-be9e-496b-b1d2-a548a54a4c2c/download-server/0.log" Jun 12 19:51:23.539903 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.539787 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9"] Jun 12 19:51:23.540321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.540249 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12f8afd9-eb29-403f-a608-d61afe3ebfe3" containerName="authorino" Jun 12 19:51:23.540321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.540263 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="12f8afd9-eb29-403f-a608-d61afe3ebfe3" containerName="authorino" Jun 12 19:51:23.540321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.540280 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d8e0ab-9b1e-4c05-810b-2f5eebf06a86" containerName="manager" Jun 12 19:51:23.540321 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.540304 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d8e0ab-9b1e-4c05-810b-2f5eebf06a86" containerName="manager" Jun 12 19:51:23.540460 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.540383 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="08d8e0ab-9b1e-4c05-810b-2f5eebf06a86" containerName="manager" Jun 12 19:51:23.540460 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.540394 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="12f8afd9-eb29-403f-a608-d61afe3ebfe3" containerName="authorino" Jun 12 19:51:23.543572 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.543555 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.546246 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.546224 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9fd56\"/\"default-dockercfg-m8dvh\"" Jun 12 19:51:23.546549 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.546524 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fd56\"/\"openshift-service-ca.crt\"" Jun 12 19:51:23.547367 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.547349 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fd56\"/\"kube-root-ca.crt\"" Jun 12 19:51:23.553109 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.553081 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9"] Jun 12 19:51:23.655560 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.655519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-sys\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.655560 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.655562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-podres\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.655807 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.655650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-lib-modules\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.655807 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.655722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-proc\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.655807 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.655787 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m68pp\" (UniqueName: \"kubernetes.io/projected/91356b64-3e40-4c42-923d-246e84736b2f-kube-api-access-m68pp\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.679846 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.679812 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-bjj9x_6a19eacb-0d57-4fb8-af5f-ef0c1aa711ad/volume-data-source-validator/0.log" Jun 12 19:51:23.757129 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.757089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-proc\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.757338 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.757147 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m68pp\" (UniqueName: \"kubernetes.io/projected/91356b64-3e40-4c42-923d-246e84736b2f-kube-api-access-m68pp\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.757338 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.757190 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-sys\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.757338 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.757207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-podres\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.757338 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.757228 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-proc\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.757338 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.757252 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-lib-modules\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.757338 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.757323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-sys\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.757545 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.757390 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-lib-modules\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.757545 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.757394 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91356b64-3e40-4c42-923d-246e84736b2f-podres\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.765252 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.765218 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m68pp\" (UniqueName: \"kubernetes.io/projected/91356b64-3e40-4c42-923d-246e84736b2f-kube-api-access-m68pp\") pod \"perf-node-gather-daemonset-rqnm9\" (UID: \"91356b64-3e40-4c42-923d-246e84736b2f\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.855935 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.855831 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:23.995627 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:23.995596 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9"] Jun 12 19:51:23.997328 ip-10-0-133-180 kubenswrapper[2560]: W0612 19:51:23.997298 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod91356b64_3e40_4c42_923d_246e84736b2f.slice/crio-0b768c677a06cab1f738c996c36b68e716e973ca89a8e69b0c22d81e7679aacf WatchSource:0}: Error finding container 0b768c677a06cab1f738c996c36b68e716e973ca89a8e69b0c22d81e7679aacf: Status 404 returned error can't find the container with id 0b768c677a06cab1f738c996c36b68e716e973ca89a8e69b0c22d81e7679aacf Jun 12 19:51:24.537608 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:24.537499 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" event={"ID":"91356b64-3e40-4c42-923d-246e84736b2f","Type":"ContainerStarted","Data":"942225af84602de1d6cedc4383adf7890a8848fb72e2adfc3021d78ef58397cb"} Jun 12 19:51:24.537608 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:24.537561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" event={"ID":"91356b64-3e40-4c42-923d-246e84736b2f","Type":"ContainerStarted","Data":"0b768c677a06cab1f738c996c36b68e716e973ca89a8e69b0c22d81e7679aacf"} Jun 12 19:51:24.537874 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:24.537622 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:24.557971 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:24.557898 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" podStartSLOduration=1.557883249 podStartE2EDuration="1.557883249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:51:24.55428256 +0000 UTC m=+2397.211321699" watchObservedRunningTime="2026-06-12 19:51:24.557883249 +0000 UTC m=+2397.214922387" Jun 12 19:51:24.946143 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:24.946111 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt6lr_a522ebac-d7a4-4f0d-a596-da66772e7def/dns/0.log" Jun 12 19:51:24.967758 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:24.967733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt6lr_a522ebac-d7a4-4f0d-a596-da66772e7def/kube-rbac-proxy/0.log" Jun 12 19:51:25.010404 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:25.010366 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x68ms_f73e27a5-19e3-45f5-9fee-718113ba39f3/dns-node-resolver/0.log" Jun 12 19:51:25.633296 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:25.633255 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mg6nm_77048b64-4fc6-4841-a6f5-602cee883b68/node-ca/0.log" Jun 12 19:51:26.713667 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:26.713631 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-599d4765f4-b6ldv_6ebbe81e-8c62-48af-92d4-0707f0bf9722/kube-auth-proxy/0.log" Jun 12 19:51:26.805549 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:26.805517 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpghg_05ff9ff6-3b20-4e1a-9dab-005e13c37686/payload-pre-processing/0.log" Jun 12 19:51:26.891580 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:26.891547 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6849884d84-7q7hb_6eaed572-c30c-45ab-9671-c57af5246ff5/router/0.log" Jun 12 19:51:27.580496 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:27.580464 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-snhpj_5b6880fd-053a-4c13-836b-d8e91febbe85/serve-healthcheck-canary/0.log" Jun 12 19:51:28.038422 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:28.038390 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:51:28.043197 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:28.043167 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mtf6v_1e309f40-74d1-44ff-be6a-98ed82002869/console-operator/1.log" Jun 12 19:51:28.097488 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:28.097455 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-8xc2x_ec5c7b00-e5f7-4b65-a49d-a4c845903520/insights-operator/0.log" Jun 12 19:51:28.099644 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:28.099619 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-8xc2x_ec5c7b00-e5f7-4b65-a49d-a4c845903520/insights-operator/1.log" Jun 12 19:51:28.221672 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:28.221642 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p278h_8d97f52e-3b42-44aa-af05-22ee54386bb8/kube-rbac-proxy/0.log" Jun 12 19:51:28.269877 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:28.269846 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p278h_8d97f52e-3b42-44aa-af05-22ee54386bb8/exporter/0.log" Jun 12 19:51:28.324249 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:28.324151 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p278h_8d97f52e-3b42-44aa-af05-22ee54386bb8/extractor/0.log" Jun 12 19:51:30.554794 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:30.554765 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-rqnm9" Jun 12 19:51:30.830821 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:30.830737 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-c54fb98fc-g272s_c0102096-bf36-43f8-8c7e-8e96a240b5df/maas-api/0.log" Jun 12 19:51:31.013385 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:31.013347 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-lj48x_5c3b5998-8562-4259-a712-6091067c0a57/server/0.log" Jun 12 19:51:31.064149 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:31.064116 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-79mw8_82f90a13-fd37-48b3-8e97-2a7eb835e5da/manager/0.log" Jun 12 19:51:31.253441 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:31.253407 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6d65868-jmjvw_7e616a13-1fc1-4913-a643-e965d01961d4/manager/0.log" Jun 12 19:51:31.269797 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:31.269775 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6d65868-jmjvw_7e616a13-1fc1-4913-a643-e965d01961d4/copy-manifests/0.log" Jun 12 19:51:32.996830 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:32.996803 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d7db986fb-9vnxf_0a6ab9fd-902b-4be5-a139-056fbb97ac16/manager/0.log" Jun 12 19:51:33.057434 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:33.057402 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4j5mq_d562778d-b542-4c96-bc58-accaec9d6980/openshift-lws-operator/0.log" Jun 12 19:51:37.224856 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:37.224825 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-599d4765f4-b6ldv_6ebbe81e-8c62-48af-92d4-0707f0bf9722/kube-auth-proxy/0.log" Jun 12 19:51:37.296368 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:37.296337 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpghg_05ff9ff6-3b20-4e1a-9dab-005e13c37686/payload-pre-processing/0.log" Jun 12 19:51:37.365716 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:37.365684 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6849884d84-7q7hb_6eaed572-c30c-45ab-9671-c57af5246ff5/router/0.log" Jun 12 19:51:38.578444 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:38.578405 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-599d4765f4-b6ldv_6ebbe81e-8c62-48af-92d4-0707f0bf9722/kube-auth-proxy/0.log" Jun 12 19:51:38.657634 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:38.657588 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpghg_05ff9ff6-3b20-4e1a-9dab-005e13c37686/payload-pre-processing/0.log" Jun 12 19:51:38.726134 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:38.726107 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6849884d84-7q7hb_6eaed572-c30c-45ab-9671-c57af5246ff5/router/0.log" Jun 12 19:51:38.969645 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:38.969616 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-n4f2k_9091e6de-482a-4b96-be50-dd440317d294/kube-storage-version-migrator-operator/1.log" Jun 12 19:51:38.970488 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:38.970462 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-n4f2k_9091e6de-482a-4b96-be50-dd440317d294/kube-storage-version-migrator-operator/0.log" Jun 12 19:51:40.135083 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.135031 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-959z2_9e5cdd07-9588-449a-a00f-0e4ad0b10252/kube-multus/0.log" Jun 12 19:51:40.164905 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.164874 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l6mv_a9de2fd1-5260-48d1-8fa3-a71229c218fd/kube-multus-additional-cni-plugins/0.log" Jun 12 19:51:40.186070 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.186038 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l6mv_a9de2fd1-5260-48d1-8fa3-a71229c218fd/egress-router-binary-copy/0.log" Jun 12 19:51:40.207899 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.207872 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l6mv_a9de2fd1-5260-48d1-8fa3-a71229c218fd/cni-plugins/0.log" Jun 12 19:51:40.228129 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.228056 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l6mv_a9de2fd1-5260-48d1-8fa3-a71229c218fd/bond-cni-plugin/0.log" Jun 12 19:51:40.249062 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.249032 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l6mv_a9de2fd1-5260-48d1-8fa3-a71229c218fd/routeoverride-cni/0.log" Jun 12 19:51:40.270442 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.270411 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l6mv_a9de2fd1-5260-48d1-8fa3-a71229c218fd/whereabouts-cni-bincopy/0.log" Jun 12 19:51:40.291800 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.291767 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l6mv_a9de2fd1-5260-48d1-8fa3-a71229c218fd/whereabouts-cni/0.log" Jun 12 19:51:40.495783 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.495696 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-599d4765f4-b6ldv_6ebbe81e-8c62-48af-92d4-0707f0bf9722/kube-auth-proxy/0.log" Jun 12 19:51:40.562430 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.562399 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpghg_05ff9ff6-3b20-4e1a-9dab-005e13c37686/payload-pre-processing/0.log" Jun 12 19:51:40.626342 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.626306 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6849884d84-7q7hb_6eaed572-c30c-45ab-9671-c57af5246ff5/router/0.log" Jun 12 19:51:40.761226 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.761142 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vqt4b_3f558a51-da97-4815-815b-f1d519167f3f/network-metrics-daemon/0.log" Jun 12 19:51:40.785516 ip-10-0-133-180 kubenswrapper[2560]: I0612 19:51:40.785491 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vqt4b_3f558a51-da97-4815-815b-f1d519167f3f/kube-rbac-proxy/0.log"