Jun 08 19:23:23.269409 ip-10-0-132-26 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 19:23:23.269423 ip-10-0-132-26 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 19:23:23.269432 ip-10-0-132-26 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 19:23:23.269662 ip-10-0-132-26 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 19:23:33.518956 ip-10-0-132-26 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 19:23:33.518977 ip-10-0-132-26 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1e5177bd9b1a4d1da7b93d23061c7716 -- Jun 08 19:26:31.890333 ip-10-0-132-26 systemd[1]: Starting Kubernetes Kubelet... Jun 08 19:26:32.307822 ip-10-0-132-26 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:26:32.307822 ip-10-0-132-26 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 19:26:32.307822 ip-10-0-132-26 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:26:32.307822 ip-10-0-132-26 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 19:26:32.307822 ip-10-0-132-26 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:26:32.310273 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.310185 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 19:26:32.314481 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314465 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:32.314481 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314481 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314485 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314488 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314492 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314495 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314497 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314500 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314502 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314505 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314508 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314511 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314513 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314521 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314524 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314526 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314529 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314532 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314535 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314537 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314540 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:32.314546 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314542 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314545 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314548 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314551 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314555 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314558 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314560 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314563 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314566 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314568 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314571 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314573 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314576 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314578 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314582 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314585 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314589 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314599 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314602 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:32.315036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314605 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314608 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314611 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314614 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314616 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314620 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314623 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314625 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314628 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314630 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314633 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314635 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314638 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314640 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314643 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314647 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314650 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314653 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314655 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:32.315495 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314658 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314661 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314663 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314666 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314668 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314671 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314675 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314679 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314682 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314685 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314687 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314690 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314699 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314702 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314705 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314707 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314710 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314712 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314715 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:32.315979 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314717 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314720 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314722 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314725 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314727 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314730 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314732 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314735 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314737 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314741 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314743 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314746 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314749 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314751 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314754 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314758 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314761 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314764 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314767 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314769 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:32.316445 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.314772 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315473 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315480 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315483 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315486 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315490 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315493 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315495 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315499 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315502 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315505 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315508 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315510 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315513 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315517 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315521 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315524 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315527 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315530 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:32.316963 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315532 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315535 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315538 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315541 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315544 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315547 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315550 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315553 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315555 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315558 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315560 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315565 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315569 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315571 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315574 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315577 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315579 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315582 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315584 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:32.317465 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315587 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315590 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315592 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315595 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315597 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315600 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315603 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315605 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315608 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315610 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315613 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315615 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315619 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315622 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315625 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315630 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315633 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315635 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315638 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315641 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:32.317959 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315643 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315646 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315649 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315652 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315654 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315657 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315659 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315662 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315664 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315667 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315670 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315672 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315675 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315677 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315680 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315682 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315685 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315687 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315690 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315693 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:32.318429 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315695 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315698 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315700 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315703 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315706 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315708 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315711 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315714 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315717 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315720 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315722 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315725 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315727 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315730 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315732 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315735 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315737 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315740 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315742 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315745 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:32.318975 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315747 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.315750 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316135 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316141 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316144 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316148 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316151 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316155 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316158 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316160 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316163 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316165 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316168 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316171 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316173 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316176 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316179 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316182 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316186 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:32.319464 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316189 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316192 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316195 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316198 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316200 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316203 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316206 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316209 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316211 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316214 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316216 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316219 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316221 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316224 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316227 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316230 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316233 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316235 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316238 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316240 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:32.319948 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316243 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316246 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316249 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316251 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316254 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316257 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316259 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316262 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316264 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316267 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316269 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316272 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316275 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316278 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316280 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316283 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316286 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316288 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316290 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:32.320451 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316293 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316296 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316299 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316301 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316304 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316306 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316309 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316311 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316317 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316319 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316322 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316325 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316327 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316329 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316332 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316335 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316337 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316340 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316344 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:32.320922 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316348 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316350 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316353 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316356 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316358 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316361 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316363 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316366 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316368 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316371 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316373 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316376 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316380 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316382 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316385 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316388 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316390 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316393 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316395 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316398 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:32.321396 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316400 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316408 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316411 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.316413 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316484 2549 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316492 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316497 2549 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316502 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316507 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316510 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316514 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316518 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316521 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316524 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316529 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316533 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316536 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316539 2549 flags.go:64] FLAG: --cgroup-root="" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316542 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316545 2549 flags.go:64] FLAG: --client-ca-file="" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316548 2549 flags.go:64] FLAG: --cloud-provider="external" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316551 2549 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316555 2549 flags.go:64] FLAG: --cluster-domain="" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316558 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 19:26:32.321880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316561 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316564 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316568 2549 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316571 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316574 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316578 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316581 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316584 2549 flags.go:64] FLAG: --contention-profiling="false" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316586 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316590 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316593 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316597 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316601 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316604 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316607 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316610 2549 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316613 2549 flags.go:64] FLAG: --enable-server="true" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316616 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316621 2549 flags.go:64] FLAG: --event-burst="100" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316624 2549 flags.go:64] FLAG: --event-qps="50" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316628 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316631 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316634 2549 flags.go:64] FLAG: --eviction-hard="" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316638 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 19:26:32.322470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316641 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316643 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316646 2549 flags.go:64] FLAG: --eviction-soft="" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316649 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316652 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316655 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316658 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316661 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316664 2549 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316666 2549 flags.go:64] FLAG: --feature-gates="" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316670 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316673 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316676 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316679 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316685 2549 flags.go:64] FLAG: --healthz-port="10248" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316688 2549 flags.go:64] FLAG: --help="false" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316691 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316695 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316698 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316701 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316704 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316708 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316711 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 19:26:32.323112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316714 2549 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316717 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316720 2549 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316723 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316726 2549 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316729 2549 flags.go:64] FLAG: --kube-reserved="" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316732 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316735 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316738 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316741 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316744 2549 flags.go:64] FLAG: --lock-file="" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316747 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316750 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316753 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316758 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316760 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316763 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316766 2549 flags.go:64] FLAG: --logging-format="text" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316769 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316772 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316775 2549 flags.go:64] FLAG: --manifest-url="" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316778 2549 flags.go:64] FLAG: --manifest-url-header="" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316782 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316787 2549 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316791 2549 flags.go:64] FLAG: --max-pods="110" Jun 08 19:26:32.323711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316794 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316797 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316800 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316803 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316806 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316809 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316812 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316819 2549 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316821 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316824 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316827 2549 flags.go:64] FLAG: --pod-cidr="" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316831 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316836 2549 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316839 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316842 2549 flags.go:64] FLAG: --pods-per-core="0" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316845 2549 flags.go:64] FLAG: --port="10250" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316848 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316851 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09edf1e96220fcd76" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316854 2549 flags.go:64] FLAG: --qos-reserved="" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316857 2549 flags.go:64] FLAG: --read-only-port="10255" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316860 2549 flags.go:64] FLAG: --register-node="true" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316863 2549 flags.go:64] FLAG: --register-with-taints="" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316866 2549 flags.go:64] FLAG: --registry-burst="10" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316870 2549 flags.go:64] FLAG: --registry-qps="5" Jun 08 19:26:32.324354 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316873 2549 flags.go:64] FLAG: --reserved-cpus="" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316875 2549 flags.go:64] FLAG: --reserved-memory="" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316879 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316882 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316885 2549 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316888 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316890 2549 flags.go:64] FLAG: --runonce="false" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316895 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316898 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316901 2549 flags.go:64] FLAG: --seccomp-default="false" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316916 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316920 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316923 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316926 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316930 2549 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316933 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316936 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316939 2549 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316942 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316945 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316948 2549 flags.go:64] FLAG: --system-cgroups="" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316951 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316957 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316960 2549 flags.go:64] FLAG: --tls-cert-file="" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316962 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 19:26:32.325001 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316967 2549 flags.go:64] FLAG: --tls-min-version="" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316970 2549 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316973 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316978 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316981 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316984 2549 flags.go:64] FLAG: --v="2" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316988 2549 flags.go:64] FLAG: --version="false" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.316997 2549 flags.go:64] FLAG: --vmodule="" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.317001 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.317004 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317119 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317123 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317125 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317128 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317132 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317135 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317138 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317140 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317143 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317146 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317149 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:32.325619 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317151 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317154 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317156 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317159 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317161 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317164 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317167 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317170 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317173 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317175 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317178 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317180 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317197 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317201 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317206 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317209 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317211 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317214 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317218 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317221 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:32.326374 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317223 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317226 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317229 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317231 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317234 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317239 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317242 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317244 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317247 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317250 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317253 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317255 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317258 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317261 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317263 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317266 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317269 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317273 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317277 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317279 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:32.327170 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317283 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317286 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317288 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317291 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317293 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317297 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317301 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317303 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317306 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317308 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317311 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317314 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317317 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317319 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317322 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317324 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317327 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317331 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317334 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:32.327719 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317336 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317339 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317342 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317344 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317347 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317349 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317352 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317354 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317357 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317360 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317362 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317365 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317368 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317370 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317373 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317377 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317380 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317384 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317386 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:32.328208 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317391 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317395 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317398 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317401 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317404 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317407 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317409 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317412 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317415 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.317418 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.317426 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.324288 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.324303 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.325000 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.325007 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 19:26:32.328677 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325061 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325066 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325070 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325073 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325076 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325079 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325082 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325085 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325088 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325090 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325093 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325096 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325099 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325102 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325104 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325107 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325111 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325114 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325117 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:32.329066 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325119 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325124 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325127 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325130 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325133 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325136 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325139 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325142 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325144 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325147 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325152 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325155 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325157 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325160 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325163 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325165 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325168 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325170 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325173 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:32.329570 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325176 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325178 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325180 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325183 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325186 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325188 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325191 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325193 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325196 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325198 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325201 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325204 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325206 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325208 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325211 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325214 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325216 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325219 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325221 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325224 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:32.330141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325226 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325228 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325231 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325235 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325239 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325242 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325245 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325247 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325250 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325253 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325255 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325258 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325260 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325263 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325265 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325268 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325270 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325273 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325275 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325278 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:32.330634 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325280 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325283 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325285 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325288 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325290 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325294 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325297 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325300 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325303 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325305 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325308 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325310 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325313 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325315 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325318 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325321 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325324 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325327 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325330 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:32.331260 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325332 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325335 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.325340 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.325603 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326231 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326238 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326244 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326249 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326254 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326258 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326263 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326267 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326272 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326277 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:32.331716 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326282 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326286 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326299 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326303 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326307 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326313 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326318 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326322 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326327 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326331 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326336 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326340 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326344 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326348 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326352 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326361 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326366 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326370 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326375 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326380 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:32.332304 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326385 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326389 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326395 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326401 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326405 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326413 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326420 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326431 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326435 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326440 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326444 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326449 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326453 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326457 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326461 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326465 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326469 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326473 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326477 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326482 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:32.333134 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326491 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326496 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326501 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326505 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326509 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326513 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326517 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326522 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326526 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326530 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326534 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326538 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326547 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326552 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326557 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326561 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326566 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326570 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326574 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326579 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:32.333626 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326583 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326587 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326592 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326597 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326601 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326609 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326614 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326618 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326622 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326626 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326631 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326634 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326639 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326643 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326647 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326651 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326655 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326665 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326669 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326673 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:32.334352 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326677 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326680 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326685 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326691 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326696 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326702 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326708 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:32.326712 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.326720 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.327104 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.329085 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.330666 2549 server.go:1019] "Starting client certificate rotation" Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.330779 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:26:32.334854 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.330877 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:26:32.335222 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.333058 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:26:32.335222 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.334222 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:26:32.347433 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.347412 2549 log.go:25] "Validated CRI v1 runtime API" Jun 08 19:26:32.350006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.349991 2549 log.go:25] "Validated CRI v1 image API" Jun 08 19:26:32.350819 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.350805 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 19:26:32.354120 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.354101 2549 fs.go:135] Filesystem UUIDs: map[5e444681-f7b3-4adf-a347-a69fbcc006f3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ec08e0d4-fecf-43d2-8c28-c9f23ce897ff:/dev/nvme0n1p3] Jun 08 19:26:32.354171 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.354120 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 19:26:32.359136 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.359120 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:26:32.359200 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.359105 2549 manager.go:216] Machine: {Timestamp:2026-06-08 19:26:32.357892492 +0000 UTC m=+0.338163494 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096243 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec203d7f13683b5ef3ece22410792695 SystemUUID:ec203d7f-1368-3b5e-f3ec-e22410792695 BootID:1e5177bd-9b1a-4d1d-a7b9-3d23061c7716 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:e0:72:f6:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:e0:72:f6:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:ef:a7:67:78:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 19:26:32.359200 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.359202 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 19:26:32.359300 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.359282 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 19:26:32.361687 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.361664 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 19:26:32.361827 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.361688 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 19:26:32.362383 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.362373 2549 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 19:26:32.362416 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.362386 2549 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 19:26:32.362416 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.362394 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:26:32.363012 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.363002 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:26:32.363796 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.363786 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 19:26:32.366749 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.366738 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:26:32.366862 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.366853 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 19:26:32.366894 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.366880 2549 kubelet.go:486] "Attempting to sync node with API server" Jun 08 19:26:32.366894 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.366890 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 19:26:32.366960 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.366903 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 19:26:32.366960 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.366928 2549 kubelet.go:398] "Adding apiserver pod source" Jun 08 19:26:32.366960 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.366937 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 19:26:32.367327 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.367296 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:26:32.367387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.367339 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:26:32.370788 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.370768 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 19:26:32.372166 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372151 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 19:26:32.372247 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372182 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 19:26:32.372771 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372759 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 19:26:32.372814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372779 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 19:26:32.372814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372785 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 19:26:32.372814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372790 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 19:26:32.372814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372798 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 19:26:32.372814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372804 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 19:26:32.372814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372811 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 19:26:32.372814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372816 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 19:26:32.373022 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372823 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 19:26:32.373022 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372829 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 19:26:32.373022 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372837 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 19:26:32.373022 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.372842 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 19:26:32.373499 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.373490 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 19:26:32.373499 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.373499 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 19:26:32.376744 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.376730 2549 server.go:1268] "Started kubelet" Jun 08 19:26:32.376894 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.376826 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 19:26:32.376964 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.376827 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 19:26:32.377021 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.376966 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 19:26:32.377730 ip-10-0-132-26 systemd[1]: Started Kubernetes Kubelet. Jun 08 19:26:32.378246 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.378111 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 19:26:32.378678 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.378640 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 19:26:32.378795 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.378757 2549 server.go:310] "Adding debug handlers to kubelet server" Jun 08 19:26:32.379187 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.379163 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 19:26:32.379187 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.379166 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 19:26:32.381490 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.381470 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r4hbv" Jun 08 19:26:32.384941 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.384920 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 19:26:32.385027 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.385001 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 19:26:32.385080 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.385062 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 19:26:32.385131 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.385100 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:32.385920 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.385850 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 19:26:32.385920 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.385895 2549 factory.go:55] Registering systemd factory Jun 08 19:26:32.385920 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.385921 2549 factory.go:223] Registration of the systemd container factory successfully Jun 08 19:26:32.386169 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.385900 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 19:26:32.386169 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.385953 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 19:26:32.386169 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.385958 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 19:26:32.386657 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.386605 2549 factory.go:153] Registering CRI-O factory Jun 08 19:26:32.386657 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.386619 2549 factory.go:223] Registration of the crio container factory successfully Jun 08 19:26:32.386657 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.386641 2549 factory.go:103] Registering Raw factory Jun 08 19:26:32.386657 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.386653 2549 manager.go:1196] Started watching for new ooms in manager Jun 08 19:26:32.387360 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.387342 2549 manager.go:349] Starting recovery of all containers Jun 08 19:26:32.387536 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.387521 2549 reconstruct.go:97] "Volume reconstruction finished" Jun 08 19:26:32.387536 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.387536 2549 reconciler.go:29] "Reconciler: start to sync state" Jun 08 19:26:32.387648 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.387545 2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 19:26:32.387648 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.387606 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 19:26:32.388165 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.387192 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-26.ec2.internal.18b731abfb7c156a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-26.ec2.internal,UID:ip-10-0-132-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-26.ec2.internal,},FirstTimestamp:2026-06-08 19:26:32.376702314 +0000 UTC m=+0.356973316,LastTimestamp:2026-06-08 19:26:32.376702314 +0000 UTC m=+0.356973316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-26.ec2.internal,}" Jun 08 19:26:32.390861 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.390838 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r4hbv" Jun 08 19:26:32.398773 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.398749 2549 manager.go:354] Recovery completed Jun 08 19:26:32.403812 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.403797 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:32.405738 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.405723 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:32.405798 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.405752 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:32.405798 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.405762 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:32.406291 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.406270 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 19:26:32.406291 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.406289 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 19:26:32.406291 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.406293 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:32.406456 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.406305 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:26:32.407036 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.407020 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:32.407108 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.407045 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:32.407108 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.407059 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:32.407547 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.407534 2549 policy_none.go:49] "None policy: Start" Jun 08 19:26:32.407583 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.407552 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 19:26:32.407583 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.407562 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 19:26:32.408023 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.407932 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-26.ec2.internal.18b731abfd37226e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-26.ec2.internal,UID:ip-10-0-132-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-26.ec2.internal,},FirstTimestamp:2026-06-08 19:26:32.405738094 +0000 UTC m=+0.386009098,LastTimestamp:2026-06-08 19:26:32.405738094 +0000 UTC m=+0.386009098,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-26.ec2.internal,}" Jun 08 19:26:32.408559 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.408548 2549 policy_none.go:47] "Start" Jun 08 19:26:32.453548 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.453532 2549 manager.go:337] "Starting Device Plugin manager" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.453569 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.453580 2549 server.go:87] "Starting device plugin registration server" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.453966 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.453980 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.454077 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.454174 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.454183 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.454778 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.454829 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.462031 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.463156 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.463187 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.463207 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 19:26:32.464202 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.463236 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 19:26:32.464865 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.464845 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:32.554447 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.554407 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:32.555335 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.555319 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:32.555439 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.555348 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:32.555439 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.555358 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:32.555439 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.555381 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.563046 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.562994 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.563046 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.563018 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-26.ec2.internal\": node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:32.563376 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.563350 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal"] Jun 08 19:26:32.563421 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.563412 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:32.564187 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.564171 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:32.564304 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.564202 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:32.564304 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.564220 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:32.565597 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.565581 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:32.565712 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.565679 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.565712 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.565712 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:32.566292 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.566276 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:32.566387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.566307 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:32.566387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.566323 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:32.566387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.566276 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:32.566387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.566377 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:32.566387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.566388 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:32.567817 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.567800 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.567921 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.567824 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:32.568423 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.568408 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:32.568491 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.568436 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:32.568491 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.568448 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:32.579613 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.579593 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:32.588885 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.588865 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52853f9203affd2579f94479c933b303-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"52853f9203affd2579f94479c933b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.588961 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.588889 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52853f9203affd2579f94479c933b303-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"52853f9203affd2579f94479c933b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.588961 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.588925 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18e86d904aaa5a0b5b95eb0f9feb0537-config\") pod \"kube-apiserver-proxy-ip-10-0-132-26.ec2.internal\" (UID: \"18e86d904aaa5a0b5b95eb0f9feb0537\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.599642 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.599628 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-26.ec2.internal\" not found" node="ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.604241 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.604227 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-26.ec2.internal\" not found" node="ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.680284 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.680256 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:32.689266 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.689243 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52853f9203affd2579f94479c933b303-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"52853f9203affd2579f94479c933b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.689367 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.689269 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52853f9203affd2579f94479c933b303-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"52853f9203affd2579f94479c933b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.689367 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.689295 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18e86d904aaa5a0b5b95eb0f9feb0537-config\") pod \"kube-apiserver-proxy-ip-10-0-132-26.ec2.internal\" (UID: \"18e86d904aaa5a0b5b95eb0f9feb0537\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.689367 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.689325 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18e86d904aaa5a0b5b95eb0f9feb0537-config\") pod \"kube-apiserver-proxy-ip-10-0-132-26.ec2.internal\" (UID: \"18e86d904aaa5a0b5b95eb0f9feb0537\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.689367 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.689340 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52853f9203affd2579f94479c933b303-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"52853f9203affd2579f94479c933b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.689367 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.689348 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52853f9203affd2579f94479c933b303-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"52853f9203affd2579f94479c933b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.781343 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.781297 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:32.882188 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.882111 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:32.904573 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.904546 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.908764 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:32.908748 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jun 08 19:26:32.982683 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:32.982633 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:33.083220 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:33.083192 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:33.183833 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:33.183739 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:33.277251 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.277228 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:33.283842 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:33.283818 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:33.330365 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.330341 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 19:26:33.330855 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.330509 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 19:26:33.330855 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.330540 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 19:26:33.384033 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:33.384006 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:33.387108 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:33.387078 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52853f9203affd2579f94479c933b303.slice/crio-082721800ba7517b6d4941517e3fe0f63c9b74abe806ffb397618137a9fddb13 WatchSource:0}: Error finding container 082721800ba7517b6d4941517e3fe0f63c9b74abe806ffb397618137a9fddb13: Status 404 returned error can't find the container with id 082721800ba7517b6d4941517e3fe0f63c9b74abe806ffb397618137a9fddb13 Jun 08 19:26:33.387650 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:33.387635 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e86d904aaa5a0b5b95eb0f9feb0537.slice/crio-dc7e0c07f1a33cb8043d1491a50e7ae12178aa9d1967b356bf80f016bfcf7986 WatchSource:0}: Error finding container dc7e0c07f1a33cb8043d1491a50e7ae12178aa9d1967b356bf80f016bfcf7986: Status 404 returned error can't find the container with id dc7e0c07f1a33cb8043d1491a50e7ae12178aa9d1967b356bf80f016bfcf7986 Jun 08 19:26:33.393223 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.393193 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 19:21:32 +0000 UTC" deadline="2028-02-25 15:06:53.166926278 +0000 UTC" Jun 08 19:26:33.393223 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.393223 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15043h40m19.77370693s" Jun 08 19:26:33.394284 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.394263 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:26:33.466153 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.466053 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" event={"ID":"52853f9203affd2579f94479c933b303","Type":"ContainerStarted","Data":"082721800ba7517b6d4941517e3fe0f63c9b74abe806ffb397618137a9fddb13"} Jun 08 19:26:33.467007 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.466978 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" event={"ID":"18e86d904aaa5a0b5b95eb0f9feb0537","Type":"ContainerStarted","Data":"dc7e0c07f1a33cb8043d1491a50e7ae12178aa9d1967b356bf80f016bfcf7986"} Jun 08 19:26:33.484088 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:33.484054 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:33.584609 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:33.584568 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:33.685108 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:33.685079 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:33.770054 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.769978 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:33.786207 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:33.786173 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jun 08 19:26:33.879595 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.879554 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:33.885338 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.885302 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jun 08 19:26:33.897026 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.897001 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:26:33.898355 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.898320 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jun 08 19:26:33.905599 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:33.905470 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:26:34.368628 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.368585 2549 apiserver.go:52] "Watching apiserver" Jun 08 19:26:34.377743 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.377712 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 19:26:34.378190 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.378162 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-69rrr","kube-system/global-pull-secret-syncer-ctdmm","kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jrdzn","openshift-dns/node-resolver-cktnw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal","openshift-multus/multus-z6w5h","openshift-multus/network-metrics-daemon-bpp7k","openshift-network-diagnostics/network-check-target-z8rjv","kube-system/konnectivity-agent-tr58h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4","openshift-image-registry/node-ca-kzvj8","openshift-multus/multus-additional-cni-plugins-kxpbn","openshift-network-operator/iptables-alerter-jhrl8"] Jun 08 19:26:34.379996 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.379974 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.381246 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.381219 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.382716 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.382610 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.382825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.382807 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 19:26:34.382928 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.382895 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 19:26:34.383186 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.383162 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 19:26:34.383186 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.383178 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-blddq\"" Jun 08 19:26:34.383327 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.383203 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 19:26:34.383486 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.383469 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 19:26:34.383694 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.383675 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bhmqm\"" Jun 08 19:26:34.383787 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.383712 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 19:26:34.384275 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.384250 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.384952 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.384898 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:26:34.385087 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.385016 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jmjqr\"" Jun 08 19:26:34.385181 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.385146 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 19:26:34.385259 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.385238 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 19:26:34.386122 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.386101 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.386647 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.386631 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 19:26:34.387058 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.387022 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 19:26:34.387217 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.387079 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6jgwg\"" Jun 08 19:26:34.387343 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.387324 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:26:34.387732 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.387709 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:34.387819 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.387799 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:34.388923 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.388474 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 19:26:34.388923 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.388742 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5wfsv\"" Jun 08 19:26:34.388923 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.388842 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 19:26:34.389274 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.389256 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:34.389367 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.389324 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:34.390713 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.390693 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.392609 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.392593 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:34.392708 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.392683 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:34.393285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.393244 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 19:26:34.393285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.393273 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 19:26:34.393688 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.393483 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 19:26:34.393688 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.393584 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 19:26:34.393688 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.393586 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 19:26:34.393688 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.393627 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b4dcj\"" Jun 08 19:26:34.393892 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.393699 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 19:26:34.394325 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.394305 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:34.396326 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.396308 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.396689 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.396559 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:34.398100 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.397785 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 19:26:34.398100 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.397801 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lrphw\"" Jun 08 19:26:34.398100 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.397962 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 19:26:34.399012 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.398489 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f39fd033-4c18-4402-89ff-a3eaa0d6738a-iptables-alerter-script\") pod \"iptables-alerter-jhrl8\" (UID: \"f39fd033-4c18-4402-89ff-a3eaa0d6738a\") " pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.399012 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.398624 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f39fd033-4c18-4402-89ff-a3eaa0d6738a-host-slash\") pod \"iptables-alerter-jhrl8\" (UID: \"f39fd033-4c18-4402-89ff-a3eaa0d6738a\") " pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.399012 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.398656 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-tuned\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.399012 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.398684 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.399244 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.398688 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhnmh\" (UniqueName: \"kubernetes.io/projected/c4c78959-04e2-4a31-a546-d13235ebbe5f-kube-api-access-lhnmh\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:34.399244 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399182 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-cnibin\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.399352 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399326 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-run-multus-certs\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.399409 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399368 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-os-release\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.399409 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399402 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6aabdd53-088d-4eed-a7f1-27e032fff897-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.399517 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399434 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6aabdd53-088d-4eed-a7f1-27e032fff897-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.399517 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399490 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-modprobe-d\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.399613 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399527 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-sys\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.399613 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399557 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-host\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.399613 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399564 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 19:26:34.399613 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399587 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-system-cni-dir\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.399799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399616 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-run\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.399799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399639 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-tmp\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.399799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399669 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-system-cni-dir\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.399799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399698 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-cni-dir\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.399799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399729 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-var-lib-kubelet\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.399799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399741 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 19:26:34.399799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399760 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-424nl\" (UniqueName: \"kubernetes.io/projected/f39fd033-4c18-4402-89ff-a3eaa0d6738a-kube-api-access-424nl\") pod \"iptables-alerter-jhrl8\" (UID: \"f39fd033-4c18-4402-89ff-a3eaa0d6738a\") " pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.399799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399790 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-sysctl-conf\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.400180 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399819 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-lib-modules\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.400180 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399852 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4df82b22-3f2a-462b-aa9a-2ec20a55f82a-hosts-file\") pod \"node-resolver-cktnw\" (UID: \"4df82b22-3f2a-462b-aa9a-2ec20a55f82a\") " pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.400180 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399872 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 19:26:34.400180 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399887 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-run-netns\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.400180 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399963 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-cnibin\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.400180 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.399993 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.400457 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.400443 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-kubernetes\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.400509 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.400483 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-systemd\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.400559 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.400535 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:34.400611 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.400561 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6aabdd53-088d-4eed-a7f1-27e032fff897-cni-binary-copy\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.401117 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.400770 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-cni-binary-copy\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401117 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.400844 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-socket-dir-parent\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401117 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.400884 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-var-lib-cni-bin\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401117 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.400964 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-hostroot\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401117 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.400999 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ftjq\" (UniqueName: \"kubernetes.io/projected/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-kube-api-access-9ftjq\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401117 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401057 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxhb7\" (UniqueName: \"kubernetes.io/projected/6aabdd53-088d-4eed-a7f1-27e032fff897-kube-api-access-mxhb7\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.401117 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401106 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-sysctl-d\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401161 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-var-lib-kubelet\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401226 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sllnq\" (UniqueName: \"kubernetes.io/projected/4df82b22-3f2a-462b-aa9a-2ec20a55f82a-kube-api-access-sllnq\") pod \"node-resolver-cktnw\" (UID: \"4df82b22-3f2a-462b-aa9a-2ec20a55f82a\") " pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401262 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-os-release\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401292 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-etc-kubernetes\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401321 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-sysconfig\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401349 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v44d6\" (UniqueName: \"kubernetes.io/projected/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-kube-api-access-v44d6\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401376 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4df82b22-3f2a-462b-aa9a-2ec20a55f82a-tmp-dir\") pod \"node-resolver-cktnw\" (UID: \"4df82b22-3f2a-462b-aa9a-2ec20a55f82a\") " pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401404 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-run-k8s-cni-cncf-io\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401432 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-var-lib-cni-multus\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401442 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qffnq\"" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401460 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-conf-dir\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.401494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401489 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-daemon-config\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.402096 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.401638 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:26:34.402574 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.402487 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 19:26:34.402574 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.402504 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4xjqw\"" Jun 08 19:26:34.402574 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.402546 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 19:26:34.402751 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.402546 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 19:26:34.423414 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.423390 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j5tz5" Jun 08 19:26:34.432373 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.432353 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j5tz5" Jun 08 19:26:34.487356 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.487330 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 19:26:34.501644 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501611 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-sysconfig\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.501781 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501647 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v44d6\" (UniqueName: \"kubernetes.io/projected/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-kube-api-access-v44d6\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.501781 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501674 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-conf-dir\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.501781 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501700 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-daemon-config\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.501781 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-run-multus-certs\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.501781 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501752 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-node-log\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.501781 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501778 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f39fd033-4c18-4402-89ff-a3eaa0d6738a-iptables-alerter-script\") pod \"iptables-alerter-jhrl8\" (UID: \"f39fd033-4c18-4402-89ff-a3eaa0d6738a\") " pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501753 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-conf-dir\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501799 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-run-multus-certs\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501724 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-sysconfig\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501805 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f39fd033-4c18-4402-89ff-a3eaa0d6738a-host-slash\") pod \"iptables-alerter-jhrl8\" (UID: \"f39fd033-4c18-4402-89ff-a3eaa0d6738a\") " pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501867 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhnmh\" (UniqueName: \"kubernetes.io/projected/c4c78959-04e2-4a31-a546-d13235ebbe5f-kube-api-access-lhnmh\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501875 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f39fd033-4c18-4402-89ff-a3eaa0d6738a-host-slash\") pod \"iptables-alerter-jhrl8\" (UID: \"f39fd033-4c18-4402-89ff-a3eaa0d6738a\") " pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501926 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-etc-openvswitch\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501965 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-run-ovn\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.501989 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77cb9a8d-ed29-4cda-a410-90e077ebf77b-ovn-node-metrics-cert\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502036 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77cb9a8d-ed29-4cda-a410-90e077ebf77b-ovnkube-script-lib\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502065 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-os-release\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502091 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6aabdd53-088d-4eed-a7f1-27e032fff897-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502116 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-modprobe-d\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502139 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-host\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502154 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-os-release\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502170 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-var-lib-openvswitch\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.502198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502196 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-system-cni-dir\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502200 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-host\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502232 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-cni-dir\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502254 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-system-cni-dir\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502291 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-var-lib-kubelet\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502294 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-modprobe-d\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502321 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502330 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-cni-dir\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502347 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d8ad786-aa67-4968-8ce2-d1273c7abc86-konnectivity-ca\") pod \"konnectivity-agent-tr58h\" (UID: \"3d8ad786-aa67-4968-8ce2-d1273c7abc86\") " pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502362 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-daemon-config\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502373 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-424nl\" (UniqueName: \"kubernetes.io/projected/f39fd033-4c18-4402-89ff-a3eaa0d6738a-kube-api-access-424nl\") pod \"iptables-alerter-jhrl8\" (UID: \"f39fd033-4c18-4402-89ff-a3eaa0d6738a\") " pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502379 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-var-lib-kubelet\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502408 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f39fd033-4c18-4402-89ff-a3eaa0d6738a-iptables-alerter-script\") pod \"iptables-alerter-jhrl8\" (UID: \"f39fd033-4c18-4402-89ff-a3eaa0d6738a\") " pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502424 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-lib-modules\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502459 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4df82b22-3f2a-462b-aa9a-2ec20a55f82a-hosts-file\") pod \"node-resolver-cktnw\" (UID: \"4df82b22-3f2a-462b-aa9a-2ec20a55f82a\") " pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502488 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-run-netns\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502520 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-slash\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.502982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502523 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-run-netns\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502528 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4df82b22-3f2a-462b-aa9a-2ec20a55f82a-hosts-file\") pod \"node-resolver-cktnw\" (UID: \"4df82b22-3f2a-462b-aa9a-2ec20a55f82a\") " pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502549 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-log-socket\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502602 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-run-ovn-kubernetes\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502633 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502659 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6aabdd53-088d-4eed-a7f1-27e032fff897-cni-binary-copy\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502663 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-lib-modules\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502683 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-hostroot\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502705 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-run-netns\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502727 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-cni-netd\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502753 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-var-lib-kubelet\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.502757 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502778 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sllnq\" (UniqueName: \"kubernetes.io/projected/4df82b22-3f2a-462b-aa9a-2ec20a55f82a-kube-api-access-sllnq\") pod \"node-resolver-cktnw\" (UID: \"4df82b22-3f2a-462b-aa9a-2ec20a55f82a\") " pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502806 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502815 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-var-lib-kubelet\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502831 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77cb9a8d-ed29-4cda-a410-90e077ebf77b-env-overrides\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502755 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-hostroot\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.503745 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.502875 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs podName:c4c78959-04e2-4a31-a546-d13235ebbe5f nodeName:}" failed. No retries permitted until 2026-06-08 19:26:35.002835268 +0000 UTC m=+2.983106280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs") pod "network-metrics-daemon-bpp7k" (UID: "c4c78959-04e2-4a31-a546-d13235ebbe5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502926 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502953 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-registration-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.502980 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4df82b22-3f2a-462b-aa9a-2ec20a55f82a-tmp-dir\") pod \"node-resolver-cktnw\" (UID: \"4df82b22-3f2a-462b-aa9a-2ec20a55f82a\") " pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503006 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-run-k8s-cni-cncf-io\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503030 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-var-lib-cni-multus\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503078 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-kubelet\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503102 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4wp4\" (UniqueName: \"kubernetes.io/projected/021ccab2-b7bb-4b24-8eef-76c64e87c0da-kube-api-access-z4wp4\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503102 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-run-k8s-cni-cncf-io\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503142 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-tuned\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503146 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-var-lib-cni-multus\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503169 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-cnibin\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503194 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcqzn\" (UniqueName: \"kubernetes.io/projected/77cb9a8d-ed29-4cda-a410-90e077ebf77b-kube-api-access-wcqzn\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503212 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503227 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmz7l\" (UniqueName: \"kubernetes.io/projected/87128f8d-6e20-4850-80f5-cbdec1a08016-kube-api-access-mmz7l\") pod \"node-ca-kzvj8\" (UID: \"87128f8d-6e20-4850-80f5-cbdec1a08016\") " pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503243 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6aabdd53-088d-4eed-a7f1-27e032fff897-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503258 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-sys\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.504541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503271 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-run-systemd\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503303 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87128f8d-6e20-4850-80f5-cbdec1a08016-serviceca\") pod \"node-ca-kzvj8\" (UID: \"87128f8d-6e20-4850-80f5-cbdec1a08016\") " pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503302 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6aabdd53-088d-4eed-a7f1-27e032fff897-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503324 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-run\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503306 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4df82b22-3f2a-462b-aa9a-2ec20a55f82a-tmp-dir\") pod \"node-resolver-cktnw\" (UID: \"4df82b22-3f2a-462b-aa9a-2ec20a55f82a\") " pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503348 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-tmp\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503357 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-cnibin\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503355 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6aabdd53-088d-4eed-a7f1-27e032fff897-cni-binary-copy\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503374 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-system-cni-dir\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503428 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-sys-fs\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503458 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d8ad786-aa67-4968-8ce2-d1273c7abc86-agent-certs\") pod \"konnectivity-agent-tr58h\" (UID: \"3d8ad786-aa67-4968-8ce2-d1273c7abc86\") " pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503478 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-system-cni-dir\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503489 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-sysctl-conf\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503433 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-sys\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503505 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-run\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503531 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-systemd-units\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503562 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-run-openvswitch\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503590 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-socket-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.505159 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503614 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-sysctl-conf\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503623 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-device-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503653 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-cnibin\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503697 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503704 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-cnibin\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503753 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-kubernetes\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503777 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-systemd\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503806 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77cb9a8d-ed29-4cda-a410-90e077ebf77b-ovnkube-config\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503831 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503838 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-systemd\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503845 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6aabdd53-088d-4eed-a7f1-27e032fff897-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503853 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87128f8d-6e20-4850-80f5-cbdec1a08016-host\") pod \"node-ca-kzvj8\" (UID: \"87128f8d-6e20-4850-80f5-cbdec1a08016\") " pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503839 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503923 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-cni-binary-copy\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503954 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-socket-dir-parent\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503978 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-var-lib-cni-bin\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503997 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6aabdd53-088d-4eed-a7f1-27e032fff897-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.505715 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504001 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftjq\" (UniqueName: \"kubernetes.io/projected/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-kube-api-access-9ftjq\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504047 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-multus-socket-dir-parent\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504045 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/747ed8f3-e7b3-49a0-9fe6-968e42212258-kubelet-config\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504090 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-host-var-lib-cni-bin\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504088 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/747ed8f3-e7b3-49a0-9fe6-968e42212258-dbus\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.503818 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-kubernetes\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504128 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxhb7\" (UniqueName: \"kubernetes.io/projected/6aabdd53-088d-4eed-a7f1-27e032fff897-kube-api-access-mxhb7\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504165 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-sysctl-d\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504189 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-os-release\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504212 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-etc-kubernetes\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504270 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-os-release\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504300 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-cni-bin\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504388 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-etc-kubernetes\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504413 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-sysctl-d\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.506296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.504444 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-cni-binary-copy\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.507623 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.507600 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-tmp\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.507725 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.507630 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-etc-tuned\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.520187 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.519616 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v44d6\" (UniqueName: \"kubernetes.io/projected/1d69fe10-75a1-4fb0-8cff-b0b81386e6ab-kube-api-access-v44d6\") pod \"tuned-jrdzn\" (UID: \"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab\") " pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.520800 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.520773 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ftjq\" (UniqueName: \"kubernetes.io/projected/2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19-kube-api-access-9ftjq\") pod \"multus-z6w5h\" (UID: \"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19\") " pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.520890 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.520878 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-424nl\" (UniqueName: \"kubernetes.io/projected/f39fd033-4c18-4402-89ff-a3eaa0d6738a-kube-api-access-424nl\") pod \"iptables-alerter-jhrl8\" (UID: \"f39fd033-4c18-4402-89ff-a3eaa0d6738a\") " pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.520986 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.520933 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxhb7\" (UniqueName: \"kubernetes.io/projected/6aabdd53-088d-4eed-a7f1-27e032fff897-kube-api-access-mxhb7\") pod \"multus-additional-cni-plugins-kxpbn\" (UID: \"6aabdd53-088d-4eed-a7f1-27e032fff897\") " pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.521072 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.521041 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sllnq\" (UniqueName: \"kubernetes.io/projected/4df82b22-3f2a-462b-aa9a-2ec20a55f82a-kube-api-access-sllnq\") pod \"node-resolver-cktnw\" (UID: \"4df82b22-3f2a-462b-aa9a-2ec20a55f82a\") " pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.522419 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.522396 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhnmh\" (UniqueName: \"kubernetes.io/projected/c4c78959-04e2-4a31-a546-d13235ebbe5f-kube-api-access-lhnmh\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:34.604772 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604740 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-slash\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.604772 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604773 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-log-socket\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604790 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-run-ovn-kubernetes\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604833 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-run-ovn-kubernetes\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604842 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-log-socket\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604885 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-slash\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604941 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-run-netns\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604958 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-cni-netd\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604975 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:34.605003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.604993 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77cb9a8d-ed29-4cda-a410-90e077ebf77b-env-overrides\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605017 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605032 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-cni-netd\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605040 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-registration-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605076 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-run-netns\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605099 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-kubelet\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605141 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-registration-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605145 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4wp4\" (UniqueName: \"kubernetes.io/projected/021ccab2-b7bb-4b24-8eef-76c64e87c0da-kube-api-access-z4wp4\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605175 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-kubelet\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605204 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcqzn\" (UniqueName: \"kubernetes.io/projected/77cb9a8d-ed29-4cda-a410-90e077ebf77b-kube-api-access-wcqzn\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605233 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605205 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605259 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmz7l\" (UniqueName: \"kubernetes.io/projected/87128f8d-6e20-4850-80f5-cbdec1a08016-kube-api-access-mmz7l\") pod \"node-ca-kzvj8\" (UID: \"87128f8d-6e20-4850-80f5-cbdec1a08016\") " pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605322 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-run-systemd\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.605341 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605351 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87128f8d-6e20-4850-80f5-cbdec1a08016-serviceca\") pod \"node-ca-kzvj8\" (UID: \"87128f8d-6e20-4850-80f5-cbdec1a08016\") " pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.605372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605379 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-sys-fs\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605417 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-run-systemd\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.605452 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret podName:747ed8f3-e7b3-49a0-9fe6-968e42212258 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:35.105432878 +0000 UTC m=+3.085703872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret") pod "global-pull-secret-syncer-ctdmm" (UID: "747ed8f3-e7b3-49a0-9fe6-968e42212258") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605450 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-sys-fs\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605421 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d8ad786-aa67-4968-8ce2-d1273c7abc86-agent-certs\") pod \"konnectivity-agent-tr58h\" (UID: \"3d8ad786-aa67-4968-8ce2-d1273c7abc86\") " pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605474 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77cb9a8d-ed29-4cda-a410-90e077ebf77b-env-overrides\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605503 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-systemd-units\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605532 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-run-openvswitch\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605541 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-systemd-units\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605558 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-socket-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605579 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-device-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605580 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-run-openvswitch\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605608 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77cb9a8d-ed29-4cda-a410-90e077ebf77b-ovnkube-config\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605632 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605637 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-device-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605703 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-socket-dir\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.606127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605720 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87128f8d-6e20-4850-80f5-cbdec1a08016-host\") pod \"node-ca-kzvj8\" (UID: \"87128f8d-6e20-4850-80f5-cbdec1a08016\") " pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605730 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/021ccab2-b7bb-4b24-8eef-76c64e87c0da-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605753 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87128f8d-6e20-4850-80f5-cbdec1a08016-host\") pod \"node-ca-kzvj8\" (UID: \"87128f8d-6e20-4850-80f5-cbdec1a08016\") " pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605772 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/747ed8f3-e7b3-49a0-9fe6-968e42212258-kubelet-config\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605798 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/747ed8f3-e7b3-49a0-9fe6-968e42212258-dbus\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605819 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87128f8d-6e20-4850-80f5-cbdec1a08016-serviceca\") pod \"node-ca-kzvj8\" (UID: \"87128f8d-6e20-4850-80f5-cbdec1a08016\") " pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605831 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-cni-bin\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605861 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-node-log\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605868 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/747ed8f3-e7b3-49a0-9fe6-968e42212258-dbus\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605870 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/747ed8f3-e7b3-49a0-9fe6-968e42212258-kubelet-config\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605887 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-cni-bin\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605888 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-etc-openvswitch\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605903 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-node-log\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605938 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-etc-openvswitch\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605941 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-run-ovn\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605963 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-run-ovn\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.605979 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77cb9a8d-ed29-4cda-a410-90e077ebf77b-ovn-node-metrics-cert\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.606007 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77cb9a8d-ed29-4cda-a410-90e077ebf77b-ovnkube-script-lib\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.606969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.606034 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-var-lib-openvswitch\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.607761 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.606063 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.607761 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.606089 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d8ad786-aa67-4968-8ce2-d1273c7abc86-konnectivity-ca\") pod \"konnectivity-agent-tr58h\" (UID: \"3d8ad786-aa67-4968-8ce2-d1273c7abc86\") " pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:34.607761 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.606090 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-var-lib-openvswitch\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.607761 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.606128 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77cb9a8d-ed29-4cda-a410-90e077ebf77b-ovnkube-config\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.607761 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.606154 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cb9a8d-ed29-4cda-a410-90e077ebf77b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.607761 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.606511 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77cb9a8d-ed29-4cda-a410-90e077ebf77b-ovnkube-script-lib\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.607761 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.606575 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d8ad786-aa67-4968-8ce2-d1273c7abc86-konnectivity-ca\") pod \"konnectivity-agent-tr58h\" (UID: \"3d8ad786-aa67-4968-8ce2-d1273c7abc86\") " pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:34.608240 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.608220 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d8ad786-aa67-4968-8ce2-d1273c7abc86-agent-certs\") pod \"konnectivity-agent-tr58h\" (UID: \"3d8ad786-aa67-4968-8ce2-d1273c7abc86\") " pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:34.608400 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.608382 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77cb9a8d-ed29-4cda-a410-90e077ebf77b-ovn-node-metrics-cert\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.613356 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.613338 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:34.613356 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.613359 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:34.613512 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.613370 2549 projected.go:196] Error preparing data for projected volume kube-api-access-62hxg for pod openshift-network-diagnostics/network-check-target-z8rjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:34.613512 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:34.613442 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg podName:f884e8e6-8f28-4be9-8382-0b4bd337c75e nodeName:}" failed. No retries permitted until 2026-06-08 19:26:35.113427588 +0000 UTC m=+3.093698589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-62hxg" (UniqueName: "kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg") pod "network-check-target-z8rjv" (UID: "f884e8e6-8f28-4be9-8382-0b4bd337c75e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:34.614739 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.614715 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4wp4\" (UniqueName: \"kubernetes.io/projected/021ccab2-b7bb-4b24-8eef-76c64e87c0da-kube-api-access-z4wp4\") pod \"aws-ebs-csi-driver-node-ctmj4\" (UID: \"021ccab2-b7bb-4b24-8eef-76c64e87c0da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.615146 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.615125 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcqzn\" (UniqueName: \"kubernetes.io/projected/77cb9a8d-ed29-4cda-a410-90e077ebf77b-kube-api-access-wcqzn\") pod \"ovnkube-node-69rrr\" (UID: \"77cb9a8d-ed29-4cda-a410-90e077ebf77b\") " pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.615845 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.615822 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmz7l\" (UniqueName: \"kubernetes.io/projected/87128f8d-6e20-4850-80f5-cbdec1a08016-kube-api-access-mmz7l\") pod \"node-ca-kzvj8\" (UID: \"87128f8d-6e20-4850-80f5-cbdec1a08016\") " pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:34.692485 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.692415 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z6w5h" Jun 08 19:26:34.700457 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.700438 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" Jun 08 19:26:34.710329 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.710308 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jhrl8" Jun 08 19:26:34.714013 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.713993 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" Jun 08 19:26:34.721337 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.721319 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cktnw" Jun 08 19:26:34.727133 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.727109 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:34.733944 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.733921 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:34.740687 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.740656 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" Jun 08 19:26:34.746348 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:34.746330 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kzvj8" Jun 08 19:26:35.009544 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.009472 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:35.009723 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:35.009571 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:35.009723 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:35.009626 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs podName:c4c78959-04e2-4a31-a546-d13235ebbe5f nodeName:}" failed. No retries permitted until 2026-06-08 19:26:36.009612552 +0000 UTC m=+3.989883555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs") pod "network-metrics-daemon-bpp7k" (UID: "c4c78959-04e2-4a31-a546-d13235ebbe5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:35.109987 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.109956 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:35.110171 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:35.110100 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:35.110171 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:35.110160 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret podName:747ed8f3-e7b3-49a0-9fe6-968e42212258 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:36.110145978 +0000 UTC m=+4.090416966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret") pod "global-pull-secret-syncer-ctdmm" (UID: "747ed8f3-e7b3-49a0-9fe6-968e42212258") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:35.210750 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.210711 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:35.210920 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:35.210892 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:35.210983 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:35.210932 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:35.210983 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:35.210945 2549 projected.go:196] Error preparing data for projected volume kube-api-access-62hxg for pod openshift-network-diagnostics/network-check-target-z8rjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:35.211059 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:35.211006 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg podName:f884e8e6-8f28-4be9-8382-0b4bd337c75e nodeName:}" failed. No retries permitted until 2026-06-08 19:26:36.210988596 +0000 UTC m=+4.191259590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-62hxg" (UniqueName: "kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg") pod "network-check-target-z8rjv" (UID: "f884e8e6-8f28-4be9-8382-0b4bd337c75e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:35.250880 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:35.250856 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aabdd53_088d_4eed_a7f1_27e032fff897.slice/crio-859900efba7dccf6af90bb15549c4edc6f4b60c230be75f9c4b860e589f146a7 WatchSource:0}: Error finding container 859900efba7dccf6af90bb15549c4edc6f4b60c230be75f9c4b860e589f146a7: Status 404 returned error can't find the container with id 859900efba7dccf6af90bb15549c4edc6f4b60c230be75f9c4b860e589f146a7 Jun 08 19:26:35.252313 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:35.252195 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77cb9a8d_ed29_4cda_a410_90e077ebf77b.slice/crio-6e941db491d7a2b61269f2dbbaa266f70d67e9939f09b7e9128aa619bf97b842 WatchSource:0}: Error finding container 6e941db491d7a2b61269f2dbbaa266f70d67e9939f09b7e9128aa619bf97b842: Status 404 returned error can't find the container with id 6e941db491d7a2b61269f2dbbaa266f70d67e9939f09b7e9128aa619bf97b842 Jun 08 19:26:35.255198 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:35.255171 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8ad786_aa67_4968_8ce2_d1273c7abc86.slice/crio-6e92164f501116dab0a7a9a2634305b1758ab765f8b2700296391a7e2ff4004b WatchSource:0}: Error finding container 6e92164f501116dab0a7a9a2634305b1758ab765f8b2700296391a7e2ff4004b: Status 404 returned error can't find the container with id 6e92164f501116dab0a7a9a2634305b1758ab765f8b2700296391a7e2ff4004b Jun 08 19:26:35.256803 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:35.256662 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87128f8d_6e20_4850_80f5_cbdec1a08016.slice/crio-6cf19d3517f82d4c49402287948f92642517819b81979437b19700db21dc3d80 WatchSource:0}: Error finding container 6cf19d3517f82d4c49402287948f92642517819b81979437b19700db21dc3d80: Status 404 returned error can't find the container with id 6cf19d3517f82d4c49402287948f92642517819b81979437b19700db21dc3d80 Jun 08 19:26:35.257128 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:35.257109 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d69fe10_75a1_4fb0_8cff_b0b81386e6ab.slice/crio-832be32b44ce2428953c0daef036c81d18f64c21e55864c119effee4982cb3f7 WatchSource:0}: Error finding container 832be32b44ce2428953c0daef036c81d18f64c21e55864c119effee4982cb3f7: Status 404 returned error can't find the container with id 832be32b44ce2428953c0daef036c81d18f64c21e55864c119effee4982cb3f7 Jun 08 19:26:35.259141 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:35.258649 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2138ec_7f43_4c39_b7a4_d86ce3d8fb19.slice/crio-7f89e14b025b2d51bf068cb166bb118227fe34c5e10ccb7ef968c945ce4d94eb WatchSource:0}: Error finding container 7f89e14b025b2d51bf068cb166bb118227fe34c5e10ccb7ef968c945ce4d94eb: Status 404 returned error can't find the container with id 7f89e14b025b2d51bf068cb166bb118227fe34c5e10ccb7ef968c945ce4d94eb Jun 08 19:26:35.259704 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:35.259522 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021ccab2_b7bb_4b24_8eef_76c64e87c0da.slice/crio-508afab6ad715de710787c46e318219ee407670528ff0ffb226ba9ac4986a86c WatchSource:0}: Error finding container 508afab6ad715de710787c46e318219ee407670528ff0ffb226ba9ac4986a86c: Status 404 returned error can't find the container with id 508afab6ad715de710787c46e318219ee407670528ff0ffb226ba9ac4986a86c Jun 08 19:26:35.261046 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:35.261024 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39fd033_4c18_4402_89ff_a3eaa0d6738a.slice/crio-656039bc9ea25c74858408d1f995a9af67e8c4980c76d33c65399afb38862f40 WatchSource:0}: Error finding container 656039bc9ea25c74858408d1f995a9af67e8c4980c76d33c65399afb38862f40: Status 404 returned error can't find the container with id 656039bc9ea25c74858408d1f995a9af67e8c4980c76d33c65399afb38862f40 Jun 08 19:26:35.262242 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:26:35.262056 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df82b22_3f2a_462b_aa9a_2ec20a55f82a.slice/crio-52c4f9018471033de79aee12730224d24bf1a4a72f95edbce19da633e001737d WatchSource:0}: Error finding container 52c4f9018471033de79aee12730224d24bf1a4a72f95edbce19da633e001737d: Status 404 returned error can't find the container with id 52c4f9018471033de79aee12730224d24bf1a4a72f95edbce19da633e001737d Jun 08 19:26:35.434788 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.434741 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:21:34 +0000 UTC" deadline="2028-02-18 08:59:01.142558022 +0000 UTC" Jun 08 19:26:35.434788 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.434791 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14869h32m25.70777128s" Jun 08 19:26:35.464697 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.464200 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:35.464697 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:35.464327 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:35.473745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.473714 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerStarted","Data":"6e941db491d7a2b61269f2dbbaa266f70d67e9939f09b7e9128aa619bf97b842"} Jun 08 19:26:35.474768 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.474737 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" event={"ID":"021ccab2-b7bb-4b24-8eef-76c64e87c0da","Type":"ContainerStarted","Data":"508afab6ad715de710787c46e318219ee407670528ff0ffb226ba9ac4986a86c"} Jun 08 19:26:35.475761 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.475735 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" event={"ID":"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab","Type":"ContainerStarted","Data":"832be32b44ce2428953c0daef036c81d18f64c21e55864c119effee4982cb3f7"} Jun 08 19:26:35.476727 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.476707 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tr58h" event={"ID":"3d8ad786-aa67-4968-8ce2-d1273c7abc86","Type":"ContainerStarted","Data":"6e92164f501116dab0a7a9a2634305b1758ab765f8b2700296391a7e2ff4004b"} Jun 08 19:26:35.477682 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.477663 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" event={"ID":"6aabdd53-088d-4eed-a7f1-27e032fff897","Type":"ContainerStarted","Data":"859900efba7dccf6af90bb15549c4edc6f4b60c230be75f9c4b860e589f146a7"} Jun 08 19:26:35.479394 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.479375 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" event={"ID":"18e86d904aaa5a0b5b95eb0f9feb0537","Type":"ContainerStarted","Data":"373d1e0390f4cbeae06aa1d76daa39b3611334892399b4e3e9b31f8ee902c68a"} Jun 08 19:26:35.480363 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.480344 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cktnw" event={"ID":"4df82b22-3f2a-462b-aa9a-2ec20a55f82a","Type":"ContainerStarted","Data":"52c4f9018471033de79aee12730224d24bf1a4a72f95edbce19da633e001737d"} Jun 08 19:26:35.481507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.481482 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jhrl8" event={"ID":"f39fd033-4c18-4402-89ff-a3eaa0d6738a","Type":"ContainerStarted","Data":"656039bc9ea25c74858408d1f995a9af67e8c4980c76d33c65399afb38862f40"} Jun 08 19:26:35.482659 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.482608 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z6w5h" event={"ID":"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19","Type":"ContainerStarted","Data":"7f89e14b025b2d51bf068cb166bb118227fe34c5e10ccb7ef968c945ce4d94eb"} Jun 08 19:26:35.483710 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.483692 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kzvj8" event={"ID":"87128f8d-6e20-4850-80f5-cbdec1a08016","Type":"ContainerStarted","Data":"6cf19d3517f82d4c49402287948f92642517819b81979437b19700db21dc3d80"} Jun 08 19:26:35.494509 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:35.494469 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" podStartSLOduration=2.4944566 podStartE2EDuration="2.4944566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:35.494247871 +0000 UTC m=+3.474518881" watchObservedRunningTime="2026-06-08 19:26:35.4944566 +0000 UTC m=+3.474727611" Jun 08 19:26:36.016271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.016232 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:36.016444 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.016432 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:36.016519 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.016495 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs podName:c4c78959-04e2-4a31-a546-d13235ebbe5f nodeName:}" failed. No retries permitted until 2026-06-08 19:26:38.016475394 +0000 UTC m=+5.996746390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs") pod "network-metrics-daemon-bpp7k" (UID: "c4c78959-04e2-4a31-a546-d13235ebbe5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:36.116927 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.116874 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:36.117111 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.117042 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:36.117111 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.117109 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret podName:747ed8f3-e7b3-49a0-9fe6-968e42212258 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:38.117091042 +0000 UTC m=+6.097362045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret") pod "global-pull-secret-syncer-ctdmm" (UID: "747ed8f3-e7b3-49a0-9fe6-968e42212258") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:36.218823 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.218164 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:36.218823 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.218375 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:36.218823 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.218395 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:36.218823 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.218408 2549 projected.go:196] Error preparing data for projected volume kube-api-access-62hxg for pod openshift-network-diagnostics/network-check-target-z8rjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:36.218823 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.218468 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg podName:f884e8e6-8f28-4be9-8382-0b4bd337c75e nodeName:}" failed. No retries permitted until 2026-06-08 19:26:38.21845017 +0000 UTC m=+6.198721178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-62hxg" (UniqueName: "kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg") pod "network-check-target-z8rjv" (UID: "f884e8e6-8f28-4be9-8382-0b4bd337c75e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:36.313618 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.313587 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:36.435752 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.435691 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:21:34 +0000 UTC" deadline="2027-11-17 04:02:19.802721271 +0000 UTC" Jun 08 19:26:36.435752 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.435749 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12632h35m43.366976885s" Jun 08 19:26:36.463674 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.463637 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:36.463826 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.463686 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:36.463826 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.463781 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:36.463980 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:36.463931 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:36.511569 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.511531 2549 generic.go:356] "Generic (PLEG): container finished" podID="52853f9203affd2579f94479c933b303" containerID="595d3fbe8f5cd3e325ed249712e08ce00e29f54fb59cc7802c0269ee578b631e" exitCode=0 Jun 08 19:26:36.512201 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:36.511962 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" event={"ID":"52853f9203affd2579f94479c933b303","Type":"ContainerDied","Data":"595d3fbe8f5cd3e325ed249712e08ce00e29f54fb59cc7802c0269ee578b631e"} Jun 08 19:26:37.463645 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:37.463614 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:37.464273 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:37.463739 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:37.527108 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:37.526511 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" event={"ID":"52853f9203affd2579f94479c933b303","Type":"ContainerStarted","Data":"bd618ca0ea19efb1291e17343fd91d6134bc2e27df9c8fd4fe7080b329b864a8"} Jun 08 19:26:38.033821 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:38.033769 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:38.034038 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.034000 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:38.034113 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.034067 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs podName:c4c78959-04e2-4a31-a546-d13235ebbe5f nodeName:}" failed. No retries permitted until 2026-06-08 19:26:42.034048063 +0000 UTC m=+10.014319058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs") pod "network-metrics-daemon-bpp7k" (UID: "c4c78959-04e2-4a31-a546-d13235ebbe5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:38.134745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:38.134704 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:38.134988 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.134862 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:38.134988 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.134937 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret podName:747ed8f3-e7b3-49a0-9fe6-968e42212258 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:42.134919076 +0000 UTC m=+10.115190081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret") pod "global-pull-secret-syncer-ctdmm" (UID: "747ed8f3-e7b3-49a0-9fe6-968e42212258") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:38.236189 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:38.236150 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:38.236363 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.236315 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:38.236363 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.236339 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:38.236363 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.236352 2549 projected.go:196] Error preparing data for projected volume kube-api-access-62hxg for pod openshift-network-diagnostics/network-check-target-z8rjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:38.236504 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.236415 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg podName:f884e8e6-8f28-4be9-8382-0b4bd337c75e nodeName:}" failed. No retries permitted until 2026-06-08 19:26:42.236394657 +0000 UTC m=+10.216665666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-62hxg" (UniqueName: "kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg") pod "network-check-target-z8rjv" (UID: "f884e8e6-8f28-4be9-8382-0b4bd337c75e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:38.464100 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:38.464022 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:38.464564 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.464150 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:38.464564 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:38.464516 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:38.464671 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:38.464613 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:39.463730 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:39.463691 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:39.463996 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:39.463830 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:40.464324 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:40.464278 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:40.464800 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:40.464295 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:40.464800 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:40.464429 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:40.464800 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:40.464519 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:41.463445 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:41.463404 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:41.463622 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:41.463546 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:42.068376 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:42.068338 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:42.069011 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.068508 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:42.069011 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.068584 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs podName:c4c78959-04e2-4a31-a546-d13235ebbe5f nodeName:}" failed. No retries permitted until 2026-06-08 19:26:50.068560724 +0000 UTC m=+18.048831724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs") pod "network-metrics-daemon-bpp7k" (UID: "c4c78959-04e2-4a31-a546-d13235ebbe5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:42.169729 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:42.169687 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:42.169918 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.169818 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:42.169918 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.169878 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret podName:747ed8f3-e7b3-49a0-9fe6-968e42212258 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:50.169860608 +0000 UTC m=+18.150131614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret") pod "global-pull-secret-syncer-ctdmm" (UID: "747ed8f3-e7b3-49a0-9fe6-968e42212258") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:42.270528 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:42.270177 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:42.270528 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.270412 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:42.270528 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.270438 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:42.270528 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.270452 2549 projected.go:196] Error preparing data for projected volume kube-api-access-62hxg for pod openshift-network-diagnostics/network-check-target-z8rjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:42.270528 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.270518 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg podName:f884e8e6-8f28-4be9-8382-0b4bd337c75e nodeName:}" failed. No retries permitted until 2026-06-08 19:26:50.270498338 +0000 UTC m=+18.250769330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-62hxg" (UniqueName: "kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg") pod "network-check-target-z8rjv" (UID: "f884e8e6-8f28-4be9-8382-0b4bd337c75e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:42.464969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:42.464381 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:42.464969 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.464535 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:42.464969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:42.464571 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:42.464969 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:42.464646 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:43.464150 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:43.464089 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:43.464596 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:43.464222 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:44.464101 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:44.464065 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:44.464288 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:44.464072 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:44.464288 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:44.464210 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:44.464288 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:44.464260 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:45.464465 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:45.464380 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:45.464938 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:45.464513 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:46.463774 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:46.463746 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:46.463981 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:46.463747 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:46.463981 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:46.463885 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:46.464109 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:46.463984 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:47.464501 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:47.464301 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:47.464932 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:47.464610 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:48.464110 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:48.464079 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:48.464304 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:48.464215 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:48.464304 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:48.464271 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:48.464407 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:48.464372 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:49.464213 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:49.464182 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:49.464633 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:49.464298 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:50.128418 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:50.128381 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:50.128596 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.128548 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:50.128647 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.128620 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs podName:c4c78959-04e2-4a31-a546-d13235ebbe5f nodeName:}" failed. No retries permitted until 2026-06-08 19:27:06.128600916 +0000 UTC m=+34.108871928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs") pod "network-metrics-daemon-bpp7k" (UID: "c4c78959-04e2-4a31-a546-d13235ebbe5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:50.229376 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:50.229346 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:50.229555 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.229462 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:50.229555 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.229524 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret podName:747ed8f3-e7b3-49a0-9fe6-968e42212258 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:06.229504215 +0000 UTC m=+34.209775203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret") pod "global-pull-secret-syncer-ctdmm" (UID: "747ed8f3-e7b3-49a0-9fe6-968e42212258") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:50.330183 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:50.330146 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:50.330355 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.330294 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:50.330355 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.330320 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:50.330355 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.330333 2549 projected.go:196] Error preparing data for projected volume kube-api-access-62hxg for pod openshift-network-diagnostics/network-check-target-z8rjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:50.330494 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.330393 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg podName:f884e8e6-8f28-4be9-8382-0b4bd337c75e nodeName:}" failed. No retries permitted until 2026-06-08 19:27:06.330374596 +0000 UTC m=+34.310645609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-62hxg" (UniqueName: "kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg") pod "network-check-target-z8rjv" (UID: "f884e8e6-8f28-4be9-8382-0b4bd337c75e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:50.463987 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:50.463867 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:50.463987 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:50.463940 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:50.464184 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.464031 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:50.464184 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:50.464150 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:51.464080 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:51.464044 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:51.464271 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:51.464171 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:52.465278 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:52.465240 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:52.465718 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:52.465296 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:52.465718 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:52.465383 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:52.465718 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:52.465470 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:53.464020 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:53.463992 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:53.464137 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:53.464089 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:54.469942 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.469645 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:54.470521 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.469690 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:54.470521 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:54.470024 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:54.470521 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:54.470152 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:54.563968 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.563920 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cktnw" event={"ID":"4df82b22-3f2a-462b-aa9a-2ec20a55f82a","Type":"ContainerStarted","Data":"4f1de8040a5af4a22447e0a474e20b9f8562e7ffefee180aa380eefac592365b"} Jun 08 19:26:54.565673 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.565645 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z6w5h" event={"ID":"2d2138ec-7f43-4c39-b7a4-d86ce3d8fb19","Type":"ContainerStarted","Data":"0bff2b110b1476c864dba616ecd0b3e6aeb6f832ac376869df11d0cbf0a0e1dc"} Jun 08 19:26:54.567278 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.567253 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kzvj8" event={"ID":"87128f8d-6e20-4850-80f5-cbdec1a08016","Type":"ContainerStarted","Data":"2ca8b5fbba4a33ea3ae986275f0760ceedc9d5d9c24c8bd7365ad0286465eaec"} Jun 08 19:26:54.570403 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.570383 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:26:54.570771 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.570747 2549 generic.go:356] "Generic (PLEG): container finished" podID="77cb9a8d-ed29-4cda-a410-90e077ebf77b" containerID="205175ca298ef790b6fc452c46ae81c828efce91987ad4bc01cc2e2145b9d134" exitCode=1 Jun 08 19:26:54.570849 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.570829 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerStarted","Data":"177c9886a99115ba9b0d8952364ddf73a9cee3471e936fabe8defc0abb8706e1"} Jun 08 19:26:54.570943 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.570926 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerStarted","Data":"d6ac16486f17013bb7807efe47ee6d796ca59fa47e5c1be748d375eef2e1b62a"} Jun 08 19:26:54.571006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.570984 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerStarted","Data":"40392ab2953a5b6170f337c5a5573fa787326ef41cb23564a6253548d4d0d289"} Jun 08 19:26:54.571058 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.571032 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerStarted","Data":"29c13b674ea813acf53dd166044e1647a35879fe449f133ccaf917a002f3cf86"} Jun 08 19:26:54.571105 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.571078 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerDied","Data":"205175ca298ef790b6fc452c46ae81c828efce91987ad4bc01cc2e2145b9d134"} Jun 08 19:26:54.571141 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.571127 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerStarted","Data":"475bac839f4510fb3379860b63d91cc52f80a9b74e7ce17fa223f4760c2d36b4"} Jun 08 19:26:54.572549 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.572526 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" event={"ID":"021ccab2-b7bb-4b24-8eef-76c64e87c0da","Type":"ContainerStarted","Data":"62dd29c3183e1ee759e56ffa256f3c014a15be2cb2c4e671d67737012cf0a5cf"} Jun 08 19:26:54.574040 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.574011 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" event={"ID":"1d69fe10-75a1-4fb0-8cff-b0b81386e6ab","Type":"ContainerStarted","Data":"4a58d1c449903134013e5c9b8b4596d7e97b6028d2fc17df1f36c0c698e85e7f"} Jun 08 19:26:54.575580 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.575557 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tr58h" event={"ID":"3d8ad786-aa67-4968-8ce2-d1273c7abc86","Type":"ContainerStarted","Data":"b6099f42d93677591e92b4d9549c4b6f45250ae05a6d3badff7457e20fc73c4e"} Jun 08 19:26:54.577158 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.577135 2549 generic.go:356] "Generic (PLEG): container finished" podID="6aabdd53-088d-4eed-a7f1-27e032fff897" containerID="0a2c86923a1233e2982210d6c8b62c73ad2407f734c78b7a7026c2f3e2af5353" exitCode=0 Jun 08 19:26:54.577233 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.577172 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" event={"ID":"6aabdd53-088d-4eed-a7f1-27e032fff897","Type":"ContainerDied","Data":"0a2c86923a1233e2982210d6c8b62c73ad2407f734c78b7a7026c2f3e2af5353"} Jun 08 19:26:54.588684 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.588635 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cktnw" podStartSLOduration=4.239806772 podStartE2EDuration="22.588620574s" totalImagesPullingTime="18.348813802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:54.587679098 +0000 UTC m=+22.567950113" watchObservedRunningTime="2026-06-08 19:26:54.588620574 +0000 UTC m=+22.568891584" Jun 08 19:26:54.588793 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.588719 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" podStartSLOduration=21.588712986 podStartE2EDuration="21.588712986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:37.545436727 +0000 UTC m=+5.525707741" watchObservedRunningTime="2026-06-08 19:26:54.588712986 +0000 UTC m=+22.568983998" Jun 08 19:26:54.631369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.631322 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jrdzn" podStartSLOduration=4.27551047 podStartE2EDuration="22.631300563s" totalImagesPullingTime="18.355790093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:54.611009673 +0000 UTC m=+22.591280684" watchObservedRunningTime="2026-06-08 19:26:54.631300563 +0000 UTC m=+22.611571574" Jun 08 19:26:54.654334 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.654280 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tr58h" podStartSLOduration=8.888530483 podStartE2EDuration="22.654265012s" totalImagesPullingTime="13.765734529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:54.653991405 +0000 UTC m=+22.634262487" watchObservedRunningTime="2026-06-08 19:26:54.654265012 +0000 UTC m=+22.634536050" Jun 08 19:26:54.654488 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.654449 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kzvj8" podStartSLOduration=8.889967745 podStartE2EDuration="22.654442793s" totalImagesPullingTime="13.764475048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:54.631101189 +0000 UTC m=+22.611372200" watchObservedRunningTime="2026-06-08 19:26:54.654442793 +0000 UTC m=+22.634713803" Jun 08 19:26:54.682514 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.682472 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z6w5h" podStartSLOduration=4.305634278 podStartE2EDuration="22.682457549s" totalImagesPullingTime="18.376823271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:54.681918647 +0000 UTC m=+22.662189650" watchObservedRunningTime="2026-06-08 19:26:54.682457549 +0000 UTC m=+22.662728560" Jun 08 19:26:54.797197 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:54.797176 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 19:26:55.463415 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:55.463332 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:55.463565 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:55.463431 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:55.465569 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:55.465466 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T19:26:54.797192872Z","UUID":"0970b1f0-b5ab-4064-8851-52b30e60dc5a","Handler":null,"Name":"","Endpoint":""} Jun 08 19:26:55.468279 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:55.468260 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 19:26:55.468375 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:55.468298 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 19:26:55.581549 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:55.581396 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jhrl8" event={"ID":"f39fd033-4c18-4402-89ff-a3eaa0d6738a","Type":"ContainerStarted","Data":"aedb917168bad79b8abef8aa984254dd8e6f27fd2bb27f6f33dd889b9ec130fd"} Jun 08 19:26:55.583646 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:55.583611 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" event={"ID":"021ccab2-b7bb-4b24-8eef-76c64e87c0da","Type":"ContainerStarted","Data":"f78c7d9b91135126f12eb177abe8db2ba63ad4d6e349f682309f8a846817e4a0"} Jun 08 19:26:55.599606 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:55.599554 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jhrl8" podStartSLOduration=5.296341593 podStartE2EDuration="23.59953186s" totalImagesPullingTime="18.303190267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:55.599486216 +0000 UTC m=+23.579757228" watchObservedRunningTime="2026-06-08 19:26:55.59953186 +0000 UTC m=+23.579802875" Jun 08 19:26:55.855422 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:55.855390 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:55.856028 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:55.856004 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:56.464256 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:56.464225 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:56.464256 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:56.464251 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:56.464483 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:56.464359 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:56.464483 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:56.464462 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:56.589088 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:56.589053 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:26:56.589564 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:56.589536 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerStarted","Data":"d69942ec303a1441b0342e8191db4fe0a6267f85be567134fcb66a0c151740a4"} Jun 08 19:26:56.591923 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:56.591882 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" event={"ID":"021ccab2-b7bb-4b24-8eef-76c64e87c0da","Type":"ContainerStarted","Data":"7fab1721300dd3be29076b862542338afc8b229b8e66778282e83a6736829c79"} Jun 08 19:26:56.592286 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:56.592263 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:56.592777 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:56.592759 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tr58h" Jun 08 19:26:56.615506 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:56.615414 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctmj4" podStartSLOduration=4.615924392 podStartE2EDuration="24.615399043s" totalImagesPullingTime="19.999474651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:56.615214988 +0000 UTC m=+24.595486000" watchObservedRunningTime="2026-06-08 19:26:56.615399043 +0000 UTC m=+24.595670053" Jun 08 19:26:57.463874 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:57.463837 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:57.464066 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:57.463967 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:58.464019 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:58.463997 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:26:58.464397 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:58.464138 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:26:58.464397 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:58.464175 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:26:58.464397 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:58.464271 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:26:58.602323 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:58.602292 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:26:58.602778 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:58.602745 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerStarted","Data":"e934160bc312e6b2d9cbccd0ab2ffeefa331790a0c2b2b6e752755bebad6afde"} Jun 08 19:26:58.603144 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:58.603126 2549 scope.go:117] "RemoveContainer" containerID="205175ca298ef790b6fc452c46ae81c828efce91987ad4bc01cc2e2145b9d134" Jun 08 19:26:59.463832 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.463662 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:26:59.463986 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:26:59.463930 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:26:59.606557 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.606515 2549 generic.go:356] "Generic (PLEG): container finished" podID="6aabdd53-088d-4eed-a7f1-27e032fff897" containerID="75bb8146267d0d65155328e09ade0d732202a41b2128b5a870c71c80a2e6b673" exitCode=0 Jun 08 19:26:59.607022 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.606598 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" event={"ID":"6aabdd53-088d-4eed-a7f1-27e032fff897","Type":"ContainerDied","Data":"75bb8146267d0d65155328e09ade0d732202a41b2128b5a870c71c80a2e6b673"} Jun 08 19:26:59.610410 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.610319 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:26:59.610685 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.610664 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" event={"ID":"77cb9a8d-ed29-4cda-a410-90e077ebf77b","Type":"ContainerStarted","Data":"df0dd43537f6e93ef90e5b2625d935979c612be12dc4bd591a06b99f130fcedb"} Jun 08 19:26:59.610893 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.610872 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:59.610999 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.610954 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:59.611083 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.611005 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:59.626191 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.626168 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:59.626323 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.626264 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:26:59.678305 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:26:59.678255 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" podStartSLOduration=9.257505358 podStartE2EDuration="27.678239516s" totalImagesPullingTime="18.420734158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:59.675388118 +0000 UTC m=+27.655659130" watchObservedRunningTime="2026-06-08 19:26:59.678239516 +0000 UTC m=+27.658510549" Jun 08 19:27:00.464044 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:00.464016 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:27:00.464044 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:00.464031 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:27:00.464272 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:00.464145 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:27:00.464337 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:00.464288 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:27:01.058464 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:01.058424 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ctdmm"] Jun 08 19:27:01.059148 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:01.058541 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:27:01.059148 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:01.058625 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:27:01.061304 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:01.061276 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8rjv"] Jun 08 19:27:01.061446 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:01.061393 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:27:01.061680 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:01.061490 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:27:01.062031 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:01.062009 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bpp7k"] Jun 08 19:27:01.062146 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:01.062103 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:27:01.062207 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:01.062184 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:27:01.617451 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:01.617418 2549 generic.go:356] "Generic (PLEG): container finished" podID="6aabdd53-088d-4eed-a7f1-27e032fff897" containerID="4bae4ee8eb8b8cdfb63c7a3e84c200491e49a636a75fc2226f942e6cb238bb19" exitCode=0 Jun 08 19:27:01.617652 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:01.617511 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" event={"ID":"6aabdd53-088d-4eed-a7f1-27e032fff897","Type":"ContainerDied","Data":"4bae4ee8eb8b8cdfb63c7a3e84c200491e49a636a75fc2226f942e6cb238bb19"} Jun 08 19:27:02.464635 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:02.464602 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:27:02.465098 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:02.464731 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:27:02.466552 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:02.466530 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:27:02.466684 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:02.466624 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:27:02.466731 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:02.466666 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:27:02.466731 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:02.466712 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:27:03.625129 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:03.624939 2549 generic.go:356] "Generic (PLEG): container finished" podID="6aabdd53-088d-4eed-a7f1-27e032fff897" containerID="eaff753c27db16efda6b6518c71c34a9602507331a29a12b7bb456762f3433ad" exitCode=0 Jun 08 19:27:03.625129 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:03.625027 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" event={"ID":"6aabdd53-088d-4eed-a7f1-27e032fff897","Type":"ContainerDied","Data":"eaff753c27db16efda6b6518c71c34a9602507331a29a12b7bb456762f3433ad"} Jun 08 19:27:04.464387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:04.464358 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:27:04.464571 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:04.464359 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:27:04.464571 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:04.464487 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ctdmm" podUID="747ed8f3-e7b3-49a0-9fe6-968e42212258" Jun 08 19:27:04.464571 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:04.464527 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:27:04.464726 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:04.464628 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8rjv" podUID="f884e8e6-8f28-4be9-8382-0b4bd337c75e" Jun 08 19:27:04.464776 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:04.464721 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:27:06.150197 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.150169 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:27:06.150661 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.150315 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:27:06.150661 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.150375 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs podName:c4c78959-04e2-4a31-a546-d13235ebbe5f nodeName:}" failed. No retries permitted until 2026-06-08 19:27:38.15035976 +0000 UTC m=+66.130630754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs") pod "network-metrics-daemon-bpp7k" (UID: "c4c78959-04e2-4a31-a546-d13235ebbe5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:27:06.251166 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.251132 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:27:06.251363 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.251256 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:27:06.251363 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.251316 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret podName:747ed8f3-e7b3-49a0-9fe6-968e42212258 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:38.251302994 +0000 UTC m=+66.231573983 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret") pod "global-pull-secret-syncer-ctdmm" (UID: "747ed8f3-e7b3-49a0-9fe6-968e42212258") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:27:06.335176 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.335142 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeReady" Jun 08 19:27:06.335347 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.335316 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 19:27:06.351471 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.351421 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:27:06.351653 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.351609 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:27:06.351653 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.351634 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:27:06.351653 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.351646 2549 projected.go:196] Error preparing data for projected volume kube-api-access-62hxg for pod openshift-network-diagnostics/network-check-target-z8rjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:27:06.351810 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.351708 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg podName:f884e8e6-8f28-4be9-8382-0b4bd337c75e nodeName:}" failed. No retries permitted until 2026-06-08 19:27:38.351688276 +0000 UTC m=+66.331959277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-62hxg" (UniqueName: "kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg") pod "network-check-target-z8rjv" (UID: "f884e8e6-8f28-4be9-8382-0b4bd337c75e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:27:06.384120 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.384089 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8lzsn"] Jun 08 19:27:06.401686 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.401604 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4vt28"] Jun 08 19:27:06.401834 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.401742 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.405823 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.405792 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 19:27:06.406002 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.405986 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 19:27:06.406689 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.406665 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2qd47\"" Jun 08 19:27:06.427566 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.427540 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8lzsn"] Jun 08 19:27:06.427691 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.427588 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4vt28"] Jun 08 19:27:06.427691 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.427667 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4vt28" Jun 08 19:27:06.430757 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.430736 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 19:27:06.430757 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.430752 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fjjgf\"" Jun 08 19:27:06.431034 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.430738 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 19:27:06.431154 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.431086 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 19:27:06.463937 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.463895 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:27:06.464101 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.463923 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:27:06.464101 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.464057 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:27:06.467603 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.467532 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:27:06.467603 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.467552 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9vt4h\"" Jun 08 19:27:06.467603 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.467579 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b4x6n\"" Jun 08 19:27:06.467857 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.467541 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 19:27:06.467857 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.467700 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:27:06.467857 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.467764 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 19:27:06.553081 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.553043 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a9c2142-6d73-414a-bdf6-9b4662669244-config-volume\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.553264 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.553095 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.553264 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.553161 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh2b7\" (UniqueName: \"kubernetes.io/projected/1a9c2142-6d73-414a-bdf6-9b4662669244-kube-api-access-qh2b7\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.553264 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.553198 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86xv4\" (UniqueName: \"kubernetes.io/projected/a36c67fc-408f-4321-8607-988163a9b912-kube-api-access-86xv4\") pod \"ingress-canary-4vt28\" (UID: \"a36c67fc-408f-4321-8607-988163a9b912\") " pod="openshift-ingress-canary/ingress-canary-4vt28" Jun 08 19:27:06.553391 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.553317 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a36c67fc-408f-4321-8607-988163a9b912-cert\") pod \"ingress-canary-4vt28\" (UID: \"a36c67fc-408f-4321-8607-988163a9b912\") " pod="openshift-ingress-canary/ingress-canary-4vt28" Jun 08 19:27:06.553391 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.553365 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a9c2142-6d73-414a-bdf6-9b4662669244-tmp-dir\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.654105 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.654023 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.654105 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.654076 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh2b7\" (UniqueName: \"kubernetes.io/projected/1a9c2142-6d73-414a-bdf6-9b4662669244-kube-api-access-qh2b7\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.654105 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.654099 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86xv4\" (UniqueName: \"kubernetes.io/projected/a36c67fc-408f-4321-8607-988163a9b912-kube-api-access-86xv4\") pod \"ingress-canary-4vt28\" (UID: \"a36c67fc-408f-4321-8607-988163a9b912\") " pod="openshift-ingress-canary/ingress-canary-4vt28" Jun 08 19:27:06.654376 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.654156 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a36c67fc-408f-4321-8607-988163a9b912-cert\") pod \"ingress-canary-4vt28\" (UID: \"a36c67fc-408f-4321-8607-988163a9b912\") " pod="openshift-ingress-canary/ingress-canary-4vt28" Jun 08 19:27:06.654376 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.654189 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a9c2142-6d73-414a-bdf6-9b4662669244-tmp-dir\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.654376 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.654197 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:06.654376 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.654219 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a9c2142-6d73-414a-bdf6-9b4662669244-config-volume\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.654376 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:06.654257 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls podName:1a9c2142-6d73-414a-bdf6-9b4662669244 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:07.154238024 +0000 UTC m=+35.134509017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls") pod "dns-default-8lzsn" (UID: "1a9c2142-6d73-414a-bdf6-9b4662669244") : secret "dns-default-metrics-tls" not found Jun 08 19:27:06.654813 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.654785 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a9c2142-6d73-414a-bdf6-9b4662669244-config-volume\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.654943 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.654876 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a9c2142-6d73-414a-bdf6-9b4662669244-tmp-dir\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.659226 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.659206 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a36c67fc-408f-4321-8607-988163a9b912-cert\") pod \"ingress-canary-4vt28\" (UID: \"a36c67fc-408f-4321-8607-988163a9b912\") " pod="openshift-ingress-canary/ingress-canary-4vt28" Jun 08 19:27:06.666135 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.666115 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh2b7\" (UniqueName: \"kubernetes.io/projected/1a9c2142-6d73-414a-bdf6-9b4662669244-kube-api-access-qh2b7\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:06.666231 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.666208 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86xv4\" (UniqueName: \"kubernetes.io/projected/a36c67fc-408f-4321-8607-988163a9b912-kube-api-access-86xv4\") pod \"ingress-canary-4vt28\" (UID: \"a36c67fc-408f-4321-8607-988163a9b912\") " pod="openshift-ingress-canary/ingress-canary-4vt28" Jun 08 19:27:06.737351 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:06.737307 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4vt28" Jun 08 19:27:07.157128 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:07.157093 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:07.157585 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:07.157272 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:07.157585 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:07.157349 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls podName:1a9c2142-6d73-414a-bdf6-9b4662669244 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:08.15732801 +0000 UTC m=+36.137599003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls") pod "dns-default-8lzsn" (UID: "1a9c2142-6d73-414a-bdf6-9b4662669244") : secret "dns-default-metrics-tls" not found Jun 08 19:27:07.868560 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:07.868373 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4vt28"] Jun 08 19:27:07.871767 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:27:07.871732 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36c67fc_408f_4321_8607_988163a9b912.slice/crio-ba2423ca595537aa4fd0bfe598274d65feccc840905b7b6398743fa26836d790 WatchSource:0}: Error finding container ba2423ca595537aa4fd0bfe598274d65feccc840905b7b6398743fa26836d790: Status 404 returned error can't find the container with id ba2423ca595537aa4fd0bfe598274d65feccc840905b7b6398743fa26836d790 Jun 08 19:27:08.165083 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:08.165053 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:08.165388 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:08.165204 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:08.165388 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:08.165267 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls podName:1a9c2142-6d73-414a-bdf6-9b4662669244 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:10.165250288 +0000 UTC m=+38.145521278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls") pod "dns-default-8lzsn" (UID: "1a9c2142-6d73-414a-bdf6-9b4662669244") : secret "dns-default-metrics-tls" not found Jun 08 19:27:08.637894 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:08.637857 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4vt28" event={"ID":"a36c67fc-408f-4321-8607-988163a9b912","Type":"ContainerStarted","Data":"ba2423ca595537aa4fd0bfe598274d65feccc840905b7b6398743fa26836d790"} Jun 08 19:27:08.641108 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:08.641044 2549 generic.go:356] "Generic (PLEG): container finished" podID="6aabdd53-088d-4eed-a7f1-27e032fff897" containerID="6b97a8a93d844765ae8ed15ca44131081bb78121d17b8285040d7d51e9667576" exitCode=0 Jun 08 19:27:08.641108 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:08.641097 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" event={"ID":"6aabdd53-088d-4eed-a7f1-27e032fff897","Type":"ContainerDied","Data":"6b97a8a93d844765ae8ed15ca44131081bb78121d17b8285040d7d51e9667576"} Jun 08 19:27:09.647893 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:09.647817 2549 generic.go:356] "Generic (PLEG): container finished" podID="6aabdd53-088d-4eed-a7f1-27e032fff897" containerID="c76cd7ccde7d90d423a0d9fec349152386db7a854836a3c91ab3a1f43378a083" exitCode=0 Jun 08 19:27:09.647893 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:09.647865 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" event={"ID":"6aabdd53-088d-4eed-a7f1-27e032fff897","Type":"ContainerDied","Data":"c76cd7ccde7d90d423a0d9fec349152386db7a854836a3c91ab3a1f43378a083"} Jun 08 19:27:10.179860 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:10.179787 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:10.180005 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:10.179952 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:10.180066 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:10.180013 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls podName:1a9c2142-6d73-414a-bdf6-9b4662669244 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:14.179998799 +0000 UTC m=+42.160269789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls") pod "dns-default-8lzsn" (UID: "1a9c2142-6d73-414a-bdf6-9b4662669244") : secret "dns-default-metrics-tls" not found Jun 08 19:27:10.654428 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:10.654390 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" event={"ID":"6aabdd53-088d-4eed-a7f1-27e032fff897","Type":"ContainerStarted","Data":"b876328c45973bb00a11a7016c078c86e1955108aefe02a6bf4192a801b70824"} Jun 08 19:27:10.655778 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:10.655746 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4vt28" event={"ID":"a36c67fc-408f-4321-8607-988163a9b912","Type":"ContainerStarted","Data":"7f62bc2655feebaf83eaad79f0969aa93c36305dd8dd804ab0861e05d7c7ffc9"} Jun 08 19:27:10.682971 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:10.682896 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kxpbn" podStartSLOduration=9.859833073 podStartE2EDuration="38.682877734s" totalImagesPullingTime="28.823044661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:27:10.68221123 +0000 UTC m=+38.662482242" watchObservedRunningTime="2026-06-08 19:27:10.682877734 +0000 UTC m=+38.663148746" Jun 08 19:27:10.699831 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:10.699775 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4vt28" podStartSLOduration=2.447552566 podStartE2EDuration="4.699757479s" totalImagesPullingTime="2.252204913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:27:10.699013219 +0000 UTC m=+38.679284243" watchObservedRunningTime="2026-06-08 19:27:10.699757479 +0000 UTC m=+38.680028492" Jun 08 19:27:14.206306 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:14.206119 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:14.206731 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:14.206273 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:14.206731 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:14.206394 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls podName:1a9c2142-6d73-414a-bdf6-9b4662669244 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:22.206378653 +0000 UTC m=+50.186649641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls") pod "dns-default-8lzsn" (UID: "1a9c2142-6d73-414a-bdf6-9b4662669244") : secret "dns-default-metrics-tls" not found Jun 08 19:27:22.263182 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:22.263142 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:22.263587 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:22.263275 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:22.263587 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:22.263342 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls podName:1a9c2142-6d73-414a-bdf6-9b4662669244 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:38.263327093 +0000 UTC m=+66.243598083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls") pod "dns-default-8lzsn" (UID: "1a9c2142-6d73-414a-bdf6-9b4662669244") : secret "dns-default-metrics-tls" not found Jun 08 19:27:31.628338 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:31.628311 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69rrr" Jun 08 19:27:38.180274 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.180218 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:27:38.185196 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.185175 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:27:38.190718 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:38.190698 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:27:38.190843 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:38.190773 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs podName:c4c78959-04e2-4a31-a546-d13235ebbe5f nodeName:}" failed. No retries permitted until 2026-06-08 19:28:42.190750416 +0000 UTC m=+130.171021410 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs") pod "network-metrics-daemon-bpp7k" (UID: "c4c78959-04e2-4a31-a546-d13235ebbe5f") : secret "metrics-daemon-secret" not found Jun 08 19:27:38.281299 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.281256 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:27:38.281455 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.281321 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:27:38.281455 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:38.281420 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:38.281542 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:27:38.281503 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls podName:1a9c2142-6d73-414a-bdf6-9b4662669244 nodeName:}" failed. No retries permitted until 2026-06-08 19:28:10.281483897 +0000 UTC m=+98.261754897 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls") pod "dns-default-8lzsn" (UID: "1a9c2142-6d73-414a-bdf6-9b4662669244") : secret "dns-default-metrics-tls" not found Jun 08 19:27:38.286106 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.286080 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:27:38.295119 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.295089 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/747ed8f3-e7b3-49a0-9fe6-968e42212258-original-pull-secret\") pod \"global-pull-secret-syncer-ctdmm\" (UID: \"747ed8f3-e7b3-49a0-9fe6-968e42212258\") " pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:27:38.381789 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.381741 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:27:38.384574 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.384552 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 19:27:38.394651 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.394624 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 19:27:38.405297 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.405274 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62hxg\" (UniqueName: \"kubernetes.io/projected/f884e8e6-8f28-4be9-8382-0b4bd337c75e-kube-api-access-62hxg\") pod \"network-check-target-z8rjv\" (UID: \"f884e8e6-8f28-4be9-8382-0b4bd337c75e\") " pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:27:38.579415 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.579383 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9vt4h\"" Jun 08 19:27:38.586943 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.586891 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:27:38.588062 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.588043 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ctdmm" Jun 08 19:27:38.729502 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.729325 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8rjv"] Jun 08 19:27:38.732137 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:27:38.732110 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf884e8e6_8f28_4be9_8382_0b4bd337c75e.slice/crio-bdc04e9ddcf28c30ba027eca3266920773674e748c924dc0866bd40676501410 WatchSource:0}: Error finding container bdc04e9ddcf28c30ba027eca3266920773674e748c924dc0866bd40676501410: Status 404 returned error can't find the container with id bdc04e9ddcf28c30ba027eca3266920773674e748c924dc0866bd40676501410 Jun 08 19:27:38.751577 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:38.751479 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ctdmm"] Jun 08 19:27:38.754036 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:27:38.754005 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747ed8f3_e7b3_49a0_9fe6_968e42212258.slice/crio-764898569d6ab9dfa29595d8d43940bd1fae14069feeedbc21a80e448d40e646 WatchSource:0}: Error finding container 764898569d6ab9dfa29595d8d43940bd1fae14069feeedbc21a80e448d40e646: Status 404 returned error can't find the container with id 764898569d6ab9dfa29595d8d43940bd1fae14069feeedbc21a80e448d40e646 Jun 08 19:27:39.730122 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:39.730082 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ctdmm" event={"ID":"747ed8f3-e7b3-49a0-9fe6-968e42212258","Type":"ContainerStarted","Data":"764898569d6ab9dfa29595d8d43940bd1fae14069feeedbc21a80e448d40e646"} Jun 08 19:27:39.731674 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:39.731648 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8rjv" event={"ID":"f884e8e6-8f28-4be9-8382-0b4bd337c75e","Type":"ContainerStarted","Data":"bdc04e9ddcf28c30ba027eca3266920773674e748c924dc0866bd40676501410"} Jun 08 19:27:42.742063 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:42.742020 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8rjv" event={"ID":"f884e8e6-8f28-4be9-8382-0b4bd337c75e","Type":"ContainerStarted","Data":"69c72be3224325c4df565d25318966e42d28d54d81fb55374c3d5c78dffb1e46"} Jun 08 19:27:42.742525 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:42.742172 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:27:42.761952 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:42.761839 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z8rjv" podStartSLOduration=67.757545914 podStartE2EDuration="1m10.761816797s" totalImagesPullingTime="3.004270883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:27:42.760505568 +0000 UTC m=+70.740776591" watchObservedRunningTime="2026-06-08 19:27:42.761816797 +0000 UTC m=+70.742087809" Jun 08 19:27:43.745787 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:27:43.745689 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ctdmm" event={"ID":"747ed8f3-e7b3-49a0-9fe6-968e42212258","Type":"ContainerStarted","Data":"3199cbba3248f0a5a100709d99802956ff734701dc69c1c92003a9f0de4ef36c"} Jun 08 19:28:10.312969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:28:10.312934 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:28:10.313366 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:28:10.313038 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:28:10.313366 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:28:10.313103 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls podName:1a9c2142-6d73-414a-bdf6-9b4662669244 nodeName:}" failed. No retries permitted until 2026-06-08 19:29:14.31308735 +0000 UTC m=+162.293358339 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls") pod "dns-default-8lzsn" (UID: "1a9c2142-6d73-414a-bdf6-9b4662669244") : secret "dns-default-metrics-tls" not found Jun 08 19:28:13.748254 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:28:13.748221 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z8rjv" Jun 08 19:28:13.765446 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:28:13.765394 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ctdmm" podStartSLOduration=97.058441501 podStartE2EDuration="1m41.765378201s" totalImagesPullingTime="4.7069367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:27:43.762299702 +0000 UTC m=+71.742570715" watchObservedRunningTime="2026-06-08 19:28:13.765378201 +0000 UTC m=+101.745649221" Jun 08 19:28:42.224995 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:28:42.224936 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:28:42.225503 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:28:42.225076 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:28:42.225503 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:28:42.225158 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs podName:c4c78959-04e2-4a31-a546-d13235ebbe5f nodeName:}" failed. No retries permitted until 2026-06-08 19:30:44.225141731 +0000 UTC m=+252.205412720 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs") pod "network-metrics-daemon-bpp7k" (UID: "c4c78959-04e2-4a31-a546-d13235ebbe5f") : secret "metrics-daemon-secret" not found Jun 08 19:29:09.413832 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:09.413773 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8lzsn" podUID="1a9c2142-6d73-414a-bdf6-9b4662669244" Jun 08 19:29:09.482238 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:09.482190 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bpp7k" podUID="c4c78959-04e2-4a31-a546-d13235ebbe5f" Jun 08 19:29:09.951647 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:09.951617 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lzsn" Jun 08 19:29:14.346456 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:14.346367 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:29:14.346977 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:14.346489 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:29:14.346977 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:14.346545 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls podName:1a9c2142-6d73-414a-bdf6-9b4662669244 nodeName:}" failed. No retries permitted until 2026-06-08 19:31:16.346530872 +0000 UTC m=+284.326801861 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls") pod "dns-default-8lzsn" (UID: "1a9c2142-6d73-414a-bdf6-9b4662669244") : secret "dns-default-metrics-tls" not found Jun 08 19:29:21.464170 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:21.464122 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:29:30.361552 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.361514 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7"] Jun 08 19:29:30.365760 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.365724 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-r5pp5"] Jun 08 19:29:30.367094 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.366975 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7" Jun 08 19:29:30.367959 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.367935 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-778c9859b9-4s84q"] Jun 08 19:29:30.368065 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.368046 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.369536 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.369518 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.370973 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.370953 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bthk9\"" Jun 08 19:29:30.371759 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.371740 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dgsgj\"" Jun 08 19:29:30.372082 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.372068 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 19:29:30.372500 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.372483 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 19:29:30.372730 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.372714 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 19:29:30.372993 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.372978 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 19:29:30.377220 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.377201 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 19:29:30.377328 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.377227 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 19:29:30.378274 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.378256 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 19:29:30.378572 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.378553 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsr4d\"" Jun 08 19:29:30.383956 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.383924 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 19:29:30.397389 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.397364 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-r5pp5"] Jun 08 19:29:30.403132 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.403108 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7"] Jun 08 19:29:30.404225 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.404188 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-778c9859b9-4s84q"] Jun 08 19:29:30.404367 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.404295 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 19:29:30.445079 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445045 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24bfa9f9-cb85-40db-add0-37736c0a3d40-tmp\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.445079 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445081 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-certificates\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.445295 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445099 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ffvc\" (UniqueName: \"kubernetes.io/projected/24bfa9f9-cb85-40db-add0-37736c0a3d40-kube-api-access-4ffvc\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.445295 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445145 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.445295 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445210 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-image-registry-private-configuration\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.445295 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445230 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-trusted-ca\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.445295 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445253 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-installation-pull-secrets\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.445295 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445288 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-bound-sa-token\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.445479 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445332 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpq88\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-kube-api-access-vpq88\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.445479 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445361 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bfa9f9-cb85-40db-add0-37736c0a3d40-service-ca-bundle\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.445479 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445380 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24bfa9f9-cb85-40db-add0-37736c0a3d40-serving-cert\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.445479 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445397 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjsg9\" (UniqueName: \"kubernetes.io/projected/5e4a6c7b-6864-4c96-807e-57286fa7ccc9-kube-api-access-wjsg9\") pod \"network-check-source-dbd9cf844-mghx7\" (UID: \"5e4a6c7b-6864-4c96-807e-57286fa7ccc9\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7" Jun 08 19:29:30.445479 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445423 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bfa9f9-cb85-40db-add0-37736c0a3d40-trusted-ca-bundle\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.445479 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445444 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/24bfa9f9-cb85-40db-add0-37736c0a3d40-snapshots\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.445479 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.445463 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f7e9d65-0098-4d7e-ae0f-3e980975412f-ca-trust-extracted\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.485007 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.484971 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-md6b7"] Jun 08 19:29:30.486873 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.486856 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.489892 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.489869 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zhbqg\"" Jun 08 19:29:30.490059 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.489945 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 08 19:29:30.490752 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.490737 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:29:30.491070 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.491050 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 08 19:29:30.491179 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.491080 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 08 19:29:30.495828 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.495809 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 08 19:29:30.498896 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.498877 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-svswr"] Jun 08 19:29:30.500634 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.500618 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:30.502215 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.502196 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf"] Jun 08 19:29:30.504016 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.503946 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 19:29:30.504016 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.504012 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 19:29:30.504181 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.504043 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qcmvm\"" Jun 08 19:29:30.504181 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.504135 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:30.505240 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.505218 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-md6b7"] Jun 08 19:29:30.509133 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.509072 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 19:29:30.509133 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.509118 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:29:30.509293 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.509263 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x5xsf\"" Jun 08 19:29:30.513667 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.512519 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 19:29:30.521939 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.521898 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-svswr"] Jun 08 19:29:30.531428 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.531396 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf"] Jun 08 19:29:30.545769 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545740 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:30.545950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545774 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c1db2c1-91c2-40d0-bd43-039c9ce03232-config\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.545950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545797 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-certificates\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.545950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545824 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.545950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545848 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:30.545950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545875 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-image-registry-private-configuration\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.545950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545898 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-installation-pull-secrets\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.545950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545943 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bfa9f9-cb85-40db-add0-37736c0a3d40-service-ca-bundle\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.546308 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545967 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/953173bb-813a-4daa-a199-d1ec635252bd-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:30.546308 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:30.545977 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:29:30.546308 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.545993 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c1db2c1-91c2-40d0-bd43-039c9ce03232-trusted-ca\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.546308 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:30.545998 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778c9859b9-4s84q: secret "image-registry-tls" not found Jun 08 19:29:30.546308 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546035 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt78p\" (UniqueName: \"kubernetes.io/projected/9c1db2c1-91c2-40d0-bd43-039c9ce03232-kube-api-access-kt78p\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.546308 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:30.546065 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls podName:4f7e9d65-0098-4d7e-ae0f-3e980975412f nodeName:}" failed. No retries permitted until 2026-06-08 19:29:31.04604417 +0000 UTC m=+179.026315159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls") pod "image-registry-778c9859b9-4s84q" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f") : secret "image-registry-tls" not found Jun 08 19:29:30.546308 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546121 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpq88\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-kube-api-access-vpq88\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.546308 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546143 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1db2c1-91c2-40d0-bd43-039c9ce03232-serving-cert\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546404 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjsg9\" (UniqueName: \"kubernetes.io/projected/5e4a6c7b-6864-4c96-807e-57286fa7ccc9-kube-api-access-wjsg9\") pod \"network-check-source-dbd9cf844-mghx7\" (UID: \"5e4a6c7b-6864-4c96-807e-57286fa7ccc9\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546436 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5x7s\" (UniqueName: \"kubernetes.io/projected/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-kube-api-access-z5x7s\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546458 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/24bfa9f9-cb85-40db-add0-37736c0a3d40-snapshots\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546484 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f7e9d65-0098-4d7e-ae0f-3e980975412f-ca-trust-extracted\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546496 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-certificates\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546526 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24bfa9f9-cb85-40db-add0-37736c0a3d40-tmp\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546572 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ffvc\" (UniqueName: \"kubernetes.io/projected/24bfa9f9-cb85-40db-add0-37736c0a3d40-kube-api-access-4ffvc\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546595 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bfa9f9-cb85-40db-add0-37736c0a3d40-service-ca-bundle\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546610 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-trusted-ca\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.546676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546655 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24bfa9f9-cb85-40db-add0-37736c0a3d40-serving-cert\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.547151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546691 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bfa9f9-cb85-40db-add0-37736c0a3d40-trusted-ca-bundle\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.547151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546721 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-bound-sa-token\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.547151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.546828 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f7e9d65-0098-4d7e-ae0f-3e980975412f-ca-trust-extracted\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.547151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.547118 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/24bfa9f9-cb85-40db-add0-37736c0a3d40-snapshots\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.547357 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.547296 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24bfa9f9-cb85-40db-add0-37736c0a3d40-tmp\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.547551 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.547528 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-trusted-ca\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.547842 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.547822 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bfa9f9-cb85-40db-add0-37736c0a3d40-trusted-ca-bundle\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.548680 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.548658 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-installation-pull-secrets\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.548783 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.548698 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-image-registry-private-configuration\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.549013 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.548989 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24bfa9f9-cb85-40db-add0-37736c0a3d40-serving-cert\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.571917 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.571880 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjsg9\" (UniqueName: \"kubernetes.io/projected/5e4a6c7b-6864-4c96-807e-57286fa7ccc9-kube-api-access-wjsg9\") pod \"network-check-source-dbd9cf844-mghx7\" (UID: \"5e4a6c7b-6864-4c96-807e-57286fa7ccc9\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7" Jun 08 19:29:30.572476 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.572456 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-bound-sa-token\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.573745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.573725 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ffvc\" (UniqueName: \"kubernetes.io/projected/24bfa9f9-cb85-40db-add0-37736c0a3d40-kube-api-access-4ffvc\") pod \"insights-operator-896549976-r5pp5\" (UID: \"24bfa9f9-cb85-40db-add0-37736c0a3d40\") " pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.577863 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.577840 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpq88\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-kube-api-access-vpq88\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:30.647813 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.647711 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:30.647813 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.647766 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c1db2c1-91c2-40d0-bd43-039c9ce03232-config\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.647813 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.647809 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:30.648114 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.647853 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/953173bb-813a-4daa-a199-d1ec635252bd-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:30.648114 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:30.647870 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:29:30.648114 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.647879 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c1db2c1-91c2-40d0-bd43-039c9ce03232-trusted-ca\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.648114 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.647924 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt78p\" (UniqueName: \"kubernetes.io/projected/9c1db2c1-91c2-40d0-bd43-039c9ce03232-kube-api-access-kt78p\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.648114 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.647954 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1db2c1-91c2-40d0-bd43-039c9ce03232-serving-cert\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.648114 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:30.647989 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert podName:953173bb-813a-4daa-a199-d1ec635252bd nodeName:}" failed. No retries permitted until 2026-06-08 19:29:31.14797224 +0000 UTC m=+179.128243237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-svswr" (UID: "953173bb-813a-4daa-a199-d1ec635252bd") : secret "networking-console-plugin-cert" not found Jun 08 19:29:30.648114 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:30.648028 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:29:30.648114 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:30.648116 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls podName:062c65ae-d5b1-4d05-9463-3d24a4eaa87a nodeName:}" failed. No retries permitted until 2026-06-08 19:29:31.14809689 +0000 UTC m=+179.128367896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gf6wf" (UID: "062c65ae-d5b1-4d05-9463-3d24a4eaa87a") : secret "samples-operator-tls" not found Jun 08 19:29:30.648571 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.648549 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c1db2c1-91c2-40d0-bd43-039c9ce03232-config\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.648635 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.648615 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5x7s\" (UniqueName: \"kubernetes.io/projected/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-kube-api-access-z5x7s\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:30.648676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.648639 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/953173bb-813a-4daa-a199-d1ec635252bd-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:30.648875 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.648858 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c1db2c1-91c2-40d0-bd43-039c9ce03232-trusted-ca\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.650302 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.650286 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1db2c1-91c2-40d0-bd43-039c9ce03232-serving-cert\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.657410 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.657391 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt78p\" (UniqueName: \"kubernetes.io/projected/9c1db2c1-91c2-40d0-bd43-039c9ce03232-kube-api-access-kt78p\") pod \"console-operator-668fdbf85c-md6b7\" (UID: \"9c1db2c1-91c2-40d0-bd43-039c9ce03232\") " pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.657486 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.657392 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5x7s\" (UniqueName: \"kubernetes.io/projected/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-kube-api-access-z5x7s\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:30.678252 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.678221 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7" Jun 08 19:29:30.686095 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.686072 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-r5pp5" Jun 08 19:29:30.796336 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.796309 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:30.811188 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.811152 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7"] Jun 08 19:29:30.813098 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:29:30.813068 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4a6c7b_6864_4c96_807e_57286fa7ccc9.slice/crio-9a67c58af9e4a983779f6989692ecc8efe73709e2b7901aee2a3be9e504f0842 WatchSource:0}: Error finding container 9a67c58af9e4a983779f6989692ecc8efe73709e2b7901aee2a3be9e504f0842: Status 404 returned error can't find the container with id 9a67c58af9e4a983779f6989692ecc8efe73709e2b7901aee2a3be9e504f0842 Jun 08 19:29:30.835703 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.835650 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-r5pp5"] Jun 08 19:29:30.851333 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:29:30.851298 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24bfa9f9_cb85_40db_add0_37736c0a3d40.slice/crio-5295ee7e7302b35bb2ca9afea9aabcb98f4c698443727f83eac40cfe0c624ba3 WatchSource:0}: Error finding container 5295ee7e7302b35bb2ca9afea9aabcb98f4c698443727f83eac40cfe0c624ba3: Status 404 returned error can't find the container with id 5295ee7e7302b35bb2ca9afea9aabcb98f4c698443727f83eac40cfe0c624ba3 Jun 08 19:29:30.936245 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:30.936217 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-md6b7"] Jun 08 19:29:30.938338 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:29:30.938307 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1db2c1_91c2_40d0_bd43_039c9ce03232.slice/crio-accdb4e054ed2e0a94a67d9221b2a9a3c9bfe7724aedd44d1816032535e5af36 WatchSource:0}: Error finding container accdb4e054ed2e0a94a67d9221b2a9a3c9bfe7724aedd44d1816032535e5af36: Status 404 returned error can't find the container with id accdb4e054ed2e0a94a67d9221b2a9a3c9bfe7724aedd44d1816032535e5af36 Jun 08 19:29:31.002804 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:31.002765 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7" event={"ID":"5e4a6c7b-6864-4c96-807e-57286fa7ccc9","Type":"ContainerStarted","Data":"c3f398db984102d6d2d4b380ed63843573017bf0ef8907f934919d9bb5ff9649"} Jun 08 19:29:31.003003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:31.002825 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7" event={"ID":"5e4a6c7b-6864-4c96-807e-57286fa7ccc9","Type":"ContainerStarted","Data":"9a67c58af9e4a983779f6989692ecc8efe73709e2b7901aee2a3be9e504f0842"} Jun 08 19:29:31.003955 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:31.003930 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" event={"ID":"9c1db2c1-91c2-40d0-bd43-039c9ce03232","Type":"ContainerStarted","Data":"accdb4e054ed2e0a94a67d9221b2a9a3c9bfe7724aedd44d1816032535e5af36"} Jun 08 19:29:31.004966 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:31.004933 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r5pp5" event={"ID":"24bfa9f9-cb85-40db-add0-37736c0a3d40","Type":"ContainerStarted","Data":"5295ee7e7302b35bb2ca9afea9aabcb98f4c698443727f83eac40cfe0c624ba3"} Jun 08 19:29:31.019413 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:31.019356 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mghx7" podStartSLOduration=1.019341803 podStartE2EDuration="1.019341803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:31.018804877 +0000 UTC m=+178.999075889" watchObservedRunningTime="2026-06-08 19:29:31.019341803 +0000 UTC m=+178.999612813" Jun 08 19:29:31.052181 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:31.052146 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:31.052360 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:31.052336 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:29:31.052402 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:31.052364 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778c9859b9-4s84q: secret "image-registry-tls" not found Jun 08 19:29:31.052445 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:31.052428 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls podName:4f7e9d65-0098-4d7e-ae0f-3e980975412f nodeName:}" failed. No retries permitted until 2026-06-08 19:29:32.052408966 +0000 UTC m=+180.032679960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls") pod "image-registry-778c9859b9-4s84q" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f") : secret "image-registry-tls" not found Jun 08 19:29:31.153235 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:31.153197 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:31.153382 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:31.153320 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:31.153382 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:31.153350 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:29:31.153480 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:31.153415 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls podName:062c65ae-d5b1-4d05-9463-3d24a4eaa87a nodeName:}" failed. No retries permitted until 2026-06-08 19:29:32.153397831 +0000 UTC m=+180.133668820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gf6wf" (UID: "062c65ae-d5b1-4d05-9463-3d24a4eaa87a") : secret "samples-operator-tls" not found Jun 08 19:29:31.153480 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:31.153441 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:29:31.153560 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:31.153524 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert podName:953173bb-813a-4daa-a199-d1ec635252bd nodeName:}" failed. No retries permitted until 2026-06-08 19:29:32.153507734 +0000 UTC m=+180.133778729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-svswr" (UID: "953173bb-813a-4daa-a199-d1ec635252bd") : secret "networking-console-plugin-cert" not found Jun 08 19:29:32.060475 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:32.060438 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:32.061029 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:32.060687 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:29:32.061029 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:32.060709 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778c9859b9-4s84q: secret "image-registry-tls" not found Jun 08 19:29:32.061029 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:32.060770 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls podName:4f7e9d65-0098-4d7e-ae0f-3e980975412f nodeName:}" failed. No retries permitted until 2026-06-08 19:29:34.060751356 +0000 UTC m=+182.041022366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls") pod "image-registry-778c9859b9-4s84q" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f") : secret "image-registry-tls" not found Jun 08 19:29:32.160955 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:32.160898 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:32.161133 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:32.160969 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:32.161133 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:32.161056 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:29:32.161133 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:32.161069 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:29:32.161133 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:32.161128 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert podName:953173bb-813a-4daa-a199-d1ec635252bd nodeName:}" failed. No retries permitted until 2026-06-08 19:29:34.161108174 +0000 UTC m=+182.141379163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-svswr" (UID: "953173bb-813a-4daa-a199-d1ec635252bd") : secret "networking-console-plugin-cert" not found Jun 08 19:29:32.161294 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:32.161149 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls podName:062c65ae-d5b1-4d05-9463-3d24a4eaa87a nodeName:}" failed. No retries permitted until 2026-06-08 19:29:34.16113767 +0000 UTC m=+182.141408658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gf6wf" (UID: "062c65ae-d5b1-4d05-9463-3d24a4eaa87a") : secret "samples-operator-tls" not found Jun 08 19:29:34.016463 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:34.016406 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r5pp5" event={"ID":"24bfa9f9-cb85-40db-add0-37736c0a3d40","Type":"ContainerStarted","Data":"adc1ecc6a6faa13ec5d413873ceed5612e1e544ac15de5280df9d0517402a5c8"} Jun 08 19:29:34.017955 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:34.017937 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/0.log" Jun 08 19:29:34.018030 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:34.017970 2549 generic.go:356] "Generic (PLEG): container finished" podID="9c1db2c1-91c2-40d0-bd43-039c9ce03232" containerID="51c5f51d9f8862c27dd36d50cb3043f727744ab4502ce720dad6766a752305d3" exitCode=255 Jun 08 19:29:34.018030 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:34.017998 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" event={"ID":"9c1db2c1-91c2-40d0-bd43-039c9ce03232","Type":"ContainerDied","Data":"51c5f51d9f8862c27dd36d50cb3043f727744ab4502ce720dad6766a752305d3"} Jun 08 19:29:34.018219 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:34.018204 2549 scope.go:117] "RemoveContainer" containerID="51c5f51d9f8862c27dd36d50cb3043f727744ab4502ce720dad6766a752305d3" Jun 08 19:29:34.034027 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:34.033966 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-r5pp5" podStartSLOduration=1.536907137 podStartE2EDuration="4.033946284s" totalImagesPullingTime="2.497039147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:34.032899652 +0000 UTC m=+182.013170664" watchObservedRunningTime="2026-06-08 19:29:34.033946284 +0000 UTC m=+182.014217295" Jun 08 19:29:34.076609 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:34.076579 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:34.076787 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:34.076767 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:29:34.076836 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:34.076792 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778c9859b9-4s84q: secret "image-registry-tls" not found Jun 08 19:29:34.076869 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:34.076849 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls podName:4f7e9d65-0098-4d7e-ae0f-3e980975412f nodeName:}" failed. No retries permitted until 2026-06-08 19:29:38.076829279 +0000 UTC m=+186.057100268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls") pod "image-registry-778c9859b9-4s84q" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f") : secret "image-registry-tls" not found Jun 08 19:29:34.177765 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:34.177728 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:34.177985 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:34.177818 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:34.177985 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:34.177931 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:29:34.177985 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:34.177983 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert podName:953173bb-813a-4daa-a199-d1ec635252bd nodeName:}" failed. No retries permitted until 2026-06-08 19:29:38.177969639 +0000 UTC m=+186.158240628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-svswr" (UID: "953173bb-813a-4daa-a199-d1ec635252bd") : secret "networking-console-plugin-cert" not found Jun 08 19:29:34.178148 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:34.177930 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:29:34.178148 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:34.178075 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls podName:062c65ae-d5b1-4d05-9463-3d24a4eaa87a nodeName:}" failed. No retries permitted until 2026-06-08 19:29:38.178057417 +0000 UTC m=+186.158328419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gf6wf" (UID: "062c65ae-d5b1-4d05-9463-3d24a4eaa87a") : secret "samples-operator-tls" not found Jun 08 19:29:35.023465 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:35.023436 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:29:35.023881 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:35.023839 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/0.log" Jun 08 19:29:35.023881 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:35.023872 2549 generic.go:356] "Generic (PLEG): container finished" podID="9c1db2c1-91c2-40d0-bd43-039c9ce03232" containerID="d1a8bdc57004541eade320ade015d69ae484e482d491ef4fbb94d8b1a2cfc74d" exitCode=255 Jun 08 19:29:35.024018 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:35.023955 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" event={"ID":"9c1db2c1-91c2-40d0-bd43-039c9ce03232","Type":"ContainerDied","Data":"d1a8bdc57004541eade320ade015d69ae484e482d491ef4fbb94d8b1a2cfc74d"} Jun 08 19:29:35.024070 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:35.024022 2549 scope.go:117] "RemoveContainer" containerID="51c5f51d9f8862c27dd36d50cb3043f727744ab4502ce720dad6766a752305d3" Jun 08 19:29:35.024396 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:35.024377 2549 scope.go:117] "RemoveContainer" containerID="d1a8bdc57004541eade320ade015d69ae484e482d491ef4fbb94d8b1a2cfc74d" Jun 08 19:29:35.024586 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:35.024561 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-md6b7_openshift-console-operator(9c1db2c1-91c2-40d0-bd43-039c9ce03232)\"" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" podUID="9c1db2c1-91c2-40d0-bd43-039c9ce03232" Jun 08 19:29:36.028857 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:36.028827 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:29:36.029243 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:36.029174 2549 scope.go:117] "RemoveContainer" containerID="d1a8bdc57004541eade320ade015d69ae484e482d491ef4fbb94d8b1a2cfc74d" Jun 08 19:29:36.029348 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:36.029329 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-md6b7_openshift-console-operator(9c1db2c1-91c2-40d0-bd43-039c9ce03232)\"" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" podUID="9c1db2c1-91c2-40d0-bd43-039c9ce03232" Jun 08 19:29:36.976918 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:36.976889 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cktnw_4df82b22-3f2a-462b-aa9a-2ec20a55f82a/dns-node-resolver/0.log" Jun 08 19:29:38.108889 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:38.108842 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:38.109395 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:38.109036 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:29:38.109395 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:38.109058 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778c9859b9-4s84q: secret "image-registry-tls" not found Jun 08 19:29:38.109395 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:38.109153 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls podName:4f7e9d65-0098-4d7e-ae0f-3e980975412f nodeName:}" failed. No retries permitted until 2026-06-08 19:29:46.10913063 +0000 UTC m=+194.089401633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls") pod "image-registry-778c9859b9-4s84q" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f") : secret "image-registry-tls" not found Jun 08 19:29:38.177663 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:38.177632 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kzvj8_87128f8d-6e20-4850-80f5-cbdec1a08016/node-ca/0.log" Jun 08 19:29:38.210212 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:38.210176 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:38.210375 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:38.210231 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:38.210375 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:38.210363 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:29:38.210466 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:38.210424 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls podName:062c65ae-d5b1-4d05-9463-3d24a4eaa87a nodeName:}" failed. No retries permitted until 2026-06-08 19:29:46.210409441 +0000 UTC m=+194.190680429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gf6wf" (UID: "062c65ae-d5b1-4d05-9463-3d24a4eaa87a") : secret "samples-operator-tls" not found Jun 08 19:29:38.210466 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:38.210364 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:29:38.210577 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:38.210526 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert podName:953173bb-813a-4daa-a199-d1ec635252bd nodeName:}" failed. No retries permitted until 2026-06-08 19:29:46.210506698 +0000 UTC m=+194.190777690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-svswr" (UID: "953173bb-813a-4daa-a199-d1ec635252bd") : secret "networking-console-plugin-cert" not found Jun 08 19:29:38.776792 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:38.776765 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4vt28_a36c67fc-408f-4321-8607-988163a9b912/serve-healthcheck-canary/0.log" Jun 08 19:29:40.796561 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:40.796520 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:40.796975 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:40.796585 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:40.796975 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:40.796932 2549 scope.go:117] "RemoveContainer" containerID="d1a8bdc57004541eade320ade015d69ae484e482d491ef4fbb94d8b1a2cfc74d" Jun 08 19:29:40.797120 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:40.797100 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-md6b7_openshift-console-operator(9c1db2c1-91c2-40d0-bd43-039c9ce03232)\"" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" podUID="9c1db2c1-91c2-40d0-bd43-039c9ce03232" Jun 08 19:29:46.173149 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.173105 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:46.175440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.175419 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") pod \"image-registry-778c9859b9-4s84q\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:46.274315 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.274280 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:29:46.274499 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.274326 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:46.274499 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:46.274447 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:29:46.274618 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:29:46.274546 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert podName:953173bb-813a-4daa-a199-d1ec635252bd nodeName:}" failed. No retries permitted until 2026-06-08 19:30:02.274524795 +0000 UTC m=+210.254795786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-svswr" (UID: "953173bb-813a-4daa-a199-d1ec635252bd") : secret "networking-console-plugin-cert" not found Jun 08 19:29:46.276651 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.276629 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c65ae-d5b1-4d05-9463-3d24a4eaa87a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gf6wf\" (UID: \"062c65ae-d5b1-4d05-9463-3d24a4eaa87a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:46.293207 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.293185 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsr4d\"" Jun 08 19:29:46.301252 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.301236 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:46.421563 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.421539 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x5xsf\"" Jun 08 19:29:46.428025 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.427961 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-778c9859b9-4s84q"] Jun 08 19:29:46.429890 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.429869 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" Jun 08 19:29:46.430658 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:29:46.430635 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f7e9d65_0098_4d7e_ae0f_3e980975412f.slice/crio-3d06d0aa0db9c5f73bb904dc7921c9a38ebbcd3581dcedbbd1f4c8b4c312b9a1 WatchSource:0}: Error finding container 3d06d0aa0db9c5f73bb904dc7921c9a38ebbcd3581dcedbbd1f4c8b4c312b9a1: Status 404 returned error can't find the container with id 3d06d0aa0db9c5f73bb904dc7921c9a38ebbcd3581dcedbbd1f4c8b4c312b9a1 Jun 08 19:29:46.557473 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:46.557442 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf"] Jun 08 19:29:47.062397 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:47.062361 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" event={"ID":"062c65ae-d5b1-4d05-9463-3d24a4eaa87a","Type":"ContainerStarted","Data":"a445a8c0ca03c4b58a4a3c8574d71de88afe2fe3af6838ba5371049573461c31"} Jun 08 19:29:47.063734 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:47.063706 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" event={"ID":"4f7e9d65-0098-4d7e-ae0f-3e980975412f","Type":"ContainerStarted","Data":"90ab116423996b54d52c0085cf116c0bb59d73e34952ac60cc7c96c34865bf44"} Jun 08 19:29:47.063867 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:47.063744 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" event={"ID":"4f7e9d65-0098-4d7e-ae0f-3e980975412f","Type":"ContainerStarted","Data":"3d06d0aa0db9c5f73bb904dc7921c9a38ebbcd3581dcedbbd1f4c8b4c312b9a1"} Jun 08 19:29:47.063867 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:47.063847 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:29:47.088612 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:47.088543 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" podStartSLOduration=17.088528975 podStartE2EDuration="17.088528975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:47.088128215 +0000 UTC m=+195.068399226" watchObservedRunningTime="2026-06-08 19:29:47.088528975 +0000 UTC m=+195.068799985" Jun 08 19:29:49.071254 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:49.071217 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" event={"ID":"062c65ae-d5b1-4d05-9463-3d24a4eaa87a","Type":"ContainerStarted","Data":"2d647c0b8e7a575e2bae61060f3d0b5fa1a8d79ee3a5dac7b25ff5a3b4303e7d"} Jun 08 19:29:49.071643 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:49.071270 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" event={"ID":"062c65ae-d5b1-4d05-9463-3d24a4eaa87a","Type":"ContainerStarted","Data":"5c91804e9577b1f297106243ce55c7207678ee543951115c1b9b4eeaffb2e538"} Jun 08 19:29:49.091461 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:49.091410 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gf6wf" podStartSLOduration=17.286516908 podStartE2EDuration="19.091395616s" totalImagesPullingTime="1.804878708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:49.091112392 +0000 UTC m=+197.071383403" watchObservedRunningTime="2026-06-08 19:29:49.091395616 +0000 UTC m=+197.071666754" Jun 08 19:29:53.464023 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:53.463990 2549 scope.go:117] "RemoveContainer" containerID="d1a8bdc57004541eade320ade015d69ae484e482d491ef4fbb94d8b1a2cfc74d" Jun 08 19:29:54.089330 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:54.089301 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:29:54.089492 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:54.089362 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" event={"ID":"9c1db2c1-91c2-40d0-bd43-039c9ce03232","Type":"ContainerStarted","Data":"c131531c7ae944ac0822265c9f351ca9b844bc786e86021e78006108fa68850c"} Jun 08 19:29:54.089616 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:54.089596 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:54.094340 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:54.094317 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" Jun 08 19:29:54.107825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:54.107774 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-md6b7" podStartSLOduration=21.692761184 podStartE2EDuration="24.107761965s" totalImagesPullingTime="2.415000781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:54.107444381 +0000 UTC m=+202.087715393" watchObservedRunningTime="2026-06-08 19:29:54.107761965 +0000 UTC m=+202.088032954" Jun 08 19:29:57.079129 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.079097 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k9js4"] Jun 08 19:29:57.081242 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.081226 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.084923 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.084889 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 19:29:57.085056 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.084901 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 19:29:57.085056 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.084968 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mfg6k\"" Jun 08 19:29:57.088563 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.088540 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-778c9859b9-4s84q"] Jun 08 19:29:57.105419 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.105392 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-ss4g2"] Jun 08 19:29:57.108096 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.108047 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9js4"] Jun 08 19:29:57.108238 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.108179 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-ss4g2" Jun 08 19:29:57.111292 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.111269 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l4k7j\"" Jun 08 19:29:57.111415 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.111396 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 19:29:57.111734 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.111710 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 19:29:57.124825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.124800 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-ss4g2"] Jun 08 19:29:57.142495 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.142469 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68cd8c5474-fk74v"] Jun 08 19:29:57.144455 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.144436 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.157412 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.157388 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12e78c9f-57c4-4c5e-9724-ee13613f6851-crio-socket\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.157524 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.157438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12e78c9f-57c4-4c5e-9724-ee13613f6851-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.157524 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.157461 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-247gl\" (UniqueName: \"kubernetes.io/projected/12e78c9f-57c4-4c5e-9724-ee13613f6851-kube-api-access-247gl\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.157644 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.157520 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12e78c9f-57c4-4c5e-9724-ee13613f6851-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.157644 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.157611 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2tnt\" (UniqueName: \"kubernetes.io/projected/c940890e-f3e7-4eb2-99ed-851020c74780-kube-api-access-w2tnt\") pod \"downloads-6657875f97-ss4g2\" (UID: \"c940890e-f3e7-4eb2-99ed-851020c74780\") " pod="openshift-console/downloads-6657875f97-ss4g2" Jun 08 19:29:57.157742 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.157641 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12e78c9f-57c4-4c5e-9724-ee13613f6851-data-volume\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.158335 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.158292 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cd8c5474-fk74v"] Jun 08 19:29:57.258185 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258155 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tnt\" (UniqueName: \"kubernetes.io/projected/c940890e-f3e7-4eb2-99ed-851020c74780-kube-api-access-w2tnt\") pod \"downloads-6657875f97-ss4g2\" (UID: \"c940890e-f3e7-4eb2-99ed-851020c74780\") " pod="openshift-console/downloads-6657875f97-ss4g2" Jun 08 19:29:57.258185 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258190 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12e78c9f-57c4-4c5e-9724-ee13613f6851-data-volume\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.258398 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258214 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ced11cd7-0788-45f2-89a3-baba9f5e4110-ca-trust-extracted\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.258398 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258262 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ced11cd7-0788-45f2-89a3-baba9f5e4110-installation-pull-secrets\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.258398 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258304 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12e78c9f-57c4-4c5e-9724-ee13613f6851-crio-socket\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.258398 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258374 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12e78c9f-57c4-4c5e-9724-ee13613f6851-crio-socket\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.258552 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258388 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ced11cd7-0788-45f2-89a3-baba9f5e4110-registry-certificates\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.258552 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258424 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ced11cd7-0788-45f2-89a3-baba9f5e4110-bound-sa-token\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.258552 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258458 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12e78c9f-57c4-4c5e-9724-ee13613f6851-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.258552 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258502 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247gl\" (UniqueName: \"kubernetes.io/projected/12e78c9f-57c4-4c5e-9724-ee13613f6851-kube-api-access-247gl\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.258552 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258529 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ced11cd7-0788-45f2-89a3-baba9f5e4110-image-registry-private-configuration\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.258722 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258558 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ced11cd7-0788-45f2-89a3-baba9f5e4110-trusted-ca\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.258722 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258594 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12e78c9f-57c4-4c5e-9724-ee13613f6851-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.258722 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258618 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12e78c9f-57c4-4c5e-9724-ee13613f6851-data-volume\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.258722 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258653 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ced11cd7-0788-45f2-89a3-baba9f5e4110-registry-tls\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.258722 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.258678 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwcbj\" (UniqueName: \"kubernetes.io/projected/ced11cd7-0788-45f2-89a3-baba9f5e4110-kube-api-access-cwcbj\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.259118 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.259100 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12e78c9f-57c4-4c5e-9724-ee13613f6851-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.260806 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.260785 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12e78c9f-57c4-4c5e-9724-ee13613f6851-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.271526 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.271504 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2tnt\" (UniqueName: \"kubernetes.io/projected/c940890e-f3e7-4eb2-99ed-851020c74780-kube-api-access-w2tnt\") pod \"downloads-6657875f97-ss4g2\" (UID: \"c940890e-f3e7-4eb2-99ed-851020c74780\") " pod="openshift-console/downloads-6657875f97-ss4g2" Jun 08 19:29:57.271633 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.271535 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-247gl\" (UniqueName: \"kubernetes.io/projected/12e78c9f-57c4-4c5e-9724-ee13613f6851-kube-api-access-247gl\") pod \"insights-runtime-extractor-k9js4\" (UID: \"12e78c9f-57c4-4c5e-9724-ee13613f6851\") " pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.359505 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.359427 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ced11cd7-0788-45f2-89a3-baba9f5e4110-image-registry-private-configuration\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.359505 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.359460 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ced11cd7-0788-45f2-89a3-baba9f5e4110-trusted-ca\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.359691 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.359507 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ced11cd7-0788-45f2-89a3-baba9f5e4110-registry-tls\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.359691 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.359608 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwcbj\" (UniqueName: \"kubernetes.io/projected/ced11cd7-0788-45f2-89a3-baba9f5e4110-kube-api-access-cwcbj\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.359691 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.359653 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ced11cd7-0788-45f2-89a3-baba9f5e4110-ca-trust-extracted\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.359889 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.359859 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ced11cd7-0788-45f2-89a3-baba9f5e4110-installation-pull-secrets\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.360003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.359988 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ced11cd7-0788-45f2-89a3-baba9f5e4110-registry-certificates\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.360068 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.360017 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ced11cd7-0788-45f2-89a3-baba9f5e4110-bound-sa-token\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.360564 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.360540 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ced11cd7-0788-45f2-89a3-baba9f5e4110-trusted-ca\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.360662 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.360598 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ced11cd7-0788-45f2-89a3-baba9f5e4110-ca-trust-extracted\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.360762 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.360738 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ced11cd7-0788-45f2-89a3-baba9f5e4110-registry-certificates\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.361983 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.361945 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ced11cd7-0788-45f2-89a3-baba9f5e4110-image-registry-private-configuration\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.361983 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.361977 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ced11cd7-0788-45f2-89a3-baba9f5e4110-registry-tls\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.362143 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.362105 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ced11cd7-0788-45f2-89a3-baba9f5e4110-installation-pull-secrets\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.369155 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.369135 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwcbj\" (UniqueName: \"kubernetes.io/projected/ced11cd7-0788-45f2-89a3-baba9f5e4110-kube-api-access-cwcbj\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.369328 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.369310 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ced11cd7-0788-45f2-89a3-baba9f5e4110-bound-sa-token\") pod \"image-registry-68cd8c5474-fk74v\" (UID: \"ced11cd7-0788-45f2-89a3-baba9f5e4110\") " pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.390255 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.390235 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9js4" Jun 08 19:29:57.418433 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.418408 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-ss4g2" Jun 08 19:29:57.453580 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.453540 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:57.528648 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.528621 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9js4"] Jun 08 19:29:57.531628 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:29:57.531567 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e78c9f_57c4_4c5e_9724_ee13613f6851.slice/crio-49200c18cd7232ce40310da7b88c785c850a8c30fa01d358f8db988518b91431 WatchSource:0}: Error finding container 49200c18cd7232ce40310da7b88c785c850a8c30fa01d358f8db988518b91431: Status 404 returned error can't find the container with id 49200c18cd7232ce40310da7b88c785c850a8c30fa01d358f8db988518b91431 Jun 08 19:29:57.563610 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.563579 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-ss4g2"] Jun 08 19:29:57.567055 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:29:57.567023 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc940890e_f3e7_4eb2_99ed_851020c74780.slice/crio-b54f66a78836ffd9c80cfd4ec87207f2187f5ccf479a25699b5e1d802938835d WatchSource:0}: Error finding container b54f66a78836ffd9c80cfd4ec87207f2187f5ccf479a25699b5e1d802938835d: Status 404 returned error can't find the container with id b54f66a78836ffd9c80cfd4ec87207f2187f5ccf479a25699b5e1d802938835d Jun 08 19:29:57.595994 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:57.595969 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cd8c5474-fk74v"] Jun 08 19:29:57.598539 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:29:57.598502 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced11cd7_0788_45f2_89a3_baba9f5e4110.slice/crio-a696c955cd2294d23dc746efbe0dc77b2d089c2b598aee9204b0f344efc8c625 WatchSource:0}: Error finding container a696c955cd2294d23dc746efbe0dc77b2d089c2b598aee9204b0f344efc8c625: Status 404 returned error can't find the container with id a696c955cd2294d23dc746efbe0dc77b2d089c2b598aee9204b0f344efc8c625 Jun 08 19:29:58.102979 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:58.102939 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-ss4g2" event={"ID":"c940890e-f3e7-4eb2-99ed-851020c74780","Type":"ContainerStarted","Data":"b54f66a78836ffd9c80cfd4ec87207f2187f5ccf479a25699b5e1d802938835d"} Jun 08 19:29:58.104401 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:58.104372 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9js4" event={"ID":"12e78c9f-57c4-4c5e-9724-ee13613f6851","Type":"ContainerStarted","Data":"21686249ec1330c893a09ff2727734ea40a9e7108384ae897c391d89e99bbbc6"} Jun 08 19:29:58.104510 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:58.104424 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9js4" event={"ID":"12e78c9f-57c4-4c5e-9724-ee13613f6851","Type":"ContainerStarted","Data":"49200c18cd7232ce40310da7b88c785c850a8c30fa01d358f8db988518b91431"} Jun 08 19:29:58.105651 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:58.105633 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" event={"ID":"ced11cd7-0788-45f2-89a3-baba9f5e4110","Type":"ContainerStarted","Data":"e171278509d2560fb4c0356ae0d62e93f34918bfd9ac17aaaf0ceeb14d4a6f5f"} Jun 08 19:29:58.105703 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:58.105669 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" event={"ID":"ced11cd7-0788-45f2-89a3-baba9f5e4110","Type":"ContainerStarted","Data":"a696c955cd2294d23dc746efbe0dc77b2d089c2b598aee9204b0f344efc8c625"} Jun 08 19:29:58.105774 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:58.105760 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:29:58.125787 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:58.125737 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" podStartSLOduration=1.125721955 podStartE2EDuration="1.125721955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:58.124595655 +0000 UTC m=+206.104866783" watchObservedRunningTime="2026-06-08 19:29:58.125721955 +0000 UTC m=+206.105992960" Jun 08 19:29:59.113165 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:29:59.113114 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9js4" event={"ID":"12e78c9f-57c4-4c5e-9724-ee13613f6851","Type":"ContainerStarted","Data":"51cffdf8c4e5e1f09977d4fdeb854f04bf648f1bfe317acf2ebee713c42e2938"} Jun 08 19:30:00.037761 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.037724 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-q87dk"] Jun 08 19:30:00.041281 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.041256 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.043845 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.043823 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 19:30:00.043845 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.043836 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 19:30:00.045000 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.044975 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h5s4h\"" Jun 08 19:30:00.045116 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.045088 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 19:30:00.045116 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.045108 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 19:30:00.045229 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.045189 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 19:30:00.060209 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.060180 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-q87dk"] Jun 08 19:30:00.121428 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.121392 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9js4" event={"ID":"12e78c9f-57c4-4c5e-9724-ee13613f6851","Type":"ContainerStarted","Data":"899359d23e7b3728de82ef5b5f21e187cbddf83b14d43f6f8e92969ba082939f"} Jun 08 19:30:00.141004 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.140953 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k9js4" podStartSLOduration=1.046730445 podStartE2EDuration="3.14093679s" totalImagesPullingTime="2.094206345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:29:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:00.140394264 +0000 UTC m=+208.120665279" watchObservedRunningTime="2026-06-08 19:30:00.14093679 +0000 UTC m=+208.121207801" Jun 08 19:30:00.185885 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.185846 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa87c32d-19b9-481a-be08-9f6b8c83c427-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.186066 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.185896 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m69rx\" (UniqueName: \"kubernetes.io/projected/fa87c32d-19b9-481a-be08-9f6b8c83c427-kube-api-access-m69rx\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.186066 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.185957 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa87c32d-19b9-481a-be08-9f6b8c83c427-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.186066 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.186057 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa87c32d-19b9-481a-be08-9f6b8c83c427-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.286958 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.286915 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa87c32d-19b9-481a-be08-9f6b8c83c427-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.287138 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:30:00.287020 2549 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 08 19:30:00.287138 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.287030 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa87c32d-19b9-481a-be08-9f6b8c83c427-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.287138 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.287056 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m69rx\" (UniqueName: \"kubernetes.io/projected/fa87c32d-19b9-481a-be08-9f6b8c83c427-kube-api-access-m69rx\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.287138 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:30:00.287088 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa87c32d-19b9-481a-be08-9f6b8c83c427-prometheus-operator-tls podName:fa87c32d-19b9-481a-be08-9f6b8c83c427 nodeName:}" failed. No retries permitted until 2026-06-08 19:30:00.787068049 +0000 UTC m=+208.767339059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fa87c32d-19b9-481a-be08-9f6b8c83c427-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-q87dk" (UID: "fa87c32d-19b9-481a-be08-9f6b8c83c427") : secret "prometheus-operator-tls" not found Jun 08 19:30:00.287138 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.287130 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa87c32d-19b9-481a-be08-9f6b8c83c427-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.287878 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.287801 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa87c32d-19b9-481a-be08-9f6b8c83c427-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.290035 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.290008 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa87c32d-19b9-481a-be08-9f6b8c83c427-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.297336 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.297308 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m69rx\" (UniqueName: \"kubernetes.io/projected/fa87c32d-19b9-481a-be08-9f6b8c83c427-kube-api-access-m69rx\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.791889 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.791858 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa87c32d-19b9-481a-be08-9f6b8c83c427-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.794739 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.794714 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa87c32d-19b9-481a-be08-9f6b8c83c427-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-q87dk\" (UID: \"fa87c32d-19b9-481a-be08-9f6b8c83c427\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:00.952531 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:00.952494 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" Jun 08 19:30:01.102699 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:01.102676 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-q87dk"] Jun 08 19:30:01.105450 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:30:01.105418 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa87c32d_19b9_481a_be08_9f6b8c83c427.slice/crio-944c5d58225b0bd1881f6abaf19d4f09659ffb7a97496ef46d385ec81705560d WatchSource:0}: Error finding container 944c5d58225b0bd1881f6abaf19d4f09659ffb7a97496ef46d385ec81705560d: Status 404 returned error can't find the container with id 944c5d58225b0bd1881f6abaf19d4f09659ffb7a97496ef46d385ec81705560d Jun 08 19:30:01.126775 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:01.126739 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" event={"ID":"fa87c32d-19b9-481a-be08-9f6b8c83c427","Type":"ContainerStarted","Data":"944c5d58225b0bd1881f6abaf19d4f09659ffb7a97496ef46d385ec81705560d"} Jun 08 19:30:02.304292 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:02.304245 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:30:02.307408 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:02.307363 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953173bb-813a-4daa-a199-d1ec635252bd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-svswr\" (UID: \"953173bb-813a-4daa-a199-d1ec635252bd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:30:02.320452 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:02.320380 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qcmvm\"" Jun 08 19:30:02.323401 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:02.323380 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" Jun 08 19:30:02.619948 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:02.619898 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-svswr"] Jun 08 19:30:02.622139 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:30:02.622103 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953173bb_813a_4daa_a199_d1ec635252bd.slice/crio-8fe5ef8405a5904e455b1597aac2f811732a729f30ce8e07d6789b0c7a394f21 WatchSource:0}: Error finding container 8fe5ef8405a5904e455b1597aac2f811732a729f30ce8e07d6789b0c7a394f21: Status 404 returned error can't find the container with id 8fe5ef8405a5904e455b1597aac2f811732a729f30ce8e07d6789b0c7a394f21 Jun 08 19:30:03.137161 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.137121 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" event={"ID":"fa87c32d-19b9-481a-be08-9f6b8c83c427","Type":"ContainerStarted","Data":"29f93fb61ea7b7b675c8cf8dd03d213febe721b1c43fbaf4a0b3b3b7ff96d273"} Jun 08 19:30:03.137335 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.137192 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" event={"ID":"fa87c32d-19b9-481a-be08-9f6b8c83c427","Type":"ContainerStarted","Data":"e6c00e8ba36b28d27bf1bbf2b5aa64b6ed0d0b495feb701b00947768174a7e65"} Jun 08 19:30:03.138364 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.138338 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" event={"ID":"953173bb-813a-4daa-a199-d1ec635252bd","Type":"ContainerStarted","Data":"8fe5ef8405a5904e455b1597aac2f811732a729f30ce8e07d6789b0c7a394f21"} Jun 08 19:30:03.157634 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.157441 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q87dk" podStartSLOduration=1.742497253 podStartE2EDuration="3.157423678s" totalImagesPullingTime="1.414926425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:03.155768224 +0000 UTC m=+211.136039234" watchObservedRunningTime="2026-06-08 19:30:03.157423678 +0000 UTC m=+211.137694691" Jun 08 19:30:03.307585 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.307550 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56b9967f7f-pnnvt"] Jun 08 19:30:03.311611 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.311343 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.314932 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.314662 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 19:30:03.314932 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.314860 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zfr4m\"" Jun 08 19:30:03.315107 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.314941 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 19:30:03.315107 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.315085 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 19:30:03.315213 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.315157 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 19:30:03.315428 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.315394 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 19:30:03.322015 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.321989 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b9967f7f-pnnvt"] Jun 08 19:30:03.414927 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.414824 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-oauth-config\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.414927 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.414869 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-config\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.415148 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.415002 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-serving-cert\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.415148 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.415027 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-service-ca\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.415148 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.415049 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp4p4\" (UniqueName: \"kubernetes.io/projected/1b409b0e-0efc-42d8-9a18-fcea7fd37807-kube-api-access-bp4p4\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.415148 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.415098 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-oauth-serving-cert\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.516546 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.516510 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-serving-cert\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.516546 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.516552 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-service-ca\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.516769 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.516575 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp4p4\" (UniqueName: \"kubernetes.io/projected/1b409b0e-0efc-42d8-9a18-fcea7fd37807-kube-api-access-bp4p4\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.516769 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.516624 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-oauth-serving-cert\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.516769 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.516686 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-oauth-config\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.516769 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.516716 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-config\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.517390 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.517362 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-service-ca\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.517502 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.517362 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-config\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.517502 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.517452 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-oauth-serving-cert\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.520158 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.520132 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-serving-cert\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.520522 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.520499 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-oauth-config\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.525652 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.525628 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp4p4\" (UniqueName: \"kubernetes.io/projected/1b409b0e-0efc-42d8-9a18-fcea7fd37807-kube-api-access-bp4p4\") pod \"console-56b9967f7f-pnnvt\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.627376 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.627337 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:03.986330 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:03.986303 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b9967f7f-pnnvt"] Jun 08 19:30:03.988661 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:30:03.988636 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b409b0e_0efc_42d8_9a18_fcea7fd37807.slice/crio-e48452f2ba8ffff684a83d775cfbc315caa8d596fb658a729c580acafea29753 WatchSource:0}: Error finding container e48452f2ba8ffff684a83d775cfbc315caa8d596fb658a729c580acafea29753: Status 404 returned error can't find the container with id e48452f2ba8ffff684a83d775cfbc315caa8d596fb658a729c580acafea29753 Jun 08 19:30:04.148804 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:04.148682 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" event={"ID":"953173bb-813a-4daa-a199-d1ec635252bd","Type":"ContainerStarted","Data":"822ddfb9afcca34d7f421cac08bab91c204f82d2123fe0846e9bdd5896715bfc"} Jun 08 19:30:04.150407 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:04.150376 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b9967f7f-pnnvt" event={"ID":"1b409b0e-0efc-42d8-9a18-fcea7fd37807","Type":"ContainerStarted","Data":"e48452f2ba8ffff684a83d775cfbc315caa8d596fb658a729c580acafea29753"} Jun 08 19:30:04.170107 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:04.170053 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-svswr" podStartSLOduration=32.907799391 podStartE2EDuration="34.170036318s" totalImagesPullingTime="1.262236927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:04.169712771 +0000 UTC m=+212.149983783" watchObservedRunningTime="2026-06-08 19:30:04.170036318 +0000 UTC m=+212.150307329" Jun 08 19:30:05.603317 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.603246 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zgwx5"] Jun 08 19:30:05.606649 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.606627 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.609339 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.609309 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zcd7h\"" Jun 08 19:30:05.609339 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.609331 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 19:30:05.609522 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.609497 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 19:30:05.609643 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.609593 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 19:30:05.739993 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.739959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.740147 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.740033 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rth9b\" (UniqueName: \"kubernetes.io/projected/d64773dd-e96d-4806-af92-eb212b62c4cf-kube-api-access-rth9b\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.740147 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.740081 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d64773dd-e96d-4806-af92-eb212b62c4cf-sys\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.740147 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.740104 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-wtmp\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.740313 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.740157 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d64773dd-e96d-4806-af92-eb212b62c4cf-metrics-client-ca\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.740313 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.740216 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.740313 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.740242 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-tls\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.740313 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.740277 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d64773dd-e96d-4806-af92-eb212b62c4cf-root\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.740313 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.740298 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-textfile\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.840721 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.840684 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d64773dd-e96d-4806-af92-eb212b62c4cf-metrics-client-ca\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.840995 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841042 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-tls\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841091 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d64773dd-e96d-4806-af92-eb212b62c4cf-root\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841116 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-textfile\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841152 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:30:05.841225 2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:30:05.841294 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-tls podName:d64773dd-e96d-4806-af92-eb212b62c4cf nodeName:}" failed. No retries permitted until 2026-06-08 19:30:06.341275646 +0000 UTC m=+214.321546638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-tls") pod "node-exporter-zgwx5" (UID: "d64773dd-e96d-4806-af92-eb212b62c4cf") : secret "node-exporter-tls" not found Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841258 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d64773dd-e96d-4806-af92-eb212b62c4cf-root\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841316 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rth9b\" (UniqueName: \"kubernetes.io/projected/d64773dd-e96d-4806-af92-eb212b62c4cf-kube-api-access-rth9b\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841431 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d64773dd-e96d-4806-af92-eb212b62c4cf-metrics-client-ca\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.841507 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841468 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-textfile\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.842160 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841671 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d64773dd-e96d-4806-af92-eb212b62c4cf-sys\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.842160 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841698 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.842160 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841583 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d64773dd-e96d-4806-af92-eb212b62c4cf-sys\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.842160 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841758 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-wtmp\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.842160 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.841982 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-wtmp\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.843972 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.843947 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:05.851670 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:05.851622 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rth9b\" (UniqueName: \"kubernetes.io/projected/d64773dd-e96d-4806-af92-eb212b62c4cf-kube-api-access-rth9b\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:06.346481 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:06.346441 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-tls\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:06.349289 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:06.349260 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d64773dd-e96d-4806-af92-eb212b62c4cf-node-exporter-tls\") pod \"node-exporter-zgwx5\" (UID: \"d64773dd-e96d-4806-af92-eb212b62c4cf\") " pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:06.518955 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:06.518853 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zgwx5" Jun 08 19:30:07.095121 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.095080 2549 patch_prober.go:28] interesting pod/image-registry-778c9859b9-4s84q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:30:07.095650 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.095144 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" podUID="4f7e9d65-0098-4d7e-ae0f-3e980975412f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:30:07.754808 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.754772 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc6768fc4-7x8q4"] Jun 08 19:30:07.758170 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.758152 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.767620 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.767589 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 19:30:07.769560 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.769537 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc6768fc4-7x8q4"] Jun 08 19:30:07.858928 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.858869 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zztk\" (UniqueName: \"kubernetes.io/projected/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-kube-api-access-9zztk\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.859100 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.858966 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-config\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.859100 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.858995 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-trusted-ca-bundle\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.859100 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.859044 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-serving-cert\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.859278 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.859127 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-oauth-serving-cert\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.859278 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.859171 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-service-ca\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.859278 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.859266 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-oauth-config\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.960025 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.959993 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-serving-cert\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.960200 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.960049 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-oauth-serving-cert\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.960200 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.960083 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-service-ca\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.960200 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.960114 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-oauth-config\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.960200 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.960137 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zztk\" (UniqueName: \"kubernetes.io/projected/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-kube-api-access-9zztk\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.960200 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.960180 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-config\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.960480 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.960205 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-trusted-ca-bundle\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.961466 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.961439 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-oauth-serving-cert\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.961576 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.961561 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-config\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.961660 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.961635 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-service-ca\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.961760 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.961739 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-trusted-ca-bundle\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.963148 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.963126 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-oauth-config\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.963240 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.963134 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-serving-cert\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:07.969692 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:07.969668 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zztk\" (UniqueName: \"kubernetes.io/projected/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-kube-api-access-9zztk\") pod \"console-7dc6768fc4-7x8q4\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:08.069207 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:08.069161 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:10.181476 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.181438 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fblgq"] Jun 08 19:30:10.184784 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.184760 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:10.187597 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.187565 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 19:30:10.187791 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.187604 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xvqlq\"" Jun 08 19:30:10.195847 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.195813 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fblgq"] Jun 08 19:30:10.282193 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.282162 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff33bd99-9a6e-4bae-9b0c-19765607fba0-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fblgq\" (UID: \"ff33bd99-9a6e-4bae-9b0c-19765607fba0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:10.282369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.282249 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkxkh\" (UniqueName: \"kubernetes.io/projected/ff33bd99-9a6e-4bae-9b0c-19765607fba0-kube-api-access-fkxkh\") pod \"monitoring-plugin-76b68cc874-fblgq\" (UID: \"ff33bd99-9a6e-4bae-9b0c-19765607fba0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:10.383151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.383118 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff33bd99-9a6e-4bae-9b0c-19765607fba0-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fblgq\" (UID: \"ff33bd99-9a6e-4bae-9b0c-19765607fba0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:10.383306 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:30:10.383281 2549 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 08 19:30:10.383374 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.383309 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkxkh\" (UniqueName: \"kubernetes.io/projected/ff33bd99-9a6e-4bae-9b0c-19765607fba0-kube-api-access-fkxkh\") pod \"monitoring-plugin-76b68cc874-fblgq\" (UID: \"ff33bd99-9a6e-4bae-9b0c-19765607fba0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:10.383427 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:30:10.383371 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff33bd99-9a6e-4bae-9b0c-19765607fba0-monitoring-plugin-cert podName:ff33bd99-9a6e-4bae-9b0c-19765607fba0 nodeName:}" failed. No retries permitted until 2026-06-08 19:30:10.883348975 +0000 UTC m=+218.863619967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ff33bd99-9a6e-4bae-9b0c-19765607fba0-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-fblgq" (UID: "ff33bd99-9a6e-4bae-9b0c-19765607fba0") : secret "monitoring-plugin-cert" not found Jun 08 19:30:10.394814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.394790 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkxkh\" (UniqueName: \"kubernetes.io/projected/ff33bd99-9a6e-4bae-9b0c-19765607fba0-kube-api-access-fkxkh\") pod \"monitoring-plugin-76b68cc874-fblgq\" (UID: \"ff33bd99-9a6e-4bae-9b0c-19765607fba0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:10.890201 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.890165 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff33bd99-9a6e-4bae-9b0c-19765607fba0-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fblgq\" (UID: \"ff33bd99-9a6e-4bae-9b0c-19765607fba0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:10.892794 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:10.892768 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff33bd99-9a6e-4bae-9b0c-19765607fba0-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fblgq\" (UID: \"ff33bd99-9a6e-4bae-9b0c-19765607fba0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:11.097127 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:11.097081 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:14.402731 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:30:14.402691 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64773dd_e96d_4806_af92_eb212b62c4cf.slice/crio-aac58cc698761bb3266ed75ab7e27d75e62dca9c3c64771b6791ff7bdc47b4cf WatchSource:0}: Error finding container aac58cc698761bb3266ed75ab7e27d75e62dca9c3c64771b6791ff7bdc47b4cf: Status 404 returned error can't find the container with id aac58cc698761bb3266ed75ab7e27d75e62dca9c3c64771b6791ff7bdc47b4cf Jun 08 19:30:14.588852 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:14.588819 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fblgq"] Jun 08 19:30:14.592648 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:30:14.592615 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff33bd99_9a6e_4bae_9b0c_19765607fba0.slice/crio-7e5942bc4f7bc1f0f7e3e815715b87350cd9d4c447e1b8303a27749705295e50 WatchSource:0}: Error finding container 7e5942bc4f7bc1f0f7e3e815715b87350cd9d4c447e1b8303a27749705295e50: Status 404 returned error can't find the container with id 7e5942bc4f7bc1f0f7e3e815715b87350cd9d4c447e1b8303a27749705295e50 Jun 08 19:30:14.604868 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:14.604754 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc6768fc4-7x8q4"] Jun 08 19:30:14.607268 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:30:14.607248 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4b7ed1_32d3_45c5_ac50_e1cfcd86c63c.slice/crio-b462c5cc55fe0087e059be79fa5d92b020a7c7beebfefc9cac01218309ed960a WatchSource:0}: Error finding container b462c5cc55fe0087e059be79fa5d92b020a7c7beebfefc9cac01218309ed960a: Status 404 returned error can't find the container with id b462c5cc55fe0087e059be79fa5d92b020a7c7beebfefc9cac01218309ed960a Jun 08 19:30:15.202011 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.201969 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-ss4g2" event={"ID":"c940890e-f3e7-4eb2-99ed-851020c74780","Type":"ContainerStarted","Data":"93743ed5d1cbe1df52283b8969e8e678c5bd6f1fc23b72c719ceadd3476109f6"} Jun 08 19:30:15.204328 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.204294 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-ss4g2" Jun 08 19:30:15.206598 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.206566 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zgwx5" event={"ID":"d64773dd-e96d-4806-af92-eb212b62c4cf","Type":"ContainerStarted","Data":"aac58cc698761bb3266ed75ab7e27d75e62dca9c3c64771b6791ff7bdc47b4cf"} Jun 08 19:30:15.208106 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.208056 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" event={"ID":"ff33bd99-9a6e-4bae-9b0c-19765607fba0","Type":"ContainerStarted","Data":"7e5942bc4f7bc1f0f7e3e815715b87350cd9d4c447e1b8303a27749705295e50"} Jun 08 19:30:15.210324 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.210293 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b9967f7f-pnnvt" event={"ID":"1b409b0e-0efc-42d8-9a18-fcea7fd37807","Type":"ContainerStarted","Data":"67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787"} Jun 08 19:30:15.212433 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.212408 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc6768fc4-7x8q4" event={"ID":"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c","Type":"ContainerStarted","Data":"8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6"} Jun 08 19:30:15.212537 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.212451 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc6768fc4-7x8q4" event={"ID":"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c","Type":"ContainerStarted","Data":"b462c5cc55fe0087e059be79fa5d92b020a7c7beebfefc9cac01218309ed960a"} Jun 08 19:30:15.213994 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.213950 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-ss4g2" Jun 08 19:30:15.223440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.223371 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-ss4g2" podStartSLOduration=1.324365132 podStartE2EDuration="18.223352638s" totalImagesPullingTime="16.898987506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:15.222019561 +0000 UTC m=+223.202290573" watchObservedRunningTime="2026-06-08 19:30:15.223352638 +0000 UTC m=+223.203623650" Jun 08 19:30:15.260812 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:15.260039 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc6768fc4-7x8q4" podStartSLOduration=8.26001616 podStartE2EDuration="8.26001616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:15.258283261 +0000 UTC m=+223.238554274" watchObservedRunningTime="2026-06-08 19:30:15.26001616 +0000 UTC m=+223.240287171" Jun 08 19:30:16.126381 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.124991 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56b9967f7f-pnnvt" podStartSLOduration=2.717026163 podStartE2EDuration="13.124951989s" totalImagesPullingTime="10.407925826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:15.278360521 +0000 UTC m=+223.258631532" watchObservedRunningTime="2026-06-08 19:30:16.124951989 +0000 UTC m=+224.105223024" Jun 08 19:30:16.127139 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.127063 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b9967f7f-pnnvt"] Jun 08 19:30:16.154137 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.154095 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6488996765-gtrp2"] Jun 08 19:30:16.192271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.192231 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6488996765-gtrp2"] Jun 08 19:30:16.192492 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.192340 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.220519 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.219443 2549 generic.go:356] "Generic (PLEG): container finished" podID="d64773dd-e96d-4806-af92-eb212b62c4cf" containerID="70a623f59330b7bdc279c0a1a8062d60de6fcb342d0ea9f60d09dd2f83329334" exitCode=0 Jun 08 19:30:16.220519 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.219558 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zgwx5" event={"ID":"d64773dd-e96d-4806-af92-eb212b62c4cf","Type":"ContainerDied","Data":"70a623f59330b7bdc279c0a1a8062d60de6fcb342d0ea9f60d09dd2f83329334"} Jun 08 19:30:16.342350 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.342305 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-oauth-serving-cert\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.342558 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.342401 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-serving-cert\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.342558 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.342484 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qczpr\" (UniqueName: \"kubernetes.io/projected/76f26feb-1bd5-46e9-804d-8dca5276491c-kube-api-access-qczpr\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.343600 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.342667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-oauth-config\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.343600 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.342737 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-service-ca\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.343600 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.343222 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-trusted-ca-bundle\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.343600 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.343278 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-console-config\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.444824 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.444786 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qczpr\" (UniqueName: \"kubernetes.io/projected/76f26feb-1bd5-46e9-804d-8dca5276491c-kube-api-access-qczpr\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.444976 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.444878 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-oauth-config\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.444976 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.444937 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-service-ca\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.445115 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.444981 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-trusted-ca-bundle\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.445115 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.445011 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-console-config\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.445115 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.445075 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-oauth-serving-cert\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.445264 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.445114 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-serving-cert\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.446251 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.446224 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-trusted-ca-bundle\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.446364 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.446347 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-oauth-serving-cert\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.447187 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.446817 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-service-ca\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.447187 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.447156 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-console-config\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.448260 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.448207 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-serving-cert\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.450583 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.450532 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-oauth-config\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.454663 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.454616 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qczpr\" (UniqueName: \"kubernetes.io/projected/76f26feb-1bd5-46e9-804d-8dca5276491c-kube-api-access-qczpr\") pod \"console-6488996765-gtrp2\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.505003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.504968 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:16.696770 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:16.696606 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6488996765-gtrp2"] Jun 08 19:30:16.782604 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:30:16.782563 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f26feb_1bd5_46e9_804d_8dca5276491c.slice/crio-ff5977e07929d3493ae6b6e3eac73bf7ce4aaabd00221af689cfa1d0f0c9fb77 WatchSource:0}: Error finding container ff5977e07929d3493ae6b6e3eac73bf7ce4aaabd00221af689cfa1d0f0c9fb77: Status 404 returned error can't find the container with id ff5977e07929d3493ae6b6e3eac73bf7ce4aaabd00221af689cfa1d0f0c9fb77 Jun 08 19:30:17.095157 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.095122 2549 patch_prober.go:28] interesting pod/image-registry-778c9859b9-4s84q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:30:17.095338 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.095181 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" podUID="4f7e9d65-0098-4d7e-ae0f-3e980975412f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:30:17.226460 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.226370 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zgwx5" event={"ID":"d64773dd-e96d-4806-af92-eb212b62c4cf","Type":"ContainerStarted","Data":"876fdcaabbaf76c4fb2c62f33f413b2e55ee4b2bf598021f8f6fd9d30567d6f0"} Jun 08 19:30:17.226920 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.226482 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zgwx5" event={"ID":"d64773dd-e96d-4806-af92-eb212b62c4cf","Type":"ContainerStarted","Data":"5b9362e92e81bec242a01cec0e02bd7c8426e8329b13153ca11a5cbefe67d130"} Jun 08 19:30:17.228337 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.228306 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" event={"ID":"ff33bd99-9a6e-4bae-9b0c-19765607fba0","Type":"ContainerStarted","Data":"056ba70aa9b70aa9cb4376b04ac5a837b803ec6310a80b715d9f6dd04d0ba19a"} Jun 08 19:30:17.228454 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.228367 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:17.230381 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.230357 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6488996765-gtrp2" event={"ID":"76f26feb-1bd5-46e9-804d-8dca5276491c","Type":"ContainerStarted","Data":"8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70"} Jun 08 19:30:17.230515 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.230397 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6488996765-gtrp2" event={"ID":"76f26feb-1bd5-46e9-804d-8dca5276491c","Type":"ContainerStarted","Data":"ff5977e07929d3493ae6b6e3eac73bf7ce4aaabd00221af689cfa1d0f0c9fb77"} Jun 08 19:30:17.234187 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.234167 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" Jun 08 19:30:17.249282 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.249227 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zgwx5" podStartSLOduration=11.016248148 podStartE2EDuration="12.249211695s" totalImagesPullingTime="1.14693608s" totalInitContainerRuntime="86.027467ms" isStatefulPod=true podCreationTimestamp="2026-06-08 19:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:17.246418361 +0000 UTC m=+225.226689373" watchObservedRunningTime="2026-06-08 19:30:17.249211695 +0000 UTC m=+225.229482710" Jun 08 19:30:17.282955 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.282876 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fblgq" podStartSLOduration=5.056456065 podStartE2EDuration="7.28285711s" totalImagesPullingTime="2.226401045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:17.280738829 +0000 UTC m=+225.261009842" watchObservedRunningTime="2026-06-08 19:30:17.28285711 +0000 UTC m=+225.263128122" Jun 08 19:30:17.300218 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.300158 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6488996765-gtrp2" podStartSLOduration=1.300140426 podStartE2EDuration="1.300140426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:17.298475787 +0000 UTC m=+225.278746800" watchObservedRunningTime="2026-06-08 19:30:17.300140426 +0000 UTC m=+225.280411437" Jun 08 19:30:17.458973 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.458939 2549 patch_prober.go:28] interesting pod/image-registry-68cd8c5474-fk74v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:30:17.459126 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:17.459009 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" podUID="ced11cd7-0788-45f2-89a3-baba9f5e4110" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:30:18.070266 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:18.070222 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:18.070543 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:18.070293 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:18.071937 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:18.071893 2549 patch_prober.go:28] interesting pod/console-7dc6768fc4-7x8q4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 08 19:30:18.072080 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:18.071956 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dc6768fc4-7x8q4" podUID="3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 08 19:30:19.118280 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:19.118244 2549 patch_prober.go:28] interesting pod/image-registry-68cd8c5474-fk74v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:30:19.118812 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:19.118301 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" podUID="ced11cd7-0788-45f2-89a3-baba9f5e4110" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:30:22.109866 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.109795 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" podUID="4f7e9d65-0098-4d7e-ae0f-3e980975412f" containerName="registry" containerID="cri-o://90ab116423996b54d52c0085cf116c0bb59d73e34952ac60cc7c96c34865bf44" gracePeriod=30 Jun 08 19:30:22.255278 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.255194 2549 generic.go:356] "Generic (PLEG): container finished" podID="4f7e9d65-0098-4d7e-ae0f-3e980975412f" containerID="90ab116423996b54d52c0085cf116c0bb59d73e34952ac60cc7c96c34865bf44" exitCode=0 Jun 08 19:30:22.255414 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.255277 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" event={"ID":"4f7e9d65-0098-4d7e-ae0f-3e980975412f","Type":"ContainerDied","Data":"90ab116423996b54d52c0085cf116c0bb59d73e34952ac60cc7c96c34865bf44"} Jun 08 19:30:22.415311 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.415275 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:30:22.509107 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.509074 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f7e9d65-0098-4d7e-ae0f-3e980975412f-ca-trust-extracted\") pod \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " Jun 08 19:30:22.509280 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.509119 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-bound-sa-token\") pod \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " Jun 08 19:30:22.509280 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.509176 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") pod \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " Jun 08 19:30:22.509280 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.509196 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpq88\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-kube-api-access-vpq88\") pod \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " Jun 08 19:30:22.509280 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.509224 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-certificates\") pod \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " Jun 08 19:30:22.509657 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.509629 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4f7e9d65-0098-4d7e-ae0f-3e980975412f" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:30:22.509921 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.509633 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-trusted-ca\") pod \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " Jun 08 19:30:22.509921 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.509889 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-image-registry-private-configuration\") pod \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " Jun 08 19:30:22.510158 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.510102 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4f7e9d65-0098-4d7e-ae0f-3e980975412f" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:30:22.510265 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.510248 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-installation-pull-secrets\") pod \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\" (UID: \"4f7e9d65-0098-4d7e-ae0f-3e980975412f\") " Jun 08 19:30:22.511043 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.510843 2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-certificates\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:22.511043 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.510868 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f7e9d65-0098-4d7e-ae0f-3e980975412f-trusted-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:22.512094 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.512068 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-kube-api-access-vpq88" (OuterVolumeSpecName: "kube-api-access-vpq88") pod "4f7e9d65-0098-4d7e-ae0f-3e980975412f" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f"). InnerVolumeSpecName "kube-api-access-vpq88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:30:22.512192 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.512172 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4f7e9d65-0098-4d7e-ae0f-3e980975412f" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:30:22.512350 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.512327 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4f7e9d65-0098-4d7e-ae0f-3e980975412f" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:30:22.513059 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.513032 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4f7e9d65-0098-4d7e-ae0f-3e980975412f" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:30:22.513165 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.513052 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4f7e9d65-0098-4d7e-ae0f-3e980975412f" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:30:22.520216 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.520184 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f7e9d65-0098-4d7e-ae0f-3e980975412f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4f7e9d65-0098-4d7e-ae0f-3e980975412f" (UID: "4f7e9d65-0098-4d7e-ae0f-3e980975412f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:30:22.611443 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.611403 2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-registry-tls\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:22.611443 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.611438 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpq88\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-kube-api-access-vpq88\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:22.611682 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.611454 2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-image-registry-private-configuration\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:22.611682 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.611470 2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f7e9d65-0098-4d7e-ae0f-3e980975412f-installation-pull-secrets\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:22.611682 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.611484 2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f7e9d65-0098-4d7e-ae0f-3e980975412f-ca-trust-extracted\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:22.611682 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:22.611496 2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f7e9d65-0098-4d7e-ae0f-3e980975412f-bound-sa-token\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:23.261429 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:23.261386 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" event={"ID":"4f7e9d65-0098-4d7e-ae0f-3e980975412f","Type":"ContainerDied","Data":"3d06d0aa0db9c5f73bb904dc7921c9a38ebbcd3581dcedbbd1f4c8b4c312b9a1"} Jun 08 19:30:23.261429 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:23.261418 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778c9859b9-4s84q" Jun 08 19:30:23.261999 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:23.261453 2549 scope.go:117] "RemoveContainer" containerID="90ab116423996b54d52c0085cf116c0bb59d73e34952ac60cc7c96c34865bf44" Jun 08 19:30:23.289528 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:23.289493 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-778c9859b9-4s84q"] Jun 08 19:30:23.300281 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:23.300253 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-778c9859b9-4s84q"] Jun 08 19:30:23.628043 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:23.628011 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:24.468305 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:24.468271 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f7e9d65-0098-4d7e-ae0f-3e980975412f" path="/var/lib/kubelet/pods/4f7e9d65-0098-4d7e-ae0f-3e980975412f/volumes" Jun 08 19:30:26.505699 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:26.505663 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:26.506092 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:26.505736 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:26.507025 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:26.507000 2549 patch_prober.go:28] interesting pod/console-6488996765-gtrp2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 08 19:30:26.507140 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:26.507043 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6488996765-gtrp2" podUID="76f26feb-1bd5-46e9-804d-8dca5276491c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 08 19:30:27.458576 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:27.458537 2549 patch_prober.go:28] interesting pod/image-registry-68cd8c5474-fk74v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:30:27.458734 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:27.458601 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" podUID="ced11cd7-0788-45f2-89a3-baba9f5e4110" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:30:28.069545 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:28.069514 2549 patch_prober.go:28] interesting pod/console-7dc6768fc4-7x8q4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 08 19:30:28.069953 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:28.069567 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dc6768fc4-7x8q4" podUID="3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 08 19:30:29.117379 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:29.117339 2549 patch_prober.go:28] interesting pod/image-registry-68cd8c5474-fk74v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:30:29.117873 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:29.117419 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" podUID="ced11cd7-0788-45f2-89a3-baba9f5e4110" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:30:36.506522 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:36.506485 2549 patch_prober.go:28] interesting pod/console-6488996765-gtrp2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 08 19:30:36.506964 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:36.506538 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6488996765-gtrp2" podUID="76f26feb-1bd5-46e9-804d-8dca5276491c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 08 19:30:37.457848 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:37.457817 2549 patch_prober.go:28] interesting pod/image-registry-68cd8c5474-fk74v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:30:37.458025 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:37.457866 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" podUID="ced11cd7-0788-45f2-89a3-baba9f5e4110" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:30:37.458025 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:37.457923 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:30:37.458406 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:37.458374 2549 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"e171278509d2560fb4c0356ae0d62e93f34918bfd9ac17aaaf0ceeb14d4a6f5f"} pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" containerMessage="Container registry failed liveness probe, will be restarted" Jun 08 19:30:37.462002 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:37.461966 2549 patch_prober.go:28] interesting pod/image-registry-68cd8c5474-fk74v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:30:37.462109 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:37.462005 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" podUID="ced11cd7-0788-45f2-89a3-baba9f5e4110" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:30:38.070563 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:38.070529 2549 patch_prober.go:28] interesting pod/console-7dc6768fc4-7x8q4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 08 19:30:38.070969 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:38.070582 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dc6768fc4-7x8q4" podUID="3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 08 19:30:42.254711 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:42.254621 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56b9967f7f-pnnvt" podUID="1b409b0e-0efc-42d8-9a18-fcea7fd37807" containerName="console" containerID="cri-o://67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787" gracePeriod=15 Jun 08 19:30:44.301275 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:44.301235 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:30:44.303546 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:44.303521 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c78959-04e2-4a31-a546-d13235ebbe5f-metrics-certs\") pod \"network-metrics-daemon-bpp7k\" (UID: \"c4c78959-04e2-4a31-a546-d13235ebbe5f\") " pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:30:44.567189 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:44.567105 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b4x6n\"" Jun 08 19:30:44.574617 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:44.574596 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpp7k" Jun 08 19:30:44.728470 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:44.728443 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bpp7k"] Jun 08 19:30:44.730608 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:30:44.730579 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c78959_04e2_4a31_a546_d13235ebbe5f.slice/crio-1f2b17927a13bccf1fb86390c1021f1fd2055e8663ed9c6134fa61127e3af31a WatchSource:0}: Error finding container 1f2b17927a13bccf1fb86390c1021f1fd2055e8663ed9c6134fa61127e3af31a: Status 404 returned error can't find the container with id 1f2b17927a13bccf1fb86390c1021f1fd2055e8663ed9c6134fa61127e3af31a Jun 08 19:30:44.926316 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:44.926289 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:45.007701 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.007661 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-service-ca\") pod \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " Jun 08 19:30:45.007933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.007710 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp4p4\" (UniqueName: \"kubernetes.io/projected/1b409b0e-0efc-42d8-9a18-fcea7fd37807-kube-api-access-bp4p4\") pod \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " Jun 08 19:30:45.007933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.007755 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-config\") pod \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " Jun 08 19:30:45.007933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.007787 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-oauth-config\") pod \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " Jun 08 19:30:45.007933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.007848 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-serving-cert\") pod \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " Jun 08 19:30:45.007933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.007890 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-oauth-serving-cert\") pod \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\" (UID: \"1b409b0e-0efc-42d8-9a18-fcea7fd37807\") " Jun 08 19:30:45.008243 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.008216 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-config" (OuterVolumeSpecName: "console-config") pod "1b409b0e-0efc-42d8-9a18-fcea7fd37807" (UID: "1b409b0e-0efc-42d8-9a18-fcea7fd37807"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:30:45.008303 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.008269 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-service-ca" (OuterVolumeSpecName: "service-ca") pod "1b409b0e-0efc-42d8-9a18-fcea7fd37807" (UID: "1b409b0e-0efc-42d8-9a18-fcea7fd37807"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:30:45.008406 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.008365 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1b409b0e-0efc-42d8-9a18-fcea7fd37807" (UID: "1b409b0e-0efc-42d8-9a18-fcea7fd37807"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:30:45.010104 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.010066 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1b409b0e-0efc-42d8-9a18-fcea7fd37807" (UID: "1b409b0e-0efc-42d8-9a18-fcea7fd37807"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:30:45.010195 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.010119 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1b409b0e-0efc-42d8-9a18-fcea7fd37807" (UID: "1b409b0e-0efc-42d8-9a18-fcea7fd37807"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:30:45.010195 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.010127 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b409b0e-0efc-42d8-9a18-fcea7fd37807-kube-api-access-bp4p4" (OuterVolumeSpecName: "kube-api-access-bp4p4") pod "1b409b0e-0efc-42d8-9a18-fcea7fd37807" (UID: "1b409b0e-0efc-42d8-9a18-fcea7fd37807"). InnerVolumeSpecName "kube-api-access-bp4p4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:30:45.109015 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.108932 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-oauth-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:45.109015 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.108961 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:45.109015 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.108971 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-oauth-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:45.109015 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.108980 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-service-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:45.109015 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.109002 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp4p4\" (UniqueName: \"kubernetes.io/projected/1b409b0e-0efc-42d8-9a18-fcea7fd37807-kube-api-access-bp4p4\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:45.109015 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.109012 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b409b0e-0efc-42d8-9a18-fcea7fd37807-console-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:30:45.349469 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.349433 2549 generic.go:356] "Generic (PLEG): container finished" podID="1b409b0e-0efc-42d8-9a18-fcea7fd37807" containerID="67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787" exitCode=0 Jun 08 19:30:45.350025 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.349491 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b9967f7f-pnnvt" Jun 08 19:30:45.350025 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.349489 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b9967f7f-pnnvt" event={"ID":"1b409b0e-0efc-42d8-9a18-fcea7fd37807","Type":"ContainerDied","Data":"67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787"} Jun 08 19:30:45.350025 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.349630 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b9967f7f-pnnvt" event={"ID":"1b409b0e-0efc-42d8-9a18-fcea7fd37807","Type":"ContainerDied","Data":"e48452f2ba8ffff684a83d775cfbc315caa8d596fb658a729c580acafea29753"} Jun 08 19:30:45.350025 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.349663 2549 scope.go:117] "RemoveContainer" containerID="67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787" Jun 08 19:30:45.351311 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.351256 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpp7k" event={"ID":"c4c78959-04e2-4a31-a546-d13235ebbe5f","Type":"ContainerStarted","Data":"1f2b17927a13bccf1fb86390c1021f1fd2055e8663ed9c6134fa61127e3af31a"} Jun 08 19:30:45.363289 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.362955 2549 scope.go:117] "RemoveContainer" containerID="67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787" Jun 08 19:30:45.363432 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:30:45.363408 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787\": container with ID starting with 67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787 not found: ID does not exist" containerID="67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787" Jun 08 19:30:45.363508 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.363445 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787"} err="failed to get container status \"67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787\": rpc error: code = NotFound desc = could not find container \"67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787\": container with ID starting with 67a368e5bcdef2bc7b46d008771330584bf0808b93aae6cf205de52e23320787 not found: ID does not exist" Jun 08 19:30:45.373543 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.373515 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b9967f7f-pnnvt"] Jun 08 19:30:45.377022 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:45.377001 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56b9967f7f-pnnvt"] Jun 08 19:30:46.357698 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:46.357670 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpp7k" event={"ID":"c4c78959-04e2-4a31-a546-d13235ebbe5f","Type":"ContainerStarted","Data":"43aadd86ed8fd5537434134065cdb41892bb10aeae5bdafc5f254bddbfe7be7a"} Jun 08 19:30:46.468390 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:46.468312 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b409b0e-0efc-42d8-9a18-fcea7fd37807" path="/var/lib/kubelet/pods/1b409b0e-0efc-42d8-9a18-fcea7fd37807/volumes" Jun 08 19:30:46.506189 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:46.506149 2549 patch_prober.go:28] interesting pod/console-6488996765-gtrp2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 08 19:30:46.506352 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:46.506201 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6488996765-gtrp2" podUID="76f26feb-1bd5-46e9-804d-8dca5276491c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 08 19:30:47.368756 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:47.368724 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpp7k" event={"ID":"c4c78959-04e2-4a31-a546-d13235ebbe5f","Type":"ContainerStarted","Data":"97dac6cf7ea3d640ae76d0a02780e80058e742c2526fa8dda14af4d9220064a6"} Jun 08 19:30:47.386639 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:47.386591 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bpp7k" podStartSLOduration=253.929450093 podStartE2EDuration="4m15.386577776s" totalImagesPullingTime="1.457127683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:47.386245933 +0000 UTC m=+255.366516957" watchObservedRunningTime="2026-06-08 19:30:47.386577776 +0000 UTC m=+255.366848846" Jun 08 19:30:47.463073 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:47.463041 2549 patch_prober.go:28] interesting pod/image-registry-68cd8c5474-fk74v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:30:47.463232 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:47.463092 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" podUID="ced11cd7-0788-45f2-89a3-baba9f5e4110" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:30:48.073792 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:48.073766 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:48.077515 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:48.077478 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:30:56.509903 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:56.509876 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:56.513739 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:56.513716 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:30:56.577130 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:56.577096 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc6768fc4-7x8q4"] Jun 08 19:30:57.462305 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:57.462279 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:30:59.415679 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:59.415581 2549 generic.go:356] "Generic (PLEG): container finished" podID="24bfa9f9-cb85-40db-add0-37736c0a3d40" containerID="adc1ecc6a6faa13ec5d413873ceed5612e1e544ac15de5280df9d0517402a5c8" exitCode=0 Jun 08 19:30:59.416047 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:59.415663 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r5pp5" event={"ID":"24bfa9f9-cb85-40db-add0-37736c0a3d40","Type":"ContainerDied","Data":"adc1ecc6a6faa13ec5d413873ceed5612e1e544ac15de5280df9d0517402a5c8"} Jun 08 19:30:59.416047 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:30:59.416024 2549 scope.go:117] "RemoveContainer" containerID="adc1ecc6a6faa13ec5d413873ceed5612e1e544ac15de5280df9d0517402a5c8" Jun 08 19:31:00.422607 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:00.422570 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r5pp5" event={"ID":"24bfa9f9-cb85-40db-add0-37736c0a3d40","Type":"ContainerStarted","Data":"57c2b52833078091eb038eac05e5ff258c81f0117078e8f7afcdc728de5e1fe9"} Jun 08 19:31:02.120302 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:02.120269 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cktnw_4df82b22-3f2a-462b-aa9a-2ec20a55f82a/dns-node-resolver/0.log" Jun 08 19:31:02.476820 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:02.476738 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" podUID="ced11cd7-0788-45f2-89a3-baba9f5e4110" containerName="registry" containerID="cri-o://e171278509d2560fb4c0356ae0d62e93f34918bfd9ac17aaaf0ceeb14d4a6f5f" gracePeriod=30 Jun 08 19:31:02.920772 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:02.920745 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4vt28_a36c67fc-408f-4321-8607-988163a9b912/serve-healthcheck-canary/0.log" Jun 08 19:31:03.522138 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:03.522108 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-gf6wf_062c65ae-d5b1-4d05-9463-3d24a4eaa87a/cluster-samples-operator/0.log" Jun 08 19:31:03.722466 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:03.722445 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-gf6wf_062c65ae-d5b1-4d05-9463-3d24a4eaa87a/cluster-samples-operator-watch/0.log" Jun 08 19:31:04.440044 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:04.440014 2549 generic.go:356] "Generic (PLEG): container finished" podID="ced11cd7-0788-45f2-89a3-baba9f5e4110" containerID="e171278509d2560fb4c0356ae0d62e93f34918bfd9ac17aaaf0ceeb14d4a6f5f" exitCode=0 Jun 08 19:31:04.440044 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:04.440050 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" event={"ID":"ced11cd7-0788-45f2-89a3-baba9f5e4110","Type":"ContainerDied","Data":"e171278509d2560fb4c0356ae0d62e93f34918bfd9ac17aaaf0ceeb14d4a6f5f"} Jun 08 19:31:04.440264 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:04.440117 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" event={"ID":"ced11cd7-0788-45f2-89a3-baba9f5e4110","Type":"ContainerStarted","Data":"a325a1d31056bdd9ab2a8e2ff11d2d80e6532aa28067a8eea74de16f1824dc80"} Jun 08 19:31:04.440264 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:04.440142 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:31:12.952869 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:31:12.952828 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8lzsn" podUID="1a9c2142-6d73-414a-bdf6-9b4662669244" Jun 08 19:31:13.475850 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:13.475816 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lzsn" Jun 08 19:31:16.375148 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:16.375113 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:31:16.377455 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:16.377429 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c2142-6d73-414a-bdf6-9b4662669244-metrics-tls\") pod \"dns-default-8lzsn\" (UID: \"1a9c2142-6d73-414a-bdf6-9b4662669244\") " pod="openshift-dns/dns-default-8lzsn" Jun 08 19:31:16.479680 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:16.479652 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2qd47\"" Jun 08 19:31:16.486956 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:16.486923 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lzsn" Jun 08 19:31:16.617281 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:16.617259 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8lzsn"] Jun 08 19:31:16.619349 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:31:16.619322 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9c2142_6d73_414a_bdf6_9b4662669244.slice/crio-ac479b31baa6a097b15ab21fe769edf40383411c45873710d56c5219d1ccf81a WatchSource:0}: Error finding container ac479b31baa6a097b15ab21fe769edf40383411c45873710d56c5219d1ccf81a: Status 404 returned error can't find the container with id ac479b31baa6a097b15ab21fe769edf40383411c45873710d56c5219d1ccf81a Jun 08 19:31:17.493331 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:17.493285 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lzsn" event={"ID":"1a9c2142-6d73-414a-bdf6-9b4662669244","Type":"ContainerStarted","Data":"ac479b31baa6a097b15ab21fe769edf40383411c45873710d56c5219d1ccf81a"} Jun 08 19:31:19.504120 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:19.504088 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lzsn" event={"ID":"1a9c2142-6d73-414a-bdf6-9b4662669244","Type":"ContainerStarted","Data":"3b58bf82a50be34c1c9fd90b1be7b379dcdef8e77eb602494ef254039bd82361"} Jun 08 19:31:19.504489 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:19.504146 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lzsn" event={"ID":"1a9c2142-6d73-414a-bdf6-9b4662669244","Type":"ContainerStarted","Data":"03a369b92139032aa9b910145a97cfc308cf7f90a249900c3dfe55b8e683f830"} Jun 08 19:31:19.504489 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:19.504219 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8lzsn" Jun 08 19:31:19.525522 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:19.525462 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8lzsn" podStartSLOduration=251.599774708 podStartE2EDuration="4m13.525442043s" totalImagesPullingTime="1.925667335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:31:19.524370291 +0000 UTC m=+287.504641301" watchObservedRunningTime="2026-06-08 19:31:19.525442043 +0000 UTC m=+287.505713055" Jun 08 19:31:21.598301 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.598257 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7dc6768fc4-7x8q4" podUID="3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" containerName="console" containerID="cri-o://8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6" gracePeriod=15 Jun 08 19:31:21.849934 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.849859 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:31:21.919084 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919051 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zztk\" (UniqueName: \"kubernetes.io/projected/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-kube-api-access-9zztk\") pod \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " Jun 08 19:31:21.919084 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919094 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-oauth-config\") pod \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " Jun 08 19:31:21.919334 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919143 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-oauth-serving-cert\") pod \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " Jun 08 19:31:21.919334 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919187 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-service-ca\") pod \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " Jun 08 19:31:21.919334 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919214 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-trusted-ca-bundle\") pod \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " Jun 08 19:31:21.919334 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919321 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-config\") pod \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " Jun 08 19:31:21.919516 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919384 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-serving-cert\") pod \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\" (UID: \"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c\") " Jun 08 19:31:21.919660 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919626 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" (UID: "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:21.919660 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919635 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-service-ca" (OuterVolumeSpecName: "service-ca") pod "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" (UID: "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:21.919774 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919638 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" (UID: "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:21.919841 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.919817 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-config" (OuterVolumeSpecName: "console-config") pod "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" (UID: "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:21.921370 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.921346 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-kube-api-access-9zztk" (OuterVolumeSpecName: "kube-api-access-9zztk") pod "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" (UID: "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c"). InnerVolumeSpecName "kube-api-access-9zztk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:31:21.921485 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.921430 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" (UID: "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:21.921485 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:21.921466 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" (UID: "3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:22.020190 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.020148 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-oauth-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:31:22.020190 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.020181 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-oauth-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:31:22.020190 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.020193 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-service-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:31:22.020432 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.020206 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-trusted-ca-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:31:22.020432 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.020241 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:31:22.020432 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.020250 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-console-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:31:22.020432 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.020258 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zztk\" (UniqueName: \"kubernetes.io/projected/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c-kube-api-access-9zztk\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:31:22.515929 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.515865 2549 generic.go:356] "Generic (PLEG): container finished" podID="3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" containerID="8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6" exitCode=0 Jun 08 19:31:22.516112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.515935 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc6768fc4-7x8q4" Jun 08 19:31:22.516112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.515949 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc6768fc4-7x8q4" event={"ID":"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c","Type":"ContainerDied","Data":"8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6"} Jun 08 19:31:22.516112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.516027 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc6768fc4-7x8q4" event={"ID":"3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c","Type":"ContainerDied","Data":"b462c5cc55fe0087e059be79fa5d92b020a7c7beebfefc9cac01218309ed960a"} Jun 08 19:31:22.516112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.516060 2549 scope.go:117] "RemoveContainer" containerID="8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6" Jun 08 19:31:22.524238 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.524223 2549 scope.go:117] "RemoveContainer" containerID="8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6" Jun 08 19:31:22.524531 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:31:22.524509 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6\": container with ID starting with 8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6 not found: ID does not exist" containerID="8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6" Jun 08 19:31:22.524584 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.524539 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6"} err="failed to get container status \"8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6\": rpc error: code = NotFound desc = could not find container \"8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6\": container with ID starting with 8757a8b19a85498d477b02656025039321ab93d43a241d4ecbb03fc044a380d6 not found: ID does not exist" Jun 08 19:31:22.532698 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.532674 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc6768fc4-7x8q4"] Jun 08 19:31:22.536539 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:22.536518 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc6768fc4-7x8q4"] Jun 08 19:31:24.468592 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:24.468553 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" path="/var/lib/kubelet/pods/3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c/volumes" Jun 08 19:31:25.448760 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:25.448731 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68cd8c5474-fk74v" Jun 08 19:31:29.510666 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.510633 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8lzsn" Jun 08 19:31:29.911230 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.911189 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-896666444-vrs2j"] Jun 08 19:31:29.911955 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.911930 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b409b0e-0efc-42d8-9a18-fcea7fd37807" containerName="console" Jun 08 19:31:29.912116 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.912105 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b409b0e-0efc-42d8-9a18-fcea7fd37807" containerName="console" Jun 08 19:31:29.912410 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.912396 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f7e9d65-0098-4d7e-ae0f-3e980975412f" containerName="registry" Jun 08 19:31:29.912512 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.912503 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f7e9d65-0098-4d7e-ae0f-3e980975412f" containerName="registry" Jun 08 19:31:29.912603 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.912594 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" containerName="console" Jun 08 19:31:29.912688 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.912679 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" containerName="console" Jun 08 19:31:29.912857 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.912847 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b409b0e-0efc-42d8-9a18-fcea7fd37807" containerName="console" Jun 08 19:31:29.912973 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.912963 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a4b7ed1-32d3-45c5-ac50-e1cfcd86c63c" containerName="console" Jun 08 19:31:29.913061 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.913052 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f7e9d65-0098-4d7e-ae0f-3e980975412f" containerName="registry" Jun 08 19:31:29.916977 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.916935 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:29.925258 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.925224 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-896666444-vrs2j"] Jun 08 19:31:29.984252 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.984216 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-console-config\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:29.984252 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.984258 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-serving-cert\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:29.984525 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.984285 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-service-ca\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:29.984525 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.984395 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmc8l\" (UniqueName: \"kubernetes.io/projected/5944cfd6-d139-4c41-8c26-a311938540b8-kube-api-access-nmc8l\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:29.984525 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.984438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-trusted-ca-bundle\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:29.984525 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.984480 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-oauth-config\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:29.984525 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:29.984518 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-oauth-serving-cert\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.085389 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.085351 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-service-ca\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.085585 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.085406 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmc8l\" (UniqueName: \"kubernetes.io/projected/5944cfd6-d139-4c41-8c26-a311938540b8-kube-api-access-nmc8l\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.085585 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.085432 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-trusted-ca-bundle\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.085585 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.085462 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-oauth-config\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.085585 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.085491 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-oauth-serving-cert\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.085585 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.085538 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-console-config\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.085585 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.085561 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-serving-cert\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.086241 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.086210 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-oauth-serving-cert\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.086362 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.086217 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-service-ca\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.086362 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.086281 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-trusted-ca-bundle\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.086473 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.086355 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-console-config\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.088044 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.088014 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-serving-cert\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.088044 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.088031 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-oauth-config\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.094503 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.094480 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmc8l\" (UniqueName: \"kubernetes.io/projected/5944cfd6-d139-4c41-8c26-a311938540b8-kube-api-access-nmc8l\") pod \"console-896666444-vrs2j\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.228413 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.228322 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:30.408365 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.408338 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-896666444-vrs2j"] Jun 08 19:31:30.411656 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:31:30.411617 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5944cfd6_d139_4c41_8c26_a311938540b8.slice/crio-0cadb03a3723c748b5a9aa1e3a63807e5da4b738438767dea11db8aec62bb8db WatchSource:0}: Error finding container 0cadb03a3723c748b5a9aa1e3a63807e5da4b738438767dea11db8aec62bb8db: Status 404 returned error can't find the container with id 0cadb03a3723c748b5a9aa1e3a63807e5da4b738438767dea11db8aec62bb8db Jun 08 19:31:30.551747 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.551710 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896666444-vrs2j" event={"ID":"5944cfd6-d139-4c41-8c26-a311938540b8","Type":"ContainerStarted","Data":"f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2"} Jun 08 19:31:30.552164 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.551764 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896666444-vrs2j" event={"ID":"5944cfd6-d139-4c41-8c26-a311938540b8","Type":"ContainerStarted","Data":"0cadb03a3723c748b5a9aa1e3a63807e5da4b738438767dea11db8aec62bb8db"} Jun 08 19:31:30.572217 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:30.572164 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-896666444-vrs2j" podStartSLOduration=1.572147689 podStartE2EDuration="1.572147689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:31:30.571194312 +0000 UTC m=+298.551465313" watchObservedRunningTime="2026-06-08 19:31:30.572147689 +0000 UTC m=+298.552418759" Jun 08 19:31:32.398808 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:32.398779 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:31:32.399831 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:32.399803 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:31:32.405861 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:32.405830 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:31:32.412860 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:32.412836 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:31:32.416982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:32.416963 2549 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 19:31:40.228860 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:40.228817 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:40.230506 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:40.228884 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:40.233697 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:40.233677 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:40.594693 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:40.594667 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-896666444-vrs2j" Jun 08 19:31:40.644007 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:31:40.643974 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6488996765-gtrp2"] Jun 08 19:32:05.664234 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.664194 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6488996765-gtrp2" podUID="76f26feb-1bd5-46e9-804d-8dca5276491c" containerName="console" containerID="cri-o://8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70" gracePeriod=15 Jun 08 19:32:05.908005 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.907982 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:32:05.977057 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.976975 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-trusted-ca-bundle\") pod \"76f26feb-1bd5-46e9-804d-8dca5276491c\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " Jun 08 19:32:05.977057 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977006 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-service-ca\") pod \"76f26feb-1bd5-46e9-804d-8dca5276491c\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " Jun 08 19:32:05.977057 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977035 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-serving-cert\") pod \"76f26feb-1bd5-46e9-804d-8dca5276491c\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " Jun 08 19:32:05.977057 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977051 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qczpr\" (UniqueName: \"kubernetes.io/projected/76f26feb-1bd5-46e9-804d-8dca5276491c-kube-api-access-qczpr\") pod \"76f26feb-1bd5-46e9-804d-8dca5276491c\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " Jun 08 19:32:05.977387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977078 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-console-config\") pod \"76f26feb-1bd5-46e9-804d-8dca5276491c\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " Jun 08 19:32:05.977387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977118 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-oauth-config\") pod \"76f26feb-1bd5-46e9-804d-8dca5276491c\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " Jun 08 19:32:05.977387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977149 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-oauth-serving-cert\") pod \"76f26feb-1bd5-46e9-804d-8dca5276491c\" (UID: \"76f26feb-1bd5-46e9-804d-8dca5276491c\") " Jun 08 19:32:05.977537 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977495 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "76f26feb-1bd5-46e9-804d-8dca5276491c" (UID: "76f26feb-1bd5-46e9-804d-8dca5276491c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:32:05.977537 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977508 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-service-ca" (OuterVolumeSpecName: "service-ca") pod "76f26feb-1bd5-46e9-804d-8dca5276491c" (UID: "76f26feb-1bd5-46e9-804d-8dca5276491c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:32:05.977616 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977556 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-console-config" (OuterVolumeSpecName: "console-config") pod "76f26feb-1bd5-46e9-804d-8dca5276491c" (UID: "76f26feb-1bd5-46e9-804d-8dca5276491c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:32:05.977661 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.977627 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "76f26feb-1bd5-46e9-804d-8dca5276491c" (UID: "76f26feb-1bd5-46e9-804d-8dca5276491c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:32:05.979430 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.979400 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76f26feb-1bd5-46e9-804d-8dca5276491c-kube-api-access-qczpr" (OuterVolumeSpecName: "kube-api-access-qczpr") pod "76f26feb-1bd5-46e9-804d-8dca5276491c" (UID: "76f26feb-1bd5-46e9-804d-8dca5276491c"). InnerVolumeSpecName "kube-api-access-qczpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:32:05.979701 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.979682 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "76f26feb-1bd5-46e9-804d-8dca5276491c" (UID: "76f26feb-1bd5-46e9-804d-8dca5276491c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:32:05.979800 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:05.979754 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "76f26feb-1bd5-46e9-804d-8dca5276491c" (UID: "76f26feb-1bd5-46e9-804d-8dca5276491c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:32:06.078285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.078239 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-trusted-ca-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:32:06.078285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.078278 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-service-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:32:06.078285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.078288 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:32:06.078285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.078297 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qczpr\" (UniqueName: \"kubernetes.io/projected/76f26feb-1bd5-46e9-804d-8dca5276491c-kube-api-access-qczpr\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:32:06.078285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.078306 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-console-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:32:06.078556 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.078315 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f26feb-1bd5-46e9-804d-8dca5276491c-console-oauth-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:32:06.078556 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.078323 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f26feb-1bd5-46e9-804d-8dca5276491c-oauth-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:32:06.684185 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.684148 2549 generic.go:356] "Generic (PLEG): container finished" podID="76f26feb-1bd5-46e9-804d-8dca5276491c" containerID="8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70" exitCode=0 Jun 08 19:32:06.684597 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.684199 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6488996765-gtrp2" event={"ID":"76f26feb-1bd5-46e9-804d-8dca5276491c","Type":"ContainerDied","Data":"8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70"} Jun 08 19:32:06.684597 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.684206 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6488996765-gtrp2" Jun 08 19:32:06.684597 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.684242 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6488996765-gtrp2" event={"ID":"76f26feb-1bd5-46e9-804d-8dca5276491c","Type":"ContainerDied","Data":"ff5977e07929d3493ae6b6e3eac73bf7ce4aaabd00221af689cfa1d0f0c9fb77"} Jun 08 19:32:06.684597 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.684265 2549 scope.go:117] "RemoveContainer" containerID="8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70" Jun 08 19:32:06.692182 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.692155 2549 scope.go:117] "RemoveContainer" containerID="8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70" Jun 08 19:32:06.692443 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:32:06.692421 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70\": container with ID starting with 8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70 not found: ID does not exist" containerID="8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70" Jun 08 19:32:06.692496 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.692452 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70"} err="failed to get container status \"8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70\": rpc error: code = NotFound desc = could not find container \"8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70\": container with ID starting with 8589ffc85d2a0292b6c5b44b44cb25894593a5d2d482a177a49493fe40aa3c70 not found: ID does not exist" Jun 08 19:32:06.708567 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.708534 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6488996765-gtrp2"] Jun 08 19:32:06.717125 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:06.717100 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6488996765-gtrp2"] Jun 08 19:32:08.468885 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:32:08.468855 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76f26feb-1bd5-46e9-804d-8dca5276491c" path="/var/lib/kubelet/pods/76f26feb-1bd5-46e9-804d-8dca5276491c/volumes" Jun 08 19:35:19.875636 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:19.875561 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-94bb447bc-zbh7d"] Jun 08 19:35:19.876103 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:19.875825 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76f26feb-1bd5-46e9-804d-8dca5276491c" containerName="console" Jun 08 19:35:19.876103 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:19.875835 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="76f26feb-1bd5-46e9-804d-8dca5276491c" containerName="console" Jun 08 19:35:19.876103 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:19.875898 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="76f26feb-1bd5-46e9-804d-8dca5276491c" containerName="console" Jun 08 19:35:19.877816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:19.877793 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:19.900242 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:19.900214 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-94bb447bc-zbh7d"] Jun 08 19:35:20.009668 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.009626 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af1a7891-be37-4ac6-ab74-8814cf8df5c2-console-serving-cert\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.009668 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.009670 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bvpb\" (UniqueName: \"kubernetes.io/projected/af1a7891-be37-4ac6-ab74-8814cf8df5c2-kube-api-access-8bvpb\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.010006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.009698 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af1a7891-be37-4ac6-ab74-8814cf8df5c2-console-oauth-config\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.010006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.009791 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-oauth-serving-cert\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.010006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.009823 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-trusted-ca-bundle\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.010006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.009852 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-service-ca\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.010006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.009879 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-console-config\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.110499 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.110463 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-oauth-serving-cert\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.110499 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.110500 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-trusted-ca-bundle\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.110714 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.110526 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-service-ca\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.110714 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.110551 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-console-config\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.110714 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.110577 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af1a7891-be37-4ac6-ab74-8814cf8df5c2-console-serving-cert\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.110714 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.110608 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bvpb\" (UniqueName: \"kubernetes.io/projected/af1a7891-be37-4ac6-ab74-8814cf8df5c2-kube-api-access-8bvpb\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.110714 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.110658 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af1a7891-be37-4ac6-ab74-8814cf8df5c2-console-oauth-config\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.111384 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.111359 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-oauth-serving-cert\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.111517 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.111477 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-trusted-ca-bundle\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.111517 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.111359 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-console-config\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.111517 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.111413 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af1a7891-be37-4ac6-ab74-8814cf8df5c2-service-ca\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.113122 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.113101 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af1a7891-be37-4ac6-ab74-8814cf8df5c2-console-serving-cert\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.113199 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.113174 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af1a7891-be37-4ac6-ab74-8814cf8df5c2-console-oauth-config\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.119040 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.119017 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bvpb\" (UniqueName: \"kubernetes.io/projected/af1a7891-be37-4ac6-ab74-8814cf8df5c2-kube-api-access-8bvpb\") pod \"console-94bb447bc-zbh7d\" (UID: \"af1a7891-be37-4ac6-ab74-8814cf8df5c2\") " pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.190992 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.190883 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:20.321172 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.321147 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-94bb447bc-zbh7d"] Jun 08 19:35:20.323621 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:35:20.323579 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1a7891_be37_4ac6_ab74_8814cf8df5c2.slice/crio-fddf51e32f37904ebce9869f30a74b316a5533ecb013381e48a5a2c7489df054 WatchSource:0}: Error finding container fddf51e32f37904ebce9869f30a74b316a5533ecb013381e48a5a2c7489df054: Status 404 returned error can't find the container with id fddf51e32f37904ebce9869f30a74b316a5533ecb013381e48a5a2c7489df054 Jun 08 19:35:20.389051 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:20.389016 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94bb447bc-zbh7d" event={"ID":"af1a7891-be37-4ac6-ab74-8814cf8df5c2","Type":"ContainerStarted","Data":"fddf51e32f37904ebce9869f30a74b316a5533ecb013381e48a5a2c7489df054"} Jun 08 19:35:21.394324 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:21.394287 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94bb447bc-zbh7d" event={"ID":"af1a7891-be37-4ac6-ab74-8814cf8df5c2","Type":"ContainerStarted","Data":"7bf8252889e4bdacb3fb3512e0e5f3742cdcadd524e0cdac9ebdbcb9d1037e21"} Jun 08 19:35:21.411397 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:21.411347 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-94bb447bc-zbh7d" podStartSLOduration=2.411331276 podStartE2EDuration="2.411331276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:35:21.411069679 +0000 UTC m=+529.391340686" watchObservedRunningTime="2026-06-08 19:35:21.411331276 +0000 UTC m=+529.391602280" Jun 08 19:35:30.191687 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:30.191587 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:30.191687 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:30.191657 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:30.196321 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:30.196298 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:30.435650 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:30.435622 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-94bb447bc-zbh7d" Jun 08 19:35:30.487889 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:30.487805 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-896666444-vrs2j"] Jun 08 19:35:55.511006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.510931 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-896666444-vrs2j" podUID="5944cfd6-d139-4c41-8c26-a311938540b8" containerName="console" containerID="cri-o://f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2" gracePeriod=15 Jun 08 19:35:55.758454 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.758428 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896666444-vrs2j" Jun 08 19:35:55.783166 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783139 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmc8l\" (UniqueName: \"kubernetes.io/projected/5944cfd6-d139-4c41-8c26-a311938540b8-kube-api-access-nmc8l\") pod \"5944cfd6-d139-4c41-8c26-a311938540b8\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " Jun 08 19:35:55.783333 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783173 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-trusted-ca-bundle\") pod \"5944cfd6-d139-4c41-8c26-a311938540b8\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " Jun 08 19:35:55.783333 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783195 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-oauth-config\") pod \"5944cfd6-d139-4c41-8c26-a311938540b8\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " Jun 08 19:35:55.783333 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783219 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-console-config\") pod \"5944cfd6-d139-4c41-8c26-a311938540b8\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " Jun 08 19:35:55.783333 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783322 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-serving-cert\") pod \"5944cfd6-d139-4c41-8c26-a311938540b8\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " Jun 08 19:35:55.783554 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783359 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-oauth-serving-cert\") pod \"5944cfd6-d139-4c41-8c26-a311938540b8\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " Jun 08 19:35:55.783554 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783393 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-service-ca\") pod \"5944cfd6-d139-4c41-8c26-a311938540b8\" (UID: \"5944cfd6-d139-4c41-8c26-a311938540b8\") " Jun 08 19:35:55.783797 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783744 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5944cfd6-d139-4c41-8c26-a311938540b8" (UID: "5944cfd6-d139-4c41-8c26-a311938540b8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:35:55.783935 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783809 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5944cfd6-d139-4c41-8c26-a311938540b8" (UID: "5944cfd6-d139-4c41-8c26-a311938540b8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:35:55.783935 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783878 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-service-ca" (OuterVolumeSpecName: "service-ca") pod "5944cfd6-d139-4c41-8c26-a311938540b8" (UID: "5944cfd6-d139-4c41-8c26-a311938540b8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:35:55.783935 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.783883 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-console-config" (OuterVolumeSpecName: "console-config") pod "5944cfd6-d139-4c41-8c26-a311938540b8" (UID: "5944cfd6-d139-4c41-8c26-a311938540b8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:35:55.785821 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.785795 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5944cfd6-d139-4c41-8c26-a311938540b8" (UID: "5944cfd6-d139-4c41-8c26-a311938540b8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:35:55.785821 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.785804 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5944cfd6-d139-4c41-8c26-a311938540b8-kube-api-access-nmc8l" (OuterVolumeSpecName: "kube-api-access-nmc8l") pod "5944cfd6-d139-4c41-8c26-a311938540b8" (UID: "5944cfd6-d139-4c41-8c26-a311938540b8"). InnerVolumeSpecName "kube-api-access-nmc8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:35:55.786055 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.786032 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5944cfd6-d139-4c41-8c26-a311938540b8" (UID: "5944cfd6-d139-4c41-8c26-a311938540b8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:35:55.884285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.884252 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmc8l\" (UniqueName: \"kubernetes.io/projected/5944cfd6-d139-4c41-8c26-a311938540b8-kube-api-access-nmc8l\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:35:55.884285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.884278 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-trusted-ca-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:35:55.884285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.884289 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-oauth-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:35:55.884285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.884298 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-console-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:35:55.884593 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.884306 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5944cfd6-d139-4c41-8c26-a311938540b8-console-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:35:55.884593 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.884315 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-oauth-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:35:55.884593 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:55.884324 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5944cfd6-d139-4c41-8c26-a311938540b8-service-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:35:56.524216 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:56.524185 2549 generic.go:356] "Generic (PLEG): container finished" podID="5944cfd6-d139-4c41-8c26-a311938540b8" containerID="f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2" exitCode=0 Jun 08 19:35:56.524697 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:56.524234 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896666444-vrs2j" Jun 08 19:35:56.524697 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:56.524273 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896666444-vrs2j" event={"ID":"5944cfd6-d139-4c41-8c26-a311938540b8","Type":"ContainerDied","Data":"f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2"} Jun 08 19:35:56.524697 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:56.524330 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896666444-vrs2j" event={"ID":"5944cfd6-d139-4c41-8c26-a311938540b8","Type":"ContainerDied","Data":"0cadb03a3723c748b5a9aa1e3a63807e5da4b738438767dea11db8aec62bb8db"} Jun 08 19:35:56.524697 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:56.524354 2549 scope.go:117] "RemoveContainer" containerID="f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2" Jun 08 19:35:56.532364 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:56.532347 2549 scope.go:117] "RemoveContainer" containerID="f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2" Jun 08 19:35:56.532593 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:35:56.532569 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2\": container with ID starting with f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2 not found: ID does not exist" containerID="f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2" Jun 08 19:35:56.532643 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:56.532604 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2"} err="failed to get container status \"f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2\": rpc error: code = NotFound desc = could not find container \"f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2\": container with ID starting with f028ecc3fa078e8e113569135345e0305d91add3adfee07467bae986bbef4ae2 not found: ID does not exist" Jun 08 19:35:56.540185 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:56.540163 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-896666444-vrs2j"] Jun 08 19:35:56.543947 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:56.543928 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-896666444-vrs2j"] Jun 08 19:35:58.468981 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:35:58.468941 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5944cfd6-d139-4c41-8c26-a311938540b8" path="/var/lib/kubelet/pods/5944cfd6-d139-4c41-8c26-a311938540b8/volumes" Jun 08 19:36:32.428685 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:36:32.428645 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:36:32.429235 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:36:32.429087 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:36:32.435047 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:36:32.435028 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:36:32.435526 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:36:32.435503 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:41:32.451181 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:41:32.451154 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:41:32.451646 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:41:32.451384 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:41:32.456982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:41:32.456961 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:41:32.457145 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:41:32.457127 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:44:04.633645 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.633612 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8"] Jun 08 19:44:04.635982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.633874 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5944cfd6-d139-4c41-8c26-a311938540b8" containerName="console" Jun 08 19:44:04.635982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.633886 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5944cfd6-d139-4c41-8c26-a311938540b8" containerName="console" Jun 08 19:44:04.635982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.633961 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5944cfd6-d139-4c41-8c26-a311938540b8" containerName="console" Jun 08 19:44:04.637085 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.637068 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.641214 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.641193 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6ckmw\"" Jun 08 19:44:04.643503 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.643482 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 19:44:04.644090 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.644068 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 19:44:04.678676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.678643 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.678825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.678701 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jr92\" (UniqueName: \"kubernetes.io/projected/c6d4fe90-d597-4c82-bf1b-9b187e341237-kube-api-access-7jr92\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.678825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.678780 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.700173 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.700146 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8"] Jun 08 19:44:04.779662 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.779633 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.779825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.779681 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jr92\" (UniqueName: \"kubernetes.io/projected/c6d4fe90-d597-4c82-bf1b-9b187e341237-kube-api-access-7jr92\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.779825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.779714 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.780076 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.780061 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.780117 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.780099 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.797564 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.797536 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jr92\" (UniqueName: \"kubernetes.io/projected/c6d4fe90-d597-4c82-bf1b-9b187e341237-kube-api-access-7jr92\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:04.946713 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:04.946621 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:05.077426 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:05.077393 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8"] Jun 08 19:44:05.080707 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:44:05.080677 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d4fe90_d597_4c82_bf1b_9b187e341237.slice/crio-1509f0fa4da7b2a4b8982008e9924d415fd793eeb158033ab5574f2ffdf03e84 WatchSource:0}: Error finding container 1509f0fa4da7b2a4b8982008e9924d415fd793eeb158033ab5574f2ffdf03e84: Status 404 returned error can't find the container with id 1509f0fa4da7b2a4b8982008e9924d415fd793eeb158033ab5574f2ffdf03e84 Jun 08 19:44:05.082619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:05.082599 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:44:05.312146 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:05.312115 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" event={"ID":"c6d4fe90-d597-4c82-bf1b-9b187e341237","Type":"ContainerStarted","Data":"1509f0fa4da7b2a4b8982008e9924d415fd793eeb158033ab5574f2ffdf03e84"} Jun 08 19:44:12.343825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:12.343791 2549 generic.go:356] "Generic (PLEG): container finished" podID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerID="7e03e4068938995ca16ab7e648670d57f8792f09990f3d02cf198b441977fb26" exitCode=0 Jun 08 19:44:12.344225 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:12.343891 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" event={"ID":"c6d4fe90-d597-4c82-bf1b-9b187e341237","Type":"ContainerDied","Data":"7e03e4068938995ca16ab7e648670d57f8792f09990f3d02cf198b441977fb26"} Jun 08 19:44:14.354416 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:14.354377 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" event={"ID":"c6d4fe90-d597-4c82-bf1b-9b187e341237","Type":"ContainerStarted","Data":"a76dce1063ea4a9594b07ebefd9466cb302e25ca9c684238a539d7add7133994"} Jun 08 19:44:15.360351 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:15.360317 2549 generic.go:356] "Generic (PLEG): container finished" podID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerID="a76dce1063ea4a9594b07ebefd9466cb302e25ca9c684238a539d7add7133994" exitCode=0 Jun 08 19:44:15.360823 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:15.360360 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" event={"ID":"c6d4fe90-d597-4c82-bf1b-9b187e341237","Type":"ContainerDied","Data":"a76dce1063ea4a9594b07ebefd9466cb302e25ca9c684238a539d7add7133994"} Jun 08 19:44:29.416425 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:29.416387 2549 generic.go:356] "Generic (PLEG): container finished" podID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerID="f9efe789669214fda6f223f1adc971a8994fa69a469c36070c598a9a81480267" exitCode=0 Jun 08 19:44:29.416790 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:29.416470 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" event={"ID":"c6d4fe90-d597-4c82-bf1b-9b187e341237","Type":"ContainerDied","Data":"f9efe789669214fda6f223f1adc971a8994fa69a469c36070c598a9a81480267"} Jun 08 19:44:30.542451 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.542417 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:30.703429 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.703339 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jr92\" (UniqueName: \"kubernetes.io/projected/c6d4fe90-d597-4c82-bf1b-9b187e341237-kube-api-access-7jr92\") pod \"c6d4fe90-d597-4c82-bf1b-9b187e341237\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " Jun 08 19:44:30.703429 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.703398 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-util\") pod \"c6d4fe90-d597-4c82-bf1b-9b187e341237\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " Jun 08 19:44:30.703429 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.703421 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-bundle\") pod \"c6d4fe90-d597-4c82-bf1b-9b187e341237\" (UID: \"c6d4fe90-d597-4c82-bf1b-9b187e341237\") " Jun 08 19:44:30.704165 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.704141 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-bundle" (OuterVolumeSpecName: "bundle") pod "c6d4fe90-d597-4c82-bf1b-9b187e341237" (UID: "c6d4fe90-d597-4c82-bf1b-9b187e341237"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:44:30.705617 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.705586 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6d4fe90-d597-4c82-bf1b-9b187e341237-kube-api-access-7jr92" (OuterVolumeSpecName: "kube-api-access-7jr92") pod "c6d4fe90-d597-4c82-bf1b-9b187e341237" (UID: "c6d4fe90-d597-4c82-bf1b-9b187e341237"). InnerVolumeSpecName "kube-api-access-7jr92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:44:30.708257 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.708235 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-util" (OuterVolumeSpecName: "util") pod "c6d4fe90-d597-4c82-bf1b-9b187e341237" (UID: "c6d4fe90-d597-4c82-bf1b-9b187e341237"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:44:30.804985 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.804952 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jr92\" (UniqueName: \"kubernetes.io/projected/c6d4fe90-d597-4c82-bf1b-9b187e341237-kube-api-access-7jr92\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:44:30.804985 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.804981 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:44:30.804985 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:30.804991 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6d4fe90-d597-4c82-bf1b-9b187e341237-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:44:31.425979 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:31.425947 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" event={"ID":"c6d4fe90-d597-4c82-bf1b-9b187e341237","Type":"ContainerDied","Data":"1509f0fa4da7b2a4b8982008e9924d415fd793eeb158033ab5574f2ffdf03e84"} Jun 08 19:44:31.426155 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:31.425993 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1509f0fa4da7b2a4b8982008e9924d415fd793eeb158033ab5574f2ffdf03e84" Jun 08 19:44:31.426155 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:31.426046 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpzcw8" Jun 08 19:44:37.566893 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.566860 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8"] Jun 08 19:44:37.567369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.567138 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerName="pull" Jun 08 19:44:37.567369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.567150 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerName="pull" Jun 08 19:44:37.567369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.567162 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerName="util" Jun 08 19:44:37.567369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.567168 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerName="util" Jun 08 19:44:37.567369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.567173 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerName="extract" Jun 08 19:44:37.567369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.567179 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerName="extract" Jun 08 19:44:37.567369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.567222 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6d4fe90-d597-4c82-bf1b-9b187e341237" containerName="extract" Jun 08 19:44:37.570151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.570135 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" Jun 08 19:44:37.572769 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.572713 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zb7k7\"" Jun 08 19:44:37.572899 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.572837 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:44:37.572899 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.572879 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 19:44:37.588271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.588248 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8"] Jun 08 19:44:37.659855 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.659825 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86nt9\" (UniqueName: \"kubernetes.io/projected/28219872-07e5-43f5-b10d-52c8201c518c-kube-api-access-86nt9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-42hd8\" (UID: \"28219872-07e5-43f5-b10d-52c8201c518c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" Jun 08 19:44:37.660065 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.659871 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28219872-07e5-43f5-b10d-52c8201c518c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-42hd8\" (UID: \"28219872-07e5-43f5-b10d-52c8201c518c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" Jun 08 19:44:37.760565 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.760518 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nt9\" (UniqueName: \"kubernetes.io/projected/28219872-07e5-43f5-b10d-52c8201c518c-kube-api-access-86nt9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-42hd8\" (UID: \"28219872-07e5-43f5-b10d-52c8201c518c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" Jun 08 19:44:37.760769 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.760588 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28219872-07e5-43f5-b10d-52c8201c518c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-42hd8\" (UID: \"28219872-07e5-43f5-b10d-52c8201c518c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" Jun 08 19:44:37.761040 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.761018 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28219872-07e5-43f5-b10d-52c8201c518c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-42hd8\" (UID: \"28219872-07e5-43f5-b10d-52c8201c518c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" Jun 08 19:44:37.771889 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.771857 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86nt9\" (UniqueName: \"kubernetes.io/projected/28219872-07e5-43f5-b10d-52c8201c518c-kube-api-access-86nt9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-42hd8\" (UID: \"28219872-07e5-43f5-b10d-52c8201c518c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" Jun 08 19:44:37.879368 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:37.879267 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" Jun 08 19:44:38.010399 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:38.010372 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8"] Jun 08 19:44:38.013178 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:44:38.013153 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28219872_07e5_43f5_b10d_52c8201c518c.slice/crio-66664323ceb06d1b8af9168e43f32e66b6b424a546fd4c3bb806e3bb68110fb6 WatchSource:0}: Error finding container 66664323ceb06d1b8af9168e43f32e66b6b424a546fd4c3bb806e3bb68110fb6: Status 404 returned error can't find the container with id 66664323ceb06d1b8af9168e43f32e66b6b424a546fd4c3bb806e3bb68110fb6 Jun 08 19:44:38.455730 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:38.455697 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" event={"ID":"28219872-07e5-43f5-b10d-52c8201c518c","Type":"ContainerStarted","Data":"66664323ceb06d1b8af9168e43f32e66b6b424a546fd4c3bb806e3bb68110fb6"} Jun 08 19:44:40.469247 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:40.469211 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" event={"ID":"28219872-07e5-43f5-b10d-52c8201c518c","Type":"ContainerStarted","Data":"82ccad443ede17978cb32e2fc6b465c35a92eee1fee27e29f281fb37fd28039a"} Jun 08 19:44:40.489801 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:40.489747 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-42hd8" podStartSLOduration=1.857354275 podStartE2EDuration="3.489729997s" totalImagesPullingTime="1.632375722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:44:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:44:40.487514901 +0000 UTC m=+1088.467785911" watchObservedRunningTime="2026-06-08 19:44:40.489729997 +0000 UTC m=+1088.470001007" Jun 08 19:44:41.724822 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.724782 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j"] Jun 08 19:44:41.748454 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.748426 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j"] Jun 08 19:44:41.748625 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.748547 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:41.751455 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.751433 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 19:44:41.751597 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.751433 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 19:44:41.751597 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.751433 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6ckmw\"" Jun 08 19:44:41.894961 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.894894 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnznn\" (UniqueName: \"kubernetes.io/projected/983effba-ae1e-4720-9050-f788c6c77cdf-kube-api-access-jnznn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:41.894961 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.894959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:41.895172 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.895030 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:41.996050 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.995969 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnznn\" (UniqueName: \"kubernetes.io/projected/983effba-ae1e-4720-9050-f788c6c77cdf-kube-api-access-jnznn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:41.996050 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.996006 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:41.996050 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.996031 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:41.996357 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.996341 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:41.996397 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:41.996377 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:42.004290 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:42.004260 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnznn\" (UniqueName: \"kubernetes.io/projected/983effba-ae1e-4720-9050-f788c6c77cdf-kube-api-access-jnznn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:42.057831 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:42.057802 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:42.205364 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:42.205336 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j"] Jun 08 19:44:42.207557 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:44:42.207529 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983effba_ae1e_4720_9050_f788c6c77cdf.slice/crio-62ca47a8b42edb61dc71529cc128e7ae2a755cf7f56600fb36ec408925b95795 WatchSource:0}: Error finding container 62ca47a8b42edb61dc71529cc128e7ae2a755cf7f56600fb36ec408925b95795: Status 404 returned error can't find the container with id 62ca47a8b42edb61dc71529cc128e7ae2a755cf7f56600fb36ec408925b95795 Jun 08 19:44:42.477810 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:42.477778 2549 generic.go:356] "Generic (PLEG): container finished" podID="983effba-ae1e-4720-9050-f788c6c77cdf" containerID="049d280b03c7c7faf26622c4d87665de3c69743fc9e3156b3a2fb606de32759a" exitCode=0 Jun 08 19:44:42.478005 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:42.477863 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" event={"ID":"983effba-ae1e-4720-9050-f788c6c77cdf","Type":"ContainerDied","Data":"049d280b03c7c7faf26622c4d87665de3c69743fc9e3156b3a2fb606de32759a"} Jun 08 19:44:42.478005 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:42.477939 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" event={"ID":"983effba-ae1e-4720-9050-f788c6c77cdf","Type":"ContainerStarted","Data":"62ca47a8b42edb61dc71529cc128e7ae2a755cf7f56600fb36ec408925b95795"} Jun 08 19:44:43.381133 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.381050 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-72xdm"] Jun 08 19:44:43.383932 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.383889 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:44:43.386625 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.386603 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pts6s\"" Jun 08 19:44:43.386758 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.386602 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 19:44:43.387795 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.387778 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 19:44:43.393886 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.393861 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-72xdm"] Jun 08 19:44:43.507411 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.507375 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6dbdf527-ce69-456f-8c72-fa8dffb7f103-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-72xdm\" (UID: \"6dbdf527-ce69-456f-8c72-fa8dffb7f103\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:44:43.507548 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.507414 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj5hh\" (UniqueName: \"kubernetes.io/projected/6dbdf527-ce69-456f-8c72-fa8dffb7f103-kube-api-access-lj5hh\") pod \"cert-manager-webhook-7dc76cbb94-72xdm\" (UID: \"6dbdf527-ce69-456f-8c72-fa8dffb7f103\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:44:43.608886 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.608848 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6dbdf527-ce69-456f-8c72-fa8dffb7f103-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-72xdm\" (UID: \"6dbdf527-ce69-456f-8c72-fa8dffb7f103\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:44:43.609151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.608894 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj5hh\" (UniqueName: \"kubernetes.io/projected/6dbdf527-ce69-456f-8c72-fa8dffb7f103-kube-api-access-lj5hh\") pod \"cert-manager-webhook-7dc76cbb94-72xdm\" (UID: \"6dbdf527-ce69-456f-8c72-fa8dffb7f103\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:44:43.617799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.617762 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6dbdf527-ce69-456f-8c72-fa8dffb7f103-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-72xdm\" (UID: \"6dbdf527-ce69-456f-8c72-fa8dffb7f103\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:44:43.617799 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.617778 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj5hh\" (UniqueName: \"kubernetes.io/projected/6dbdf527-ce69-456f-8c72-fa8dffb7f103-kube-api-access-lj5hh\") pod \"cert-manager-webhook-7dc76cbb94-72xdm\" (UID: \"6dbdf527-ce69-456f-8c72-fa8dffb7f103\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:44:43.703401 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.703318 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:44:43.855684 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:43.855653 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-72xdm"] Jun 08 19:44:43.858083 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:44:43.858057 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dbdf527_ce69_456f_8c72_fa8dffb7f103.slice/crio-3bcc73c6dec011d7b703131e23fb08d8ec587e89c4ffab479169bcf08cf74203 WatchSource:0}: Error finding container 3bcc73c6dec011d7b703131e23fb08d8ec587e89c4ffab479169bcf08cf74203: Status 404 returned error can't find the container with id 3bcc73c6dec011d7b703131e23fb08d8ec587e89c4ffab479169bcf08cf74203 Jun 08 19:44:44.063212 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.063180 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-chrfv"] Jun 08 19:44:44.069215 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.069189 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" Jun 08 19:44:44.071802 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.071735 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xpf7g\"" Jun 08 19:44:44.076307 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.076278 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-chrfv"] Jun 08 19:44:44.214779 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.214725 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d98t9\" (UniqueName: \"kubernetes.io/projected/aa2253ad-2c8d-4bb6-935d-2c2d6a208a41-kube-api-access-d98t9\") pod \"cert-manager-cainjector-5d99449ffd-chrfv\" (UID: \"aa2253ad-2c8d-4bb6-935d-2c2d6a208a41\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" Jun 08 19:44:44.214995 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.214933 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa2253ad-2c8d-4bb6-935d-2c2d6a208a41-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-chrfv\" (UID: \"aa2253ad-2c8d-4bb6-935d-2c2d6a208a41\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" Jun 08 19:44:44.316960 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.316465 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa2253ad-2c8d-4bb6-935d-2c2d6a208a41-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-chrfv\" (UID: \"aa2253ad-2c8d-4bb6-935d-2c2d6a208a41\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" Jun 08 19:44:44.316960 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.316525 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d98t9\" (UniqueName: \"kubernetes.io/projected/aa2253ad-2c8d-4bb6-935d-2c2d6a208a41-kube-api-access-d98t9\") pod \"cert-manager-cainjector-5d99449ffd-chrfv\" (UID: \"aa2253ad-2c8d-4bb6-935d-2c2d6a208a41\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" Jun 08 19:44:44.326441 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.326378 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d98t9\" (UniqueName: \"kubernetes.io/projected/aa2253ad-2c8d-4bb6-935d-2c2d6a208a41-kube-api-access-d98t9\") pod \"cert-manager-cainjector-5d99449ffd-chrfv\" (UID: \"aa2253ad-2c8d-4bb6-935d-2c2d6a208a41\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" Jun 08 19:44:44.326441 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.326433 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa2253ad-2c8d-4bb6-935d-2c2d6a208a41-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-chrfv\" (UID: \"aa2253ad-2c8d-4bb6-935d-2c2d6a208a41\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" Jun 08 19:44:44.381699 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.381662 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" Jun 08 19:44:44.489246 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.489202 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" event={"ID":"6dbdf527-ce69-456f-8c72-fa8dffb7f103","Type":"ContainerStarted","Data":"3bcc73c6dec011d7b703131e23fb08d8ec587e89c4ffab479169bcf08cf74203"} Jun 08 19:44:44.733956 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:44.733903 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-chrfv"] Jun 08 19:44:44.735623 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:44:44.735599 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa2253ad_2c8d_4bb6_935d_2c2d6a208a41.slice/crio-c8342e8025252109c7ff06d0a593e2e0fa3678e88054f39469ff73c005e2ea7c WatchSource:0}: Error finding container c8342e8025252109c7ff06d0a593e2e0fa3678e88054f39469ff73c005e2ea7c: Status 404 returned error can't find the container with id c8342e8025252109c7ff06d0a593e2e0fa3678e88054f39469ff73c005e2ea7c Jun 08 19:44:45.497245 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:45.497209 2549 generic.go:356] "Generic (PLEG): container finished" podID="983effba-ae1e-4720-9050-f788c6c77cdf" containerID="6b705cdf6c7ff3b926810633d75319c03d79c4ec8f6027c44cd2661ed79c7d94" exitCode=0 Jun 08 19:44:45.497734 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:45.497249 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" event={"ID":"983effba-ae1e-4720-9050-f788c6c77cdf","Type":"ContainerDied","Data":"6b705cdf6c7ff3b926810633d75319c03d79c4ec8f6027c44cd2661ed79c7d94"} Jun 08 19:44:45.498725 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:45.498698 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" event={"ID":"aa2253ad-2c8d-4bb6-935d-2c2d6a208a41","Type":"ContainerStarted","Data":"c8342e8025252109c7ff06d0a593e2e0fa3678e88054f39469ff73c005e2ea7c"} Jun 08 19:44:46.506274 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:46.506237 2549 generic.go:356] "Generic (PLEG): container finished" podID="983effba-ae1e-4720-9050-f788c6c77cdf" containerID="9deed08d128914a0314e9d4dd8ed40c61c0bfaf863a380ebb5c7665c2fc9ff80" exitCode=0 Jun 08 19:44:46.506687 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:46.506275 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" event={"ID":"983effba-ae1e-4720-9050-f788c6c77cdf","Type":"ContainerDied","Data":"9deed08d128914a0314e9d4dd8ed40c61c0bfaf863a380ebb5c7665c2fc9ff80"} Jun 08 19:44:47.511860 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.511823 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" event={"ID":"6dbdf527-ce69-456f-8c72-fa8dffb7f103","Type":"ContainerStarted","Data":"af2660bc8f705f16ea2c5bcce4b6a80e3cb40c284828c9d72ca3ed297fd96c35"} Jun 08 19:44:47.512285 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.511871 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:44:47.513405 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.513372 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" event={"ID":"aa2253ad-2c8d-4bb6-935d-2c2d6a208a41","Type":"ContainerStarted","Data":"3802c551fd9b2a31d506a3fd67df78457ca925479c52374d8f97a4d4545a3a39"} Jun 08 19:44:47.529106 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.529056 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" podStartSLOduration=1.581243564 podStartE2EDuration="4.529033516s" totalImagesPullingTime="2.947789952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:44:47.528084098 +0000 UTC m=+1095.508355110" watchObservedRunningTime="2026-06-08 19:44:47.529033516 +0000 UTC m=+1095.509304526" Jun 08 19:44:47.545944 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.545497 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-chrfv" podStartSLOduration=1.480130886 podStartE2EDuration="3.545478275s" totalImagesPullingTime="2.065347389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:44:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:44:47.543705164 +0000 UTC m=+1095.523976176" watchObservedRunningTime="2026-06-08 19:44:47.545478275 +0000 UTC m=+1095.525749287" Jun 08 19:44:47.639670 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.639644 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:47.747664 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.747629 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnznn\" (UniqueName: \"kubernetes.io/projected/983effba-ae1e-4720-9050-f788c6c77cdf-kube-api-access-jnznn\") pod \"983effba-ae1e-4720-9050-f788c6c77cdf\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " Jun 08 19:44:47.747824 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.747683 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-util\") pod \"983effba-ae1e-4720-9050-f788c6c77cdf\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " Jun 08 19:44:47.747824 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.747720 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-bundle\") pod \"983effba-ae1e-4720-9050-f788c6c77cdf\" (UID: \"983effba-ae1e-4720-9050-f788c6c77cdf\") " Jun 08 19:44:47.748154 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.748122 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-bundle" (OuterVolumeSpecName: "bundle") pod "983effba-ae1e-4720-9050-f788c6c77cdf" (UID: "983effba-ae1e-4720-9050-f788c6c77cdf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:44:47.749785 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.749763 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/983effba-ae1e-4720-9050-f788c6c77cdf-kube-api-access-jnznn" (OuterVolumeSpecName: "kube-api-access-jnznn") pod "983effba-ae1e-4720-9050-f788c6c77cdf" (UID: "983effba-ae1e-4720-9050-f788c6c77cdf"). InnerVolumeSpecName "kube-api-access-jnznn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:44:47.751557 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.751522 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-util" (OuterVolumeSpecName: "util") pod "983effba-ae1e-4720-9050-f788c6c77cdf" (UID: "983effba-ae1e-4720-9050-f788c6c77cdf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:44:47.848464 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.848434 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:44:47.848464 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.848459 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnznn\" (UniqueName: \"kubernetes.io/projected/983effba-ae1e-4720-9050-f788c6c77cdf-kube-api-access-jnznn\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:44:47.848464 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:47.848469 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/983effba-ae1e-4720-9050-f788c6c77cdf-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:44:48.519288 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:48.519254 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" Jun 08 19:44:48.519288 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:48.519269 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz4q5j" event={"ID":"983effba-ae1e-4720-9050-f788c6c77cdf","Type":"ContainerDied","Data":"62ca47a8b42edb61dc71529cc128e7ae2a755cf7f56600fb36ec408925b95795"} Jun 08 19:44:48.519706 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:48.519311 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62ca47a8b42edb61dc71529cc128e7ae2a755cf7f56600fb36ec408925b95795" Jun 08 19:44:53.521312 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:44:53.521283 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-72xdm" Jun 08 19:45:01.168387 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.168349 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8"] Jun 08 19:45:01.168773 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.168619 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="983effba-ae1e-4720-9050-f788c6c77cdf" containerName="util" Jun 08 19:45:01.168773 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.168629 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="983effba-ae1e-4720-9050-f788c6c77cdf" containerName="util" Jun 08 19:45:01.168773 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.168637 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="983effba-ae1e-4720-9050-f788c6c77cdf" containerName="extract" Jun 08 19:45:01.168773 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.168643 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="983effba-ae1e-4720-9050-f788c6c77cdf" containerName="extract" Jun 08 19:45:01.168773 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.168654 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="983effba-ae1e-4720-9050-f788c6c77cdf" containerName="pull" Jun 08 19:45:01.168773 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.168659 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="983effba-ae1e-4720-9050-f788c6c77cdf" containerName="pull" Jun 08 19:45:01.168773 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.168707 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="983effba-ae1e-4720-9050-f788c6c77cdf" containerName="extract" Jun 08 19:45:01.217926 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.217831 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8"] Jun 08 19:45:01.218098 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.217959 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.220676 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.220650 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 19:45:01.221803 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.221750 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6ckmw\"" Jun 08 19:45:01.221803 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.221762 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 19:45:01.251493 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.251462 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.251665 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.251500 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8chdc\" (UniqueName: \"kubernetes.io/projected/80d7de16-fecc-4927-9f06-0bd535fd91e7-kube-api-access-8chdc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.251665 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.251560 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.352989 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.352950 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.353175 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.353012 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.353175 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.353039 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8chdc\" (UniqueName: \"kubernetes.io/projected/80d7de16-fecc-4927-9f06-0bd535fd91e7-kube-api-access-8chdc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.353357 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.353333 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.353420 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.353392 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.361714 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.361681 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8chdc\" (UniqueName: \"kubernetes.io/projected/80d7de16-fecc-4927-9f06-0bd535fd91e7-kube-api-access-8chdc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.527087 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.527006 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:01.680125 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:01.680087 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8"] Jun 08 19:45:01.682280 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:45:01.682250 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d7de16_fecc_4927_9f06_0bd535fd91e7.slice/crio-1fad307377844ebca9f392cb9cfb4a23c704fd5dca02889030ab69978c6e273d WatchSource:0}: Error finding container 1fad307377844ebca9f392cb9cfb4a23c704fd5dca02889030ab69978c6e273d: Status 404 returned error can't find the container with id 1fad307377844ebca9f392cb9cfb4a23c704fd5dca02889030ab69978c6e273d Jun 08 19:45:02.580173 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:02.580141 2549 generic.go:356] "Generic (PLEG): container finished" podID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerID="66636fc505a5a4a552fefa44f8d13e2752fdab0493cb908e2dbd5d437a139595" exitCode=0 Jun 08 19:45:02.580695 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:02.580221 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" event={"ID":"80d7de16-fecc-4927-9f06-0bd535fd91e7","Type":"ContainerDied","Data":"66636fc505a5a4a552fefa44f8d13e2752fdab0493cb908e2dbd5d437a139595"} Jun 08 19:45:02.580695 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:02.580269 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" event={"ID":"80d7de16-fecc-4927-9f06-0bd535fd91e7","Type":"ContainerStarted","Data":"1fad307377844ebca9f392cb9cfb4a23c704fd5dca02889030ab69978c6e273d"} Jun 08 19:45:03.587105 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:03.587071 2549 generic.go:356] "Generic (PLEG): container finished" podID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerID="863513996ddd70316f46b7f7b5681d68ce25c7c804a82dd2c8aca7bcdcceaea3" exitCode=0 Jun 08 19:45:03.587449 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:03.587122 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" event={"ID":"80d7de16-fecc-4927-9f06-0bd535fd91e7","Type":"ContainerDied","Data":"863513996ddd70316f46b7f7b5681d68ce25c7c804a82dd2c8aca7bcdcceaea3"} Jun 08 19:45:04.593632 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:04.593597 2549 generic.go:356] "Generic (PLEG): container finished" podID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerID="1419cef2c4b5ce7d4c47c845db3b8c35eb644e0072f44f22052da1a985f0e1b6" exitCode=0 Jun 08 19:45:04.594058 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:04.593678 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" event={"ID":"80d7de16-fecc-4927-9f06-0bd535fd91e7","Type":"ContainerDied","Data":"1419cef2c4b5ce7d4c47c845db3b8c35eb644e0072f44f22052da1a985f0e1b6"} Jun 08 19:45:05.719579 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.719552 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:05.786696 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.786661 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8chdc\" (UniqueName: \"kubernetes.io/projected/80d7de16-fecc-4927-9f06-0bd535fd91e7-kube-api-access-8chdc\") pod \"80d7de16-fecc-4927-9f06-0bd535fd91e7\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " Jun 08 19:45:05.786867 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.786715 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-bundle\") pod \"80d7de16-fecc-4927-9f06-0bd535fd91e7\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " Jun 08 19:45:05.786867 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.786746 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-util\") pod \"80d7de16-fecc-4927-9f06-0bd535fd91e7\" (UID: \"80d7de16-fecc-4927-9f06-0bd535fd91e7\") " Jun 08 19:45:05.787436 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.787412 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-bundle" (OuterVolumeSpecName: "bundle") pod "80d7de16-fecc-4927-9f06-0bd535fd91e7" (UID: "80d7de16-fecc-4927-9f06-0bd535fd91e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:45:05.788901 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.788873 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d7de16-fecc-4927-9f06-0bd535fd91e7-kube-api-access-8chdc" (OuterVolumeSpecName: "kube-api-access-8chdc") pod "80d7de16-fecc-4927-9f06-0bd535fd91e7" (UID: "80d7de16-fecc-4927-9f06-0bd535fd91e7"). InnerVolumeSpecName "kube-api-access-8chdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:45:05.792578 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.792548 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-util" (OuterVolumeSpecName: "util") pod "80d7de16-fecc-4927-9f06-0bd535fd91e7" (UID: "80d7de16-fecc-4927-9f06-0bd535fd91e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:45:05.888016 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.887893 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:45:05.888016 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.887960 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d7de16-fecc-4927-9f06-0bd535fd91e7-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:45:05.888016 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:05.887973 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8chdc\" (UniqueName: \"kubernetes.io/projected/80d7de16-fecc-4927-9f06-0bd535fd91e7-kube-api-access-8chdc\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:45:06.604248 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:06.604217 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" Jun 08 19:45:06.604248 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:06.604237 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddjft8" event={"ID":"80d7de16-fecc-4927-9f06-0bd535fd91e7","Type":"ContainerDied","Data":"1fad307377844ebca9f392cb9cfb4a23c704fd5dca02889030ab69978c6e273d"} Jun 08 19:45:06.604463 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:06.604282 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fad307377844ebca9f392cb9cfb4a23c704fd5dca02889030ab69978c6e273d" Jun 08 19:45:10.963446 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.963412 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9"] Jun 08 19:45:10.963926 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.963690 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerName="pull" Jun 08 19:45:10.963926 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.963702 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerName="pull" Jun 08 19:45:10.963926 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.963713 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerName="extract" Jun 08 19:45:10.963926 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.963718 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerName="extract" Jun 08 19:45:10.963926 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.963737 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerName="util" Jun 08 19:45:10.963926 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.963742 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerName="util" Jun 08 19:45:10.963926 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.963787 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d7de16-fecc-4927-9f06-0bd535fd91e7" containerName="extract" Jun 08 19:45:10.966031 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.966014 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:10.970030 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.969997 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 19:45:10.970030 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.970021 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 19:45:10.970030 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.970029 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 19:45:10.970250 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.970066 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k25gf\"" Jun 08 19:45:10.970250 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.970071 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 19:45:10.970250 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.970088 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:45:10.979315 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:10.979287 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9"] Jun 08 19:45:11.044679 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.044644 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-cert\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.044862 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.044707 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-manager-config\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.044862 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.044777 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-metrics-cert\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.044862 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.044835 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59pt4\" (UniqueName: \"kubernetes.io/projected/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-kube-api-access-59pt4\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.145255 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.145220 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-manager-config\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.145415 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.145263 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-metrics-cert\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.145415 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.145310 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59pt4\" (UniqueName: \"kubernetes.io/projected/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-kube-api-access-59pt4\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.145415 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.145342 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-cert\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.146007 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.145981 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-manager-config\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.147752 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.147730 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-metrics-cert\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.147752 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.147739 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-cert\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.179664 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.179640 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59pt4\" (UniqueName: \"kubernetes.io/projected/45890e7e-979a-45a9-a217-b8fcd8ae3b6a-kube-api-access-59pt4\") pod \"lws-controller-manager-c5d7bcdc4-hwlw9\" (UID: \"45890e7e-979a-45a9-a217-b8fcd8ae3b6a\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.275214 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.275126 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:11.460333 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.460306 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9"] Jun 08 19:45:11.461789 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:45:11.461765 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45890e7e_979a_45a9_a217_b8fcd8ae3b6a.slice/crio-8257fb2629e98707f572f9e468d741e607810d7210917ce87353d34ddc7523a3 WatchSource:0}: Error finding container 8257fb2629e98707f572f9e468d741e607810d7210917ce87353d34ddc7523a3: Status 404 returned error can't find the container with id 8257fb2629e98707f572f9e468d741e607810d7210917ce87353d34ddc7523a3 Jun 08 19:45:11.636076 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:11.636037 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" event={"ID":"45890e7e-979a-45a9-a217-b8fcd8ae3b6a","Type":"ContainerStarted","Data":"8257fb2629e98707f572f9e468d741e607810d7210917ce87353d34ddc7523a3"} Jun 08 19:45:13.571317 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.571282 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v"] Jun 08 19:45:13.573620 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.573603 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.578686 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.578655 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b26jb\"" Jun 08 19:45:13.578831 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.578690 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 19:45:13.578981 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.578963 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 19:45:13.579103 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.579088 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 19:45:13.586156 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.586134 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 19:45:13.646357 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.646327 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" event={"ID":"45890e7e-979a-45a9-a217-b8fcd8ae3b6a","Type":"ContainerStarted","Data":"2642992d51ccfcac2f91fb078f9521361c0a5bff5fb3870ee44928241706cd15"} Jun 08 19:45:13.646531 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.646376 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:13.652226 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.652200 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v"] Jun 08 19:45:13.666763 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.666737 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9abf0212-2cde-4e6b-a50e-efeda3146aa3-tmp\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.666901 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.666776 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9abf0212-2cde-4e6b-a50e-efeda3146aa3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.666901 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.666795 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9abf0212-2cde-4e6b-a50e-efeda3146aa3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.666901 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.666813 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vb49\" (UniqueName: \"kubernetes.io/projected/9abf0212-2cde-4e6b-a50e-efeda3146aa3-kube-api-access-7vb49\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.666901 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.666847 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9abf0212-2cde-4e6b-a50e-efeda3146aa3-manifests\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.768188 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.768106 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9abf0212-2cde-4e6b-a50e-efeda3146aa3-tmp\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.768366 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.768253 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9abf0212-2cde-4e6b-a50e-efeda3146aa3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.768366 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.768288 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9abf0212-2cde-4e6b-a50e-efeda3146aa3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.768366 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.768318 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vb49\" (UniqueName: \"kubernetes.io/projected/9abf0212-2cde-4e6b-a50e-efeda3146aa3-kube-api-access-7vb49\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.768531 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.768380 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9abf0212-2cde-4e6b-a50e-efeda3146aa3-manifests\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.768887 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.768857 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9abf0212-2cde-4e6b-a50e-efeda3146aa3-manifests\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.770372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.770352 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9abf0212-2cde-4e6b-a50e-efeda3146aa3-tmp\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.770710 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.770683 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9abf0212-2cde-4e6b-a50e-efeda3146aa3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.770865 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.770841 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9abf0212-2cde-4e6b-a50e-efeda3146aa3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.783174 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.783123 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" podStartSLOduration=1.82401974 podStartE2EDuration="3.783103173s" totalImagesPullingTime="1.959083433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:13.78276948 +0000 UTC m=+1121.763040492" watchObservedRunningTime="2026-06-08 19:45:13.783103173 +0000 UTC m=+1121.763374189" Jun 08 19:45:13.789775 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.789746 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vb49\" (UniqueName: \"kubernetes.io/projected/9abf0212-2cde-4e6b-a50e-efeda3146aa3-kube-api-access-7vb49\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-c6f5v\" (UID: \"9abf0212-2cde-4e6b-a50e-efeda3146aa3\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:13.884084 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:13.884047 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:14.043236 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:14.043208 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v"] Jun 08 19:45:14.045707 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:45:14.045680 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9abf0212_2cde_4e6b_a50e_efeda3146aa3.slice/crio-200178ce16bd4e048ffe586b8b56b8f665feec5cfbdd878462b489a50beadd91 WatchSource:0}: Error finding container 200178ce16bd4e048ffe586b8b56b8f665feec5cfbdd878462b489a50beadd91: Status 404 returned error can't find the container with id 200178ce16bd4e048ffe586b8b56b8f665feec5cfbdd878462b489a50beadd91 Jun 08 19:45:14.654237 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:14.654146 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" event={"ID":"9abf0212-2cde-4e6b-a50e-efeda3146aa3","Type":"ContainerStarted","Data":"200178ce16bd4e048ffe586b8b56b8f665feec5cfbdd878462b489a50beadd91"} Jun 08 19:45:17.672426 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:17.672388 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" event={"ID":"9abf0212-2cde-4e6b-a50e-efeda3146aa3","Type":"ContainerStarted","Data":"44f8628185f1b78075b588c1d8bfe937d957ddd915fb6f8212204bd7f074f3d9"} Jun 08 19:45:18.678598 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:18.678560 2549 generic.go:356] "Generic (PLEG): container finished" podID="9abf0212-2cde-4e6b-a50e-efeda3146aa3" containerID="44f8628185f1b78075b588c1d8bfe937d957ddd915fb6f8212204bd7f074f3d9" exitCode=0 Jun 08 19:45:18.678988 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:18.678646 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" event={"ID":"9abf0212-2cde-4e6b-a50e-efeda3146aa3","Type":"ContainerDied","Data":"44f8628185f1b78075b588c1d8bfe937d957ddd915fb6f8212204bd7f074f3d9"} Jun 08 19:45:19.685521 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:19.685489 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" event={"ID":"9abf0212-2cde-4e6b-a50e-efeda3146aa3","Type":"ContainerStarted","Data":"984cb87f5db1b4d9f7820fb996c8f0eb0349d7e6d87361d2acf097e1ec29abcf"} Jun 08 19:45:19.685886 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:19.685626 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:19.716541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:19.716481 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" podStartSLOduration=2.568757361 podStartE2EDuration="6.716465475s" totalImagesPullingTime="3.136981513s" totalInitContainerRuntime="1.010726601s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:19.715999651 +0000 UTC m=+1127.696270662" watchObservedRunningTime="2026-06-08 19:45:19.716465475 +0000 UTC m=+1127.696736487" Jun 08 19:45:24.656726 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:24.656692 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-hwlw9" Jun 08 19:45:30.692706 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:30.692675 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-c6f5v" Jun 08 19:45:36.993968 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:36.993929 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4"] Jun 08 19:45:37.000067 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.000042 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.003441 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.003419 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 19:45:37.004179 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.004159 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6ckmw\"" Jun 08 19:45:37.004833 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.004816 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 19:45:37.021373 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.021342 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4"] Jun 08 19:45:37.072310 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.072275 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.072495 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.072356 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.072495 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.072412 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dphqp\" (UniqueName: \"kubernetes.io/projected/33645c90-a6a0-405e-9798-ff251fbc9ddd-kube-api-access-dphqp\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.172859 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.172810 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dphqp\" (UniqueName: \"kubernetes.io/projected/33645c90-a6a0-405e-9798-ff251fbc9ddd-kube-api-access-dphqp\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.173079 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.172870 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.173079 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.172903 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.173407 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.173381 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.173472 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.173388 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.187419 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.187391 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dphqp\" (UniqueName: \"kubernetes.io/projected/33645c90-a6a0-405e-9798-ff251fbc9ddd-kube-api-access-dphqp\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.309774 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.309741 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:37.476029 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.475765 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4"] Jun 08 19:45:37.478197 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:45:37.478173 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33645c90_a6a0_405e_9798_ff251fbc9ddd.slice/crio-7e73d46906207860b663346fdee4e2b996a7748ec4fc11c310b7c3944dcbf46f WatchSource:0}: Error finding container 7e73d46906207860b663346fdee4e2b996a7748ec4fc11c310b7c3944dcbf46f: Status 404 returned error can't find the container with id 7e73d46906207860b663346fdee4e2b996a7748ec4fc11c310b7c3944dcbf46f Jun 08 19:45:37.772174 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.772143 2549 generic.go:356] "Generic (PLEG): container finished" podID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerID="e9f44f57b8a43a578f06ee7aaad5be396788af112ccd19cacf882da2902b7084" exitCode=0 Jun 08 19:45:37.772343 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.772213 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" event={"ID":"33645c90-a6a0-405e-9798-ff251fbc9ddd","Type":"ContainerDied","Data":"e9f44f57b8a43a578f06ee7aaad5be396788af112ccd19cacf882da2902b7084"} Jun 08 19:45:37.772343 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:37.772257 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" event={"ID":"33645c90-a6a0-405e-9798-ff251fbc9ddd","Type":"ContainerStarted","Data":"7e73d46906207860b663346fdee4e2b996a7748ec4fc11c310b7c3944dcbf46f"} Jun 08 19:45:38.778777 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:38.778690 2549 generic.go:356] "Generic (PLEG): container finished" podID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerID="5c3cc7c58372be5b95589b226444c431adcd090828a2dee5d6b3b0c69654a1bd" exitCode=0 Jun 08 19:45:38.779172 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:38.778778 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" event={"ID":"33645c90-a6a0-405e-9798-ff251fbc9ddd","Type":"ContainerDied","Data":"5c3cc7c58372be5b95589b226444c431adcd090828a2dee5d6b3b0c69654a1bd"} Jun 08 19:45:39.786930 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:39.786879 2549 generic.go:356] "Generic (PLEG): container finished" podID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerID="436740073cef63d591428b3356c985331a1fd2146f717752836b5040b45603d3" exitCode=0 Jun 08 19:45:39.787434 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:39.786963 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" event={"ID":"33645c90-a6a0-405e-9798-ff251fbc9ddd","Type":"ContainerDied","Data":"436740073cef63d591428b3356c985331a1fd2146f717752836b5040b45603d3"} Jun 08 19:45:40.932696 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:40.932667 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:41.004196 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.004160 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-util\") pod \"33645c90-a6a0-405e-9798-ff251fbc9ddd\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " Jun 08 19:45:41.004378 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.004217 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dphqp\" (UniqueName: \"kubernetes.io/projected/33645c90-a6a0-405e-9798-ff251fbc9ddd-kube-api-access-dphqp\") pod \"33645c90-a6a0-405e-9798-ff251fbc9ddd\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " Jun 08 19:45:41.004378 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.004286 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-bundle\") pod \"33645c90-a6a0-405e-9798-ff251fbc9ddd\" (UID: \"33645c90-a6a0-405e-9798-ff251fbc9ddd\") " Jun 08 19:45:41.005148 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.005121 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-bundle" (OuterVolumeSpecName: "bundle") pod "33645c90-a6a0-405e-9798-ff251fbc9ddd" (UID: "33645c90-a6a0-405e-9798-ff251fbc9ddd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:45:41.006359 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.006336 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33645c90-a6a0-405e-9798-ff251fbc9ddd-kube-api-access-dphqp" (OuterVolumeSpecName: "kube-api-access-dphqp") pod "33645c90-a6a0-405e-9798-ff251fbc9ddd" (UID: "33645c90-a6a0-405e-9798-ff251fbc9ddd"). InnerVolumeSpecName "kube-api-access-dphqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:45:41.009535 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.009494 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-util" (OuterVolumeSpecName: "util") pod "33645c90-a6a0-405e-9798-ff251fbc9ddd" (UID: "33645c90-a6a0-405e-9798-ff251fbc9ddd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:45:41.105107 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.105028 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:45:41.105107 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.105056 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dphqp\" (UniqueName: \"kubernetes.io/projected/33645c90-a6a0-405e-9798-ff251fbc9ddd-kube-api-access-dphqp\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:45:41.105107 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.105068 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33645c90-a6a0-405e-9798-ff251fbc9ddd-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:45:41.800500 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.800468 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" event={"ID":"33645c90-a6a0-405e-9798-ff251fbc9ddd","Type":"ContainerDied","Data":"7e73d46906207860b663346fdee4e2b996a7748ec4fc11c310b7c3944dcbf46f"} Jun 08 19:45:41.800747 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.800507 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068pwn4" Jun 08 19:45:41.800747 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:41.800515 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e73d46906207860b663346fdee4e2b996a7748ec4fc11c310b7c3944dcbf46f" Jun 08 19:45:47.628903 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.628871 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l"] Jun 08 19:45:47.629271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.629174 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerName="pull" Jun 08 19:45:47.629271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.629185 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerName="pull" Jun 08 19:45:47.629271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.629193 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerName="extract" Jun 08 19:45:47.629271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.629198 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerName="extract" Jun 08 19:45:47.629271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.629211 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerName="util" Jun 08 19:45:47.629271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.629217 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerName="util" Jun 08 19:45:47.629271 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.629266 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="33645c90-a6a0-405e-9798-ff251fbc9ddd" containerName="extract" Jun 08 19:45:47.632230 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.632211 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.638682 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.638617 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 19:45:47.660530 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.660506 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.660725 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.660561 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9m57\" (UniqueName: \"kubernetes.io/projected/f2c65169-4444-42b8-82a8-e0e3816fe0ba-kube-api-access-r9m57\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.660725 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.660667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.660929 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:45:47.660822 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.661099 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.661068 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 19:45:47.661201 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.661099 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6ckmw\"" Jun 08 19:45:47.666944 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.666920 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l"] Jun 08 19:45:47.761346 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.761307 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9m57\" (UniqueName: \"kubernetes.io/projected/f2c65169-4444-42b8-82a8-e0e3816fe0ba-kube-api-access-r9m57\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.761527 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.761357 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.761527 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.761405 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.761752 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.761736 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.761801 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.761780 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.808329 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.808300 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9m57\" (UniqueName: \"kubernetes.io/projected/f2c65169-4444-42b8-82a8-e0e3816fe0ba-kube-api-access-r9m57\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:47.941429 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:47.941351 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:48.122516 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:48.122491 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l"] Jun 08 19:45:48.124075 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:45:48.124047 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c65169_4444_42b8_82a8_e0e3816fe0ba.slice/crio-74f31a2f129039fb34fbb4d6c5f772ee887f5377a99f619147833aa44be7503a WatchSource:0}: Error finding container 74f31a2f129039fb34fbb4d6c5f772ee887f5377a99f619147833aa44be7503a: Status 404 returned error can't find the container with id 74f31a2f129039fb34fbb4d6c5f772ee887f5377a99f619147833aa44be7503a Jun 08 19:45:48.839564 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:48.839528 2549 generic.go:356] "Generic (PLEG): container finished" podID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerID="92ac21bc2e4045e4914d167a205f959d0b6cca086afd6a8fe6348d969c3776f0" exitCode=0 Jun 08 19:45:48.839959 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:48.839609 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" event={"ID":"f2c65169-4444-42b8-82a8-e0e3816fe0ba","Type":"ContainerDied","Data":"92ac21bc2e4045e4914d167a205f959d0b6cca086afd6a8fe6348d969c3776f0"} Jun 08 19:45:48.839959 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:48.839656 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" event={"ID":"f2c65169-4444-42b8-82a8-e0e3816fe0ba","Type":"ContainerStarted","Data":"74f31a2f129039fb34fbb4d6c5f772ee887f5377a99f619147833aa44be7503a"} Jun 08 19:45:49.846958 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:49.846920 2549 generic.go:356] "Generic (PLEG): container finished" podID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerID="59d7c17123b381074460c3a4d740324523a14357f9c7b15af8b257d2f7e5dbfc" exitCode=0 Jun 08 19:45:49.847378 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:49.846976 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" event={"ID":"f2c65169-4444-42b8-82a8-e0e3816fe0ba","Type":"ContainerDied","Data":"59d7c17123b381074460c3a4d740324523a14357f9c7b15af8b257d2f7e5dbfc"} Jun 08 19:45:50.854225 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:50.854189 2549 generic.go:356] "Generic (PLEG): container finished" podID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerID="671974be3f831cc367b8d0943d807baa5622a77b55c9d23cb41645f5b0ab23cc" exitCode=0 Jun 08 19:45:50.854638 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:50.854269 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" event={"ID":"f2c65169-4444-42b8-82a8-e0e3816fe0ba","Type":"ContainerDied","Data":"671974be3f831cc367b8d0943d807baa5622a77b55c9d23cb41645f5b0ab23cc"} Jun 08 19:45:51.991485 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:51.991455 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:52.098006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.097971 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-util\") pod \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " Jun 08 19:45:52.098006 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.098011 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9m57\" (UniqueName: \"kubernetes.io/projected/f2c65169-4444-42b8-82a8-e0e3816fe0ba-kube-api-access-r9m57\") pod \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " Jun 08 19:45:52.098256 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.098068 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-bundle\") pod \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\" (UID: \"f2c65169-4444-42b8-82a8-e0e3816fe0ba\") " Jun 08 19:45:52.099044 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.099017 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-bundle" (OuterVolumeSpecName: "bundle") pod "f2c65169-4444-42b8-82a8-e0e3816fe0ba" (UID: "f2c65169-4444-42b8-82a8-e0e3816fe0ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:45:52.100233 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.100200 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c65169-4444-42b8-82a8-e0e3816fe0ba-kube-api-access-r9m57" (OuterVolumeSpecName: "kube-api-access-r9m57") pod "f2c65169-4444-42b8-82a8-e0e3816fe0ba" (UID: "f2c65169-4444-42b8-82a8-e0e3816fe0ba"). InnerVolumeSpecName "kube-api-access-r9m57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:45:52.103511 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.103471 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-util" (OuterVolumeSpecName: "util") pod "f2c65169-4444-42b8-82a8-e0e3816fe0ba" (UID: "f2c65169-4444-42b8-82a8-e0e3816fe0ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:45:52.199748 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.199665 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:45:52.199748 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.199694 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9m57\" (UniqueName: \"kubernetes.io/projected/f2c65169-4444-42b8-82a8-e0e3816fe0ba-kube-api-access-r9m57\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:45:52.199748 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.199703 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c65169-4444-42b8-82a8-e0e3816fe0ba-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:45:52.867279 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.867254 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" Jun 08 19:45:52.867279 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.867271 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af7r2l" event={"ID":"f2c65169-4444-42b8-82a8-e0e3816fe0ba","Type":"ContainerDied","Data":"74f31a2f129039fb34fbb4d6c5f772ee887f5377a99f619147833aa44be7503a"} Jun 08 19:45:52.867491 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:45:52.867310 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74f31a2f129039fb34fbb4d6c5f772ee887f5377a99f619147833aa44be7503a" Jun 08 19:46:14.458244 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.458211 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz"] Jun 08 19:46:14.458817 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.458734 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerName="extract" Jun 08 19:46:14.458817 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.458755 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerName="extract" Jun 08 19:46:14.458817 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.458778 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerName="util" Jun 08 19:46:14.458817 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.458786 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerName="util" Jun 08 19:46:14.458817 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.458807 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerName="pull" Jun 08 19:46:14.458817 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.458815 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerName="pull" Jun 08 19:46:14.459135 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.458885 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c65169-4444-42b8-82a8-e0e3816fe0ba" containerName="extract" Jun 08 19:46:14.463031 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.463007 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.477038 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.470131 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 19:46:14.477038 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.472178 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 19:46:14.477998 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.477972 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 19:46:14.478262 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.478243 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b7whk\"" Jun 08 19:46:14.493702 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.493674 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz"] Jun 08 19:46:14.609166 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.609131 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.609166 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.609168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb78299c-868f-4fa9-a48f-b778202b6134-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.609385 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.609199 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb78299c-868f-4fa9-a48f-b778202b6134-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.609385 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.609224 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.609385 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.609316 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.609385 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.609353 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.609385 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.609374 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb78299c-868f-4fa9-a48f-b778202b6134-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.609623 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.609436 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rflj5\" (UniqueName: \"kubernetes.io/projected/eb78299c-868f-4fa9-a48f-b778202b6134-kube-api-access-rflj5\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.609623 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.609506 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710307 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb78299c-868f-4fa9-a48f-b778202b6134-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710348 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710521 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710382 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710521 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710402 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710521 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710420 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb78299c-868f-4fa9-a48f-b778202b6134-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710521 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710443 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rflj5\" (UniqueName: \"kubernetes.io/projected/eb78299c-868f-4fa9-a48f-b778202b6134-kube-api-access-rflj5\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710521 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710472 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710772 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710605 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710772 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710675 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb78299c-868f-4fa9-a48f-b778202b6134-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710878 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710811 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.710950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710926 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.711010 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.710987 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.711123 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.711103 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.711231 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.711211 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb78299c-868f-4fa9-a48f-b778202b6134-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.712791 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.712764 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb78299c-868f-4fa9-a48f-b778202b6134-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.713359 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.713338 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb78299c-868f-4fa9-a48f-b778202b6134-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.720259 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.720230 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb78299c-868f-4fa9-a48f-b778202b6134-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.720408 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.720357 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rflj5\" (UniqueName: \"kubernetes.io/projected/eb78299c-868f-4fa9-a48f-b778202b6134-kube-api-access-rflj5\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gdldz\" (UID: \"eb78299c-868f-4fa9-a48f-b778202b6134\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.779197 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.779164 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:14.920022 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.919993 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz"] Jun 08 19:46:14.922009 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:46:14.921984 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb78299c_868f_4fa9_a48f_b778202b6134.slice/crio-7f5058cd1d5cd624074ea1b8cabf0a143f7cdd3db5f7f70b4c9f9726539cbc1c WatchSource:0}: Error finding container 7f5058cd1d5cd624074ea1b8cabf0a143f7cdd3db5f7f70b4c9f9726539cbc1c: Status 404 returned error can't find the container with id 7f5058cd1d5cd624074ea1b8cabf0a143f7cdd3db5f7f70b4c9f9726539cbc1c Jun 08 19:46:14.974709 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:14.974626 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" event={"ID":"eb78299c-868f-4fa9-a48f-b778202b6134","Type":"ContainerStarted","Data":"7f5058cd1d5cd624074ea1b8cabf0a143f7cdd3db5f7f70b4c9f9726539cbc1c"} Jun 08 19:46:17.322178 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:17.322136 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:46:17.322461 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:17.322215 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:46:17.322461 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:17.322246 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:46:17.990979 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:17.990931 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" event={"ID":"eb78299c-868f-4fa9-a48f-b778202b6134","Type":"ContainerStarted","Data":"768c972c894461058f5a1286882bc8ab7ce4fab8a1299c9008b1751169ad6089"} Jun 08 19:46:18.011224 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.011172 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" podStartSLOduration=1.613339511 podStartE2EDuration="4.011156726s" totalImagesPullingTime="2.397817215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:46:18.009845544 +0000 UTC m=+1185.990116557" watchObservedRunningTime="2026-06-08 19:46:18.011156726 +0000 UTC m=+1185.991427737" Jun 08 19:46:18.375683 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.375641 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7759946b58-g5dts"] Jun 08 19:46:18.379645 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.379620 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7759946b58-g5dts" Jun 08 19:46:18.382317 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.382294 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 19:46:18.382620 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.382599 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dr7dt\"" Jun 08 19:46:18.388722 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.388693 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7759946b58-g5dts"] Jun 08 19:46:18.445803 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.445764 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a2fe1867-79ad-40be-a3d5-e160b2558f2f-redirect-config\") pod \"dashboard-redirect-7759946b58-g5dts\" (UID: \"a2fe1867-79ad-40be-a3d5-e160b2558f2f\") " pod="opendatahub/dashboard-redirect-7759946b58-g5dts" Jun 08 19:46:18.446012 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.445943 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9gdm\" (UniqueName: \"kubernetes.io/projected/a2fe1867-79ad-40be-a3d5-e160b2558f2f-kube-api-access-n9gdm\") pod \"dashboard-redirect-7759946b58-g5dts\" (UID: \"a2fe1867-79ad-40be-a3d5-e160b2558f2f\") " pod="opendatahub/dashboard-redirect-7759946b58-g5dts" Jun 08 19:46:18.546408 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.546369 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9gdm\" (UniqueName: \"kubernetes.io/projected/a2fe1867-79ad-40be-a3d5-e160b2558f2f-kube-api-access-n9gdm\") pod \"dashboard-redirect-7759946b58-g5dts\" (UID: \"a2fe1867-79ad-40be-a3d5-e160b2558f2f\") " pod="opendatahub/dashboard-redirect-7759946b58-g5dts" Jun 08 19:46:18.546577 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.546425 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a2fe1867-79ad-40be-a3d5-e160b2558f2f-redirect-config\") pod \"dashboard-redirect-7759946b58-g5dts\" (UID: \"a2fe1867-79ad-40be-a3d5-e160b2558f2f\") " pod="opendatahub/dashboard-redirect-7759946b58-g5dts" Jun 08 19:46:18.547146 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.547127 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a2fe1867-79ad-40be-a3d5-e160b2558f2f-redirect-config\") pod \"dashboard-redirect-7759946b58-g5dts\" (UID: \"a2fe1867-79ad-40be-a3d5-e160b2558f2f\") " pod="opendatahub/dashboard-redirect-7759946b58-g5dts" Jun 08 19:46:18.554241 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.554209 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9gdm\" (UniqueName: \"kubernetes.io/projected/a2fe1867-79ad-40be-a3d5-e160b2558f2f-kube-api-access-n9gdm\") pod \"dashboard-redirect-7759946b58-g5dts\" (UID: \"a2fe1867-79ad-40be-a3d5-e160b2558f2f\") " pod="opendatahub/dashboard-redirect-7759946b58-g5dts" Jun 08 19:46:18.693658 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.693568 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7759946b58-g5dts" Jun 08 19:46:18.779712 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.779663 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:18.784737 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.784714 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:18.822027 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.821999 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7759946b58-g5dts"] Jun 08 19:46:18.824026 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:46:18.823994 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2fe1867_79ad_40be_a3d5_e160b2558f2f.slice/crio-45e850cc7b4f2be6d5f3a20b91afb8b0ab98b3330ec1a891b539c68e748c5c85 WatchSource:0}: Error finding container 45e850cc7b4f2be6d5f3a20b91afb8b0ab98b3330ec1a891b539c68e748c5c85: Status 404 returned error can't find the container with id 45e850cc7b4f2be6d5f3a20b91afb8b0ab98b3330ec1a891b539c68e748c5c85 Jun 08 19:46:18.996581 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.996485 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7759946b58-g5dts" event={"ID":"a2fe1867-79ad-40be-a3d5-e160b2558f2f","Type":"ContainerStarted","Data":"45e850cc7b4f2be6d5f3a20b91afb8b0ab98b3330ec1a891b539c68e748c5c85"} Jun 08 19:46:18.996747 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.996727 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:18.997582 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:18.997568 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gdldz" Jun 08 19:46:21.009072 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:21.008900 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7759946b58-g5dts" event={"ID":"a2fe1867-79ad-40be-a3d5-e160b2558f2f","Type":"ContainerStarted","Data":"730c4fc0f3d9f1c752ad0fda3c08c11d7f65e37887d28965b53c8b00eafcbdbb"} Jun 08 19:46:21.024605 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:21.024556 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7759946b58-g5dts" podStartSLOduration=1.188712934 podStartE2EDuration="3.024539884s" totalImagesPullingTime="1.83582695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:46:21.023501423 +0000 UTC m=+1189.003772447" watchObservedRunningTime="2026-06-08 19:46:21.024539884 +0000 UTC m=+1189.004810895" Jun 08 19:46:32.486459 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:32.486432 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:46:32.486883 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:32.486719 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:46:32.492699 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:32.492677 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:46:32.492816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:32.492706 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:46:34.453005 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.452972 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-crrmn"] Jun 08 19:46:34.457250 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.457224 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" Jun 08 19:46:34.459824 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.459802 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 19:46:34.460126 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.460106 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 19:46:34.461151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.461128 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-db4wb\"" Jun 08 19:46:34.470608 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.470587 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-crrmn"] Jun 08 19:46:34.584249 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.584218 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdsp6\" (UniqueName: \"kubernetes.io/projected/6cd91ad6-09dc-4b4b-aba6-ab2094131355-kube-api-access-mdsp6\") pod \"kuadrant-operator-catalog-crrmn\" (UID: \"6cd91ad6-09dc-4b4b-aba6-ab2094131355\") " pod="kuadrant-system/kuadrant-operator-catalog-crrmn" Jun 08 19:46:34.685633 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.685597 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdsp6\" (UniqueName: \"kubernetes.io/projected/6cd91ad6-09dc-4b4b-aba6-ab2094131355-kube-api-access-mdsp6\") pod \"kuadrant-operator-catalog-crrmn\" (UID: \"6cd91ad6-09dc-4b4b-aba6-ab2094131355\") " pod="kuadrant-system/kuadrant-operator-catalog-crrmn" Jun 08 19:46:34.701541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.701512 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdsp6\" (UniqueName: \"kubernetes.io/projected/6cd91ad6-09dc-4b4b-aba6-ab2094131355-kube-api-access-mdsp6\") pod \"kuadrant-operator-catalog-crrmn\" (UID: \"6cd91ad6-09dc-4b4b-aba6-ab2094131355\") " pod="kuadrant-system/kuadrant-operator-catalog-crrmn" Jun 08 19:46:34.768069 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.767992 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" Jun 08 19:46:34.828213 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.828111 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-crrmn"] Jun 08 19:46:34.901153 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:34.901127 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-crrmn"] Jun 08 19:46:34.903239 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:46:34.903213 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd91ad6_09dc_4b4b_aba6_ab2094131355.slice/crio-dbe5f34f6083de655a65c4f68ac90557f364a13f80068d0e3601d781ef6b1d78 WatchSource:0}: Error finding container dbe5f34f6083de655a65c4f68ac90557f364a13f80068d0e3601d781ef6b1d78: Status 404 returned error can't find the container with id dbe5f34f6083de655a65c4f68ac90557f364a13f80068d0e3601d781ef6b1d78 Jun 08 19:46:35.036317 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:35.036289 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xvbv6"] Jun 08 19:46:35.040139 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:35.040123 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" Jun 08 19:46:35.050441 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:35.050414 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xvbv6"] Jun 08 19:46:35.079283 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:35.079255 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" event={"ID":"6cd91ad6-09dc-4b4b-aba6-ab2094131355","Type":"ContainerStarted","Data":"dbe5f34f6083de655a65c4f68ac90557f364a13f80068d0e3601d781ef6b1d78"} Jun 08 19:46:35.087717 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:35.087686 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slgft\" (UniqueName: \"kubernetes.io/projected/0f93e47b-218a-45e3-9805-09c6a6a6edea-kube-api-access-slgft\") pod \"kuadrant-operator-catalog-xvbv6\" (UID: \"0f93e47b-218a-45e3-9805-09c6a6a6edea\") " pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" Jun 08 19:46:35.188274 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:35.188237 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slgft\" (UniqueName: \"kubernetes.io/projected/0f93e47b-218a-45e3-9805-09c6a6a6edea-kube-api-access-slgft\") pod \"kuadrant-operator-catalog-xvbv6\" (UID: \"0f93e47b-218a-45e3-9805-09c6a6a6edea\") " pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" Jun 08 19:46:35.196635 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:35.196604 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slgft\" (UniqueName: \"kubernetes.io/projected/0f93e47b-218a-45e3-9805-09c6a6a6edea-kube-api-access-slgft\") pod \"kuadrant-operator-catalog-xvbv6\" (UID: \"0f93e47b-218a-45e3-9805-09c6a6a6edea\") " pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" Jun 08 19:46:35.349347 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:35.349273 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" Jun 08 19:46:35.488992 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:35.488965 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xvbv6"] Jun 08 19:46:35.502757 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:46:35.502729 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f93e47b_218a_45e3_9805_09c6a6a6edea.slice/crio-19699b5636f49c1afd8ac7879ac21749795c246e9a0bb5dff45555dd70faece8 WatchSource:0}: Error finding container 19699b5636f49c1afd8ac7879ac21749795c246e9a0bb5dff45555dd70faece8: Status 404 returned error can't find the container with id 19699b5636f49c1afd8ac7879ac21749795c246e9a0bb5dff45555dd70faece8 Jun 08 19:46:36.085494 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:36.085452 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" event={"ID":"0f93e47b-218a-45e3-9805-09c6a6a6edea","Type":"ContainerStarted","Data":"19699b5636f49c1afd8ac7879ac21749795c246e9a0bb5dff45555dd70faece8"} Jun 08 19:46:38.100971 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:38.100932 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" event={"ID":"6cd91ad6-09dc-4b4b-aba6-ab2094131355","Type":"ContainerStarted","Data":"1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac"} Jun 08 19:46:38.101510 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:38.100986 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" podUID="6cd91ad6-09dc-4b4b-aba6-ab2094131355" containerName="registry-server" containerID="cri-o://1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac" gracePeriod=2 Jun 08 19:46:38.102558 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:38.102530 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" event={"ID":"0f93e47b-218a-45e3-9805-09c6a6a6edea","Type":"ContainerStarted","Data":"849028bacf45a58ba37dc1b98abc005e08c26692c18fa0ccaad450cae240aef0"} Jun 08 19:46:38.118018 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:38.117962 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" podStartSLOduration=1.641853796 podStartE2EDuration="4.117945524s" totalImagesPullingTime="2.476091728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:46:38.114975416 +0000 UTC m=+1206.095246431" watchObservedRunningTime="2026-06-08 19:46:38.117945524 +0000 UTC m=+1206.098216535" Jun 08 19:46:38.129346 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:38.129293 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" podStartSLOduration=1.255856492 podStartE2EDuration="3.129271406s" totalImagesPullingTime="1.873414914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:46:38.128427605 +0000 UTC m=+1206.108698617" watchObservedRunningTime="2026-06-08 19:46:38.129271406 +0000 UTC m=+1206.109542417" Jun 08 19:46:38.345638 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:38.345609 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" Jun 08 19:46:38.418144 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:38.418053 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdsp6\" (UniqueName: \"kubernetes.io/projected/6cd91ad6-09dc-4b4b-aba6-ab2094131355-kube-api-access-mdsp6\") pod \"6cd91ad6-09dc-4b4b-aba6-ab2094131355\" (UID: \"6cd91ad6-09dc-4b4b-aba6-ab2094131355\") " Jun 08 19:46:38.420245 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:38.420221 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd91ad6-09dc-4b4b-aba6-ab2094131355-kube-api-access-mdsp6" (OuterVolumeSpecName: "kube-api-access-mdsp6") pod "6cd91ad6-09dc-4b4b-aba6-ab2094131355" (UID: "6cd91ad6-09dc-4b4b-aba6-ab2094131355"). InnerVolumeSpecName "kube-api-access-mdsp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:46:38.519209 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:38.519177 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdsp6\" (UniqueName: \"kubernetes.io/projected/6cd91ad6-09dc-4b4b-aba6-ab2094131355-kube-api-access-mdsp6\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:39.108865 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:39.108824 2549 generic.go:356] "Generic (PLEG): container finished" podID="6cd91ad6-09dc-4b4b-aba6-ab2094131355" containerID="1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac" exitCode=0 Jun 08 19:46:39.109260 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:39.108870 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" Jun 08 19:46:39.109260 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:39.108925 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" event={"ID":"6cd91ad6-09dc-4b4b-aba6-ab2094131355","Type":"ContainerDied","Data":"1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac"} Jun 08 19:46:39.109260 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:39.108980 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-crrmn" event={"ID":"6cd91ad6-09dc-4b4b-aba6-ab2094131355","Type":"ContainerDied","Data":"dbe5f34f6083de655a65c4f68ac90557f364a13f80068d0e3601d781ef6b1d78"} Jun 08 19:46:39.109260 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:39.109003 2549 scope.go:117] "RemoveContainer" containerID="1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac" Jun 08 19:46:39.118044 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:39.118023 2549 scope.go:117] "RemoveContainer" containerID="1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac" Jun 08 19:46:39.118327 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:46:39.118308 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac\": container with ID starting with 1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac not found: ID does not exist" containerID="1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac" Jun 08 19:46:39.118395 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:39.118337 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac"} err="failed to get container status \"1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac\": rpc error: code = NotFound desc = could not find container \"1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac\": container with ID starting with 1ebfa22bf4730539d79a47246b6187bf835ac563d5e197b0ce86ef7cd7c1caac not found: ID does not exist" Jun 08 19:46:39.125599 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:39.125574 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-crrmn"] Jun 08 19:46:39.129699 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:39.129677 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-crrmn"] Jun 08 19:46:40.469558 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:40.469526 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd91ad6-09dc-4b4b-aba6-ab2094131355" path="/var/lib/kubelet/pods/6cd91ad6-09dc-4b4b-aba6-ab2094131355/volumes" Jun 08 19:46:45.349447 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:45.349408 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" Jun 08 19:46:45.349984 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:45.349465 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" Jun 08 19:46:45.371865 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:45.371839 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" Jun 08 19:46:46.167003 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:46.166973 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xvbv6" Jun 08 19:46:50.016551 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.016519 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv"] Jun 08 19:46:50.016950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.016810 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd91ad6-09dc-4b4b-aba6-ab2094131355" containerName="registry-server" Jun 08 19:46:50.016950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.016820 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd91ad6-09dc-4b4b-aba6-ab2094131355" containerName="registry-server" Jun 08 19:46:50.016950 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.016894 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd91ad6-09dc-4b4b-aba6-ab2094131355" containerName="registry-server" Jun 08 19:46:50.022572 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.022553 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.025186 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.025162 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n8rpr\"" Jun 08 19:46:50.028202 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.028174 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv"] Jun 08 19:46:50.116657 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.116623 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.116851 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.116693 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.116851 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.116732 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcs7l\" (UniqueName: \"kubernetes.io/projected/be55ddab-934f-4cb0-b205-2a53aca6d10e-kube-api-access-lcs7l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.217506 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.217468 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.217696 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.217531 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.217696 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.217569 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcs7l\" (UniqueName: \"kubernetes.io/projected/be55ddab-934f-4cb0-b205-2a53aca6d10e-kube-api-access-lcs7l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.217876 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.217856 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.217967 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.217882 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.226231 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.226209 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcs7l\" (UniqueName: \"kubernetes.io/projected/be55ddab-934f-4cb0-b205-2a53aca6d10e-kube-api-access-lcs7l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.333204 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.333167 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:50.469673 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.469644 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv"] Jun 08 19:46:50.470787 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:46:50.470764 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe55ddab_934f_4cb0_b205_2a53aca6d10e.slice/crio-73fdabf4e577c3f1017fc2f93b4b7ff1bb6eb63ccd57d9ac3069b169af0ce0f0 WatchSource:0}: Error finding container 73fdabf4e577c3f1017fc2f93b4b7ff1bb6eb63ccd57d9ac3069b169af0ce0f0: Status 404 returned error can't find the container with id 73fdabf4e577c3f1017fc2f93b4b7ff1bb6eb63ccd57d9ac3069b169af0ce0f0 Jun 08 19:46:50.819619 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.819577 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c"] Jun 08 19:46:50.822149 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.822128 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:50.831651 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.831626 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c"] Jun 08 19:46:50.923242 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.923199 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:50.923429 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.923276 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52mk4\" (UniqueName: \"kubernetes.io/projected/f1dadce4-56db-4bf6-906d-193fc26fe87e-kube-api-access-52mk4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:50.923429 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:50.923317 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:51.024573 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.024524 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52mk4\" (UniqueName: \"kubernetes.io/projected/f1dadce4-56db-4bf6-906d-193fc26fe87e-kube-api-access-52mk4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:51.025063 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.024591 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:51.025063 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.024655 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:51.025063 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.025031 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:51.025199 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.025090 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:51.032555 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.032535 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52mk4\" (UniqueName: \"kubernetes.io/projected/f1dadce4-56db-4bf6-906d-193fc26fe87e-kube-api-access-52mk4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:51.131837 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.131744 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:51.173122 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.173081 2549 generic.go:356] "Generic (PLEG): container finished" podID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerID="81b9fb40739313faad571ea1c9e946878f0667ec922416eff2a98449a56a809e" exitCode=0 Jun 08 19:46:51.173298 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.173211 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" event={"ID":"be55ddab-934f-4cb0-b205-2a53aca6d10e","Type":"ContainerDied","Data":"81b9fb40739313faad571ea1c9e946878f0667ec922416eff2a98449a56a809e"} Jun 08 19:46:51.173298 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.173263 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" event={"ID":"be55ddab-934f-4cb0-b205-2a53aca6d10e","Type":"ContainerStarted","Data":"73fdabf4e577c3f1017fc2f93b4b7ff1bb6eb63ccd57d9ac3069b169af0ce0f0"} Jun 08 19:46:51.267751 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.267724 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c"] Jun 08 19:46:51.268892 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:46:51.268862 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1dadce4_56db_4bf6_906d_193fc26fe87e.slice/crio-652316d10f1297ef98203bfc726d07b57a70f28ff6c03212f0c118e74f5632a2 WatchSource:0}: Error finding container 652316d10f1297ef98203bfc726d07b57a70f28ff6c03212f0c118e74f5632a2: Status 404 returned error can't find the container with id 652316d10f1297ef98203bfc726d07b57a70f28ff6c03212f0c118e74f5632a2 Jun 08 19:46:51.435336 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.435251 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw"] Jun 08 19:46:51.441808 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.438877 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.447423 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.447395 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw"] Jun 08 19:46:51.530080 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.530040 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.530284 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.530115 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.530284 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.530180 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbb6q\" (UniqueName: \"kubernetes.io/projected/93faa170-0c75-49ca-9616-bf03777fdfb4-kube-api-access-dbb6q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.631367 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.631321 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.631527 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.631425 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.631527 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.631458 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbb6q\" (UniqueName: \"kubernetes.io/projected/93faa170-0c75-49ca-9616-bf03777fdfb4-kube-api-access-dbb6q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.631712 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.631680 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.631800 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.631779 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.639747 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.639719 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbb6q\" (UniqueName: \"kubernetes.io/projected/93faa170-0c75-49ca-9616-bf03777fdfb4-kube-api-access-dbb6q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.751978 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.751875 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:51.813971 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.813937 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx"] Jun 08 19:46:51.816840 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.816817 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:51.827393 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.827363 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx"] Jun 08 19:46:51.934690 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.934659 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:51.934809 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.934768 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtwls\" (UniqueName: \"kubernetes.io/projected/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-kube-api-access-vtwls\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:51.934809 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.934801 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:51.986153 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:51.986120 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw"] Jun 08 19:46:52.020837 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:46:52.020760 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93faa170_0c75_49ca_9616_bf03777fdfb4.slice/crio-836cf109c8274ad900f018a82a40f2734819e9ca9dd0036c1359c2798ad5e7dd WatchSource:0}: Error finding container 836cf109c8274ad900f018a82a40f2734819e9ca9dd0036c1359c2798ad5e7dd: Status 404 returned error can't find the container with id 836cf109c8274ad900f018a82a40f2734819e9ca9dd0036c1359c2798ad5e7dd Jun 08 19:46:52.035834 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.035808 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtwls\" (UniqueName: \"kubernetes.io/projected/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-kube-api-access-vtwls\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:52.036215 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.035847 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:52.036215 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.035917 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:52.036296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.036229 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:52.036296 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.036264 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:52.044171 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.044152 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtwls\" (UniqueName: \"kubernetes.io/projected/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-kube-api-access-vtwls\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:52.127091 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.127062 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:52.182750 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.182547 2549 generic.go:356] "Generic (PLEG): container finished" podID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerID="d16edeaa00762d65f95c0e382ec1b8bfdeeee26c9a49c7613f1b00e5814ade96" exitCode=0 Jun 08 19:46:52.182750 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.182642 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" event={"ID":"f1dadce4-56db-4bf6-906d-193fc26fe87e","Type":"ContainerDied","Data":"d16edeaa00762d65f95c0e382ec1b8bfdeeee26c9a49c7613f1b00e5814ade96"} Jun 08 19:46:52.182750 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.182689 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" event={"ID":"f1dadce4-56db-4bf6-906d-193fc26fe87e","Type":"ContainerStarted","Data":"652316d10f1297ef98203bfc726d07b57a70f28ff6c03212f0c118e74f5632a2"} Jun 08 19:46:52.186374 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.186348 2549 generic.go:356] "Generic (PLEG): container finished" podID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerID="4d2dd5a00837241cfcbd100ba949461dab3f310752564a72707e6e4ec392414b" exitCode=0 Jun 08 19:46:52.186498 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.186479 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" event={"ID":"be55ddab-934f-4cb0-b205-2a53aca6d10e","Type":"ContainerDied","Data":"4d2dd5a00837241cfcbd100ba949461dab3f310752564a72707e6e4ec392414b"} Jun 08 19:46:52.188210 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.188187 2549 generic.go:356] "Generic (PLEG): container finished" podID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerID="ee2e85b2f07685c4082d7d09ae687bd0c76de8d7154c76afafda9a8ffb5e85b0" exitCode=0 Jun 08 19:46:52.188336 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.188277 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" event={"ID":"93faa170-0c75-49ca-9616-bf03777fdfb4","Type":"ContainerDied","Data":"ee2e85b2f07685c4082d7d09ae687bd0c76de8d7154c76afafda9a8ffb5e85b0"} Jun 08 19:46:52.188395 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.188346 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" event={"ID":"93faa170-0c75-49ca-9616-bf03777fdfb4","Type":"ContainerStarted","Data":"836cf109c8274ad900f018a82a40f2734819e9ca9dd0036c1359c2798ad5e7dd"} Jun 08 19:46:52.269696 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:52.269668 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx"] Jun 08 19:46:52.270540 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:46:52.270517 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bfee0a4_bd56_4fd5_9ac5_8c88b780ab54.slice/crio-32032f1ada9f32875504c471364b3abd22da2166cde52295263a1e551188ff59 WatchSource:0}: Error finding container 32032f1ada9f32875504c471364b3abd22da2166cde52295263a1e551188ff59: Status 404 returned error can't find the container with id 32032f1ada9f32875504c471364b3abd22da2166cde52295263a1e551188ff59 Jun 08 19:46:53.195537 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:53.195439 2549 generic.go:356] "Generic (PLEG): container finished" podID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerID="e1a97b04d535966d55c02155c8f5bb7b2d7bcd3f1b919a5f43e026e2b24284d6" exitCode=0 Jun 08 19:46:53.195537 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:53.195521 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" event={"ID":"be55ddab-934f-4cb0-b205-2a53aca6d10e","Type":"ContainerDied","Data":"e1a97b04d535966d55c02155c8f5bb7b2d7bcd3f1b919a5f43e026e2b24284d6"} Jun 08 19:46:53.197260 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:53.197237 2549 generic.go:356] "Generic (PLEG): container finished" podID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerID="c50934a8be9be4b8638f3806305a12bb6dd574221f5eab25660b9c4d0a74a3de" exitCode=0 Jun 08 19:46:53.197373 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:53.197321 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" event={"ID":"93faa170-0c75-49ca-9616-bf03777fdfb4","Type":"ContainerDied","Data":"c50934a8be9be4b8638f3806305a12bb6dd574221f5eab25660b9c4d0a74a3de"} Jun 08 19:46:53.198847 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:53.198824 2549 generic.go:356] "Generic (PLEG): container finished" podID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerID="033421b0013ce2d352b3828c36a5e722d9b9c4c1595e533203a8cc17454d959d" exitCode=0 Jun 08 19:46:53.198964 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:53.198926 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" event={"ID":"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54","Type":"ContainerDied","Data":"033421b0013ce2d352b3828c36a5e722d9b9c4c1595e533203a8cc17454d959d"} Jun 08 19:46:53.198964 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:53.198955 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" event={"ID":"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54","Type":"ContainerStarted","Data":"32032f1ada9f32875504c471364b3abd22da2166cde52295263a1e551188ff59"} Jun 08 19:46:53.201051 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:53.201030 2549 generic.go:356] "Generic (PLEG): container finished" podID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerID="47257175a9d411afaacff87057ef843ee5751ac3540d959af68c4573223562fd" exitCode=0 Jun 08 19:46:53.201153 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:53.201062 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" event={"ID":"f1dadce4-56db-4bf6-906d-193fc26fe87e","Type":"ContainerDied","Data":"47257175a9d411afaacff87057ef843ee5751ac3540d959af68c4573223562fd"} Jun 08 19:46:54.208413 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.208371 2549 generic.go:356] "Generic (PLEG): container finished" podID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerID="22c00144a8e9edc2f2620ea98280d980b9778565a9e5d2772c73a9e8bb3ffc69" exitCode=0 Jun 08 19:46:54.208893 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.208446 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" event={"ID":"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54","Type":"ContainerDied","Data":"22c00144a8e9edc2f2620ea98280d980b9778565a9e5d2772c73a9e8bb3ffc69"} Jun 08 19:46:54.211047 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.211019 2549 generic.go:356] "Generic (PLEG): container finished" podID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerID="29a09746c7300f80609cb313976697215090dd549deabd409f456e9c8682db0b" exitCode=0 Jun 08 19:46:54.211151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.211090 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" event={"ID":"f1dadce4-56db-4bf6-906d-193fc26fe87e","Type":"ContainerDied","Data":"29a09746c7300f80609cb313976697215090dd549deabd409f456e9c8682db0b"} Jun 08 19:46:54.213626 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.213603 2549 generic.go:356] "Generic (PLEG): container finished" podID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerID="0ae07b70dd63ff2d4466a8715710ebff5dd4d7451e5cfca9657ad0f8e4668255" exitCode=0 Jun 08 19:46:54.213733 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.213681 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" event={"ID":"93faa170-0c75-49ca-9616-bf03777fdfb4","Type":"ContainerDied","Data":"0ae07b70dd63ff2d4466a8715710ebff5dd4d7451e5cfca9657ad0f8e4668255"} Jun 08 19:46:54.378044 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.378016 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:54.458787 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.458706 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-util\") pod \"be55ddab-934f-4cb0-b205-2a53aca6d10e\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " Jun 08 19:46:54.458787 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.458779 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcs7l\" (UniqueName: \"kubernetes.io/projected/be55ddab-934f-4cb0-b205-2a53aca6d10e-kube-api-access-lcs7l\") pod \"be55ddab-934f-4cb0-b205-2a53aca6d10e\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " Jun 08 19:46:54.459046 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.458845 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-bundle\") pod \"be55ddab-934f-4cb0-b205-2a53aca6d10e\" (UID: \"be55ddab-934f-4cb0-b205-2a53aca6d10e\") " Jun 08 19:46:54.459344 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.459318 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-bundle" (OuterVolumeSpecName: "bundle") pod "be55ddab-934f-4cb0-b205-2a53aca6d10e" (UID: "be55ddab-934f-4cb0-b205-2a53aca6d10e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:46:54.461078 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.461056 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be55ddab-934f-4cb0-b205-2a53aca6d10e-kube-api-access-lcs7l" (OuterVolumeSpecName: "kube-api-access-lcs7l") pod "be55ddab-934f-4cb0-b205-2a53aca6d10e" (UID: "be55ddab-934f-4cb0-b205-2a53aca6d10e"). InnerVolumeSpecName "kube-api-access-lcs7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:46:54.464212 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.464187 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-util" (OuterVolumeSpecName: "util") pod "be55ddab-934f-4cb0-b205-2a53aca6d10e" (UID: "be55ddab-934f-4cb0-b205-2a53aca6d10e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:46:54.559670 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.559629 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:54.559670 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.559666 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be55ddab-934f-4cb0-b205-2a53aca6d10e-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:54.559670 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:54.559679 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcs7l\" (UniqueName: \"kubernetes.io/projected/be55ddab-934f-4cb0-b205-2a53aca6d10e-kube-api-access-lcs7l\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:55.221135 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.221101 2549 generic.go:356] "Generic (PLEG): container finished" podID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerID="ca4bf645f2994d3e91fe514e895a7564a146c308295acb81d6848156c92cb1b5" exitCode=0 Jun 08 19:46:55.221531 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.221195 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" event={"ID":"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54","Type":"ContainerDied","Data":"ca4bf645f2994d3e91fe514e895a7564a146c308295acb81d6848156c92cb1b5"} Jun 08 19:46:55.223323 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.223299 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" Jun 08 19:46:55.223422 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.223315 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv" event={"ID":"be55ddab-934f-4cb0-b205-2a53aca6d10e","Type":"ContainerDied","Data":"73fdabf4e577c3f1017fc2f93b4b7ff1bb6eb63ccd57d9ac3069b169af0ce0f0"} Jun 08 19:46:55.223422 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.223363 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73fdabf4e577c3f1017fc2f93b4b7ff1bb6eb63ccd57d9ac3069b169af0ce0f0" Jun 08 19:46:55.387567 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.387541 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:55.388673 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.388656 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:55.466720 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.466690 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-util\") pod \"93faa170-0c75-49ca-9616-bf03777fdfb4\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " Jun 08 19:46:55.466933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.466738 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-util\") pod \"f1dadce4-56db-4bf6-906d-193fc26fe87e\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " Jun 08 19:46:55.466933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.466764 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbb6q\" (UniqueName: \"kubernetes.io/projected/93faa170-0c75-49ca-9616-bf03777fdfb4-kube-api-access-dbb6q\") pod \"93faa170-0c75-49ca-9616-bf03777fdfb4\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " Jun 08 19:46:55.466933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.466804 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52mk4\" (UniqueName: \"kubernetes.io/projected/f1dadce4-56db-4bf6-906d-193fc26fe87e-kube-api-access-52mk4\") pod \"f1dadce4-56db-4bf6-906d-193fc26fe87e\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " Jun 08 19:46:55.466933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.466842 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-bundle\") pod \"f1dadce4-56db-4bf6-906d-193fc26fe87e\" (UID: \"f1dadce4-56db-4bf6-906d-193fc26fe87e\") " Jun 08 19:46:55.466933 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.466894 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-bundle\") pod \"93faa170-0c75-49ca-9616-bf03777fdfb4\" (UID: \"93faa170-0c75-49ca-9616-bf03777fdfb4\") " Jun 08 19:46:55.467467 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.467428 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-bundle" (OuterVolumeSpecName: "bundle") pod "f1dadce4-56db-4bf6-906d-193fc26fe87e" (UID: "f1dadce4-56db-4bf6-906d-193fc26fe87e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:46:55.467699 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.467672 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-bundle" (OuterVolumeSpecName: "bundle") pod "93faa170-0c75-49ca-9616-bf03777fdfb4" (UID: "93faa170-0c75-49ca-9616-bf03777fdfb4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:46:55.469104 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.469074 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1dadce4-56db-4bf6-906d-193fc26fe87e-kube-api-access-52mk4" (OuterVolumeSpecName: "kube-api-access-52mk4") pod "f1dadce4-56db-4bf6-906d-193fc26fe87e" (UID: "f1dadce4-56db-4bf6-906d-193fc26fe87e"). InnerVolumeSpecName "kube-api-access-52mk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:46:55.469437 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.469419 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93faa170-0c75-49ca-9616-bf03777fdfb4-kube-api-access-dbb6q" (OuterVolumeSpecName: "kube-api-access-dbb6q") pod "93faa170-0c75-49ca-9616-bf03777fdfb4" (UID: "93faa170-0c75-49ca-9616-bf03777fdfb4"). InnerVolumeSpecName "kube-api-access-dbb6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:46:55.472965 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.472895 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-util" (OuterVolumeSpecName: "util") pod "93faa170-0c75-49ca-9616-bf03777fdfb4" (UID: "93faa170-0c75-49ca-9616-bf03777fdfb4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:46:55.473247 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.473229 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-util" (OuterVolumeSpecName: "util") pod "f1dadce4-56db-4bf6-906d-193fc26fe87e" (UID: "f1dadce4-56db-4bf6-906d-193fc26fe87e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:46:55.568578 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.568539 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:55.568578 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.568572 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:55.568578 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.568581 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbb6q\" (UniqueName: \"kubernetes.io/projected/93faa170-0c75-49ca-9616-bf03777fdfb4-kube-api-access-dbb6q\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:55.568578 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.568589 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52mk4\" (UniqueName: \"kubernetes.io/projected/f1dadce4-56db-4bf6-906d-193fc26fe87e-kube-api-access-52mk4\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:55.568836 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.568600 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1dadce4-56db-4bf6-906d-193fc26fe87e-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:55.568836 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:55.568609 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93faa170-0c75-49ca-9616-bf03777fdfb4-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:56.230452 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.230422 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" Jun 08 19:46:56.230875 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.230451 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c" event={"ID":"f1dadce4-56db-4bf6-906d-193fc26fe87e","Type":"ContainerDied","Data":"652316d10f1297ef98203bfc726d07b57a70f28ff6c03212f0c118e74f5632a2"} Jun 08 19:46:56.230875 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.230499 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="652316d10f1297ef98203bfc726d07b57a70f28ff6c03212f0c118e74f5632a2" Jun 08 19:46:56.232311 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.232286 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" event={"ID":"93faa170-0c75-49ca-9616-bf03777fdfb4","Type":"ContainerDied","Data":"836cf109c8274ad900f018a82a40f2734819e9ca9dd0036c1359c2798ad5e7dd"} Jun 08 19:46:56.232424 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.232332 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="836cf109c8274ad900f018a82a40f2734819e9ca9dd0036c1359c2798ad5e7dd" Jun 08 19:46:56.232473 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.232424 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw" Jun 08 19:46:56.347236 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.347211 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:56.477224 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.477192 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-bundle\") pod \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " Jun 08 19:46:56.477352 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.477231 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-util\") pod \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " Jun 08 19:46:56.477352 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.477276 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtwls\" (UniqueName: \"kubernetes.io/projected/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-kube-api-access-vtwls\") pod \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\" (UID: \"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54\") " Jun 08 19:46:56.477705 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.477673 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-bundle" (OuterVolumeSpecName: "bundle") pod "5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" (UID: "5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:46:56.479435 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.479404 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-kube-api-access-vtwls" (OuterVolumeSpecName: "kube-api-access-vtwls") pod "5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" (UID: "5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54"). InnerVolumeSpecName "kube-api-access-vtwls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:46:56.482624 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.482549 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-util" (OuterVolumeSpecName: "util") pod "5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" (UID: "5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:46:56.578691 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.578656 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:56.578691 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.578685 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:56.578691 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:56.578694 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtwls\" (UniqueName: \"kubernetes.io/projected/5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54-kube-api-access-vtwls\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:46:57.242148 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:57.242112 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" event={"ID":"5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54","Type":"ContainerDied","Data":"32032f1ada9f32875504c471364b3abd22da2166cde52295263a1e551188ff59"} Jun 08 19:46:57.242488 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:57.242160 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx" Jun 08 19:46:57.242488 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:46:57.242199 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32032f1ada9f32875504c471364b3abd22da2166cde52295263a1e551188ff59" Jun 08 19:47:08.380076 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380038 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb"] Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380351 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerName="util" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380362 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerName="util" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380374 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerName="extract" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380380 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerName="extract" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380391 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerName="util" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380396 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerName="util" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380403 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerName="util" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380409 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerName="util" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380416 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerName="pull" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380422 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerName="pull" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380430 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerName="extract" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380436 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerName="extract" Jun 08 19:47:08.380440 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380443 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerName="pull" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380448 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerName="pull" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380456 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerName="extract" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380462 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerName="extract" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380468 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerName="util" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380473 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerName="util" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380482 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerName="pull" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380487 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerName="pull" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380494 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerName="pull" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380499 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerName="pull" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380503 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerName="extract" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380508 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerName="extract" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380558 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="93faa170-0c75-49ca-9616-bf03777fdfb4" containerName="extract" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380565 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="be55ddab-934f-4cb0-b205-2a53aca6d10e" containerName="extract" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380571 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1dadce4-56db-4bf6-906d-193fc26fe87e" containerName="extract" Jun 08 19:47:08.380816 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.380578 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54" containerName="extract" Jun 08 19:47:08.382520 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.382504 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:08.386282 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.386254 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8ncj\"" Jun 08 19:47:08.389767 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.389642 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j9wf\" (UniqueName: \"kubernetes.io/projected/c7ae0579-6fd7-4028-84ff-225c48a7e172-kube-api-access-5j9wf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" (UID: \"c7ae0579-6fd7-4028-84ff-225c48a7e172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:08.389767 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.389706 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7ae0579-6fd7-4028-84ff-225c48a7e172-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" (UID: \"c7ae0579-6fd7-4028-84ff-225c48a7e172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:08.406642 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.406608 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb"] Jun 08 19:47:08.491008 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.490960 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9wf\" (UniqueName: \"kubernetes.io/projected/c7ae0579-6fd7-4028-84ff-225c48a7e172-kube-api-access-5j9wf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" (UID: \"c7ae0579-6fd7-4028-84ff-225c48a7e172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:08.491172 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.491042 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7ae0579-6fd7-4028-84ff-225c48a7e172-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" (UID: \"c7ae0579-6fd7-4028-84ff-225c48a7e172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:08.491499 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.491478 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7ae0579-6fd7-4028-84ff-225c48a7e172-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" (UID: \"c7ae0579-6fd7-4028-84ff-225c48a7e172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:08.512683 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.512649 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9wf\" (UniqueName: \"kubernetes.io/projected/c7ae0579-6fd7-4028-84ff-225c48a7e172-kube-api-access-5j9wf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" (UID: \"c7ae0579-6fd7-4028-84ff-225c48a7e172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:08.693563 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.693470 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:08.836118 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:08.836092 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb"] Jun 08 19:47:08.837853 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:47:08.837825 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ae0579_6fd7_4028_84ff_225c48a7e172.slice/crio-5137025bccf320e5503e28222dfc945f1fc79a454da1bc7364a1b320c5a657ca WatchSource:0}: Error finding container 5137025bccf320e5503e28222dfc945f1fc79a454da1bc7364a1b320c5a657ca: Status 404 returned error can't find the container with id 5137025bccf320e5503e28222dfc945f1fc79a454da1bc7364a1b320c5a657ca Jun 08 19:47:09.312624 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:09.312587 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" event={"ID":"c7ae0579-6fd7-4028-84ff-225c48a7e172","Type":"ContainerStarted","Data":"5137025bccf320e5503e28222dfc945f1fc79a454da1bc7364a1b320c5a657ca"} Jun 08 19:47:13.229695 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.229610 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt"] Jun 08 19:47:13.234042 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.234016 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" Jun 08 19:47:13.236563 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.236540 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 19:47:13.236694 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.236671 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6k7t6\"" Jun 08 19:47:13.251233 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.251199 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt"] Jun 08 19:47:13.332268 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.332230 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkt7b\" (UniqueName: \"kubernetes.io/projected/7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f-kube-api-access-lkt7b\") pod \"dns-operator-controller-manager-864dd78c4c-sgxdt\" (UID: \"7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" Jun 08 19:47:13.433508 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.433467 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkt7b\" (UniqueName: \"kubernetes.io/projected/7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f-kube-api-access-lkt7b\") pod \"dns-operator-controller-manager-864dd78c4c-sgxdt\" (UID: \"7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" Jun 08 19:47:13.442379 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.442345 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkt7b\" (UniqueName: \"kubernetes.io/projected/7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f-kube-api-access-lkt7b\") pod \"dns-operator-controller-manager-864dd78c4c-sgxdt\" (UID: \"7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" Jun 08 19:47:13.544776 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.544744 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" Jun 08 19:47:13.693801 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:13.693775 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt"] Jun 08 19:47:13.695618 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:47:13.695590 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8b3be4_f746_4dc8_bb9f_89a22e0bc37f.slice/crio-b722359116712c2ef0b51e2f8cfe99b6bebbc9b4e126754736613923ed37399d WatchSource:0}: Error finding container b722359116712c2ef0b51e2f8cfe99b6bebbc9b4e126754736613923ed37399d: Status 404 returned error can't find the container with id b722359116712c2ef0b51e2f8cfe99b6bebbc9b4e126754736613923ed37399d Jun 08 19:47:14.345591 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:14.345541 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" event={"ID":"7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f","Type":"ContainerStarted","Data":"b722359116712c2ef0b51e2f8cfe99b6bebbc9b4e126754736613923ed37399d"} Jun 08 19:47:15.394306 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:15.394263 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5"] Jun 08 19:47:15.397155 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:15.397130 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:15.399800 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:15.399775 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7n49w\"" Jun 08 19:47:15.412175 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:15.412147 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5"] Jun 08 19:47:15.451742 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:15.451701 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvt7\" (UniqueName: \"kubernetes.io/projected/a73f87f1-cfe5-467c-a21c-8801b8399284-kube-api-access-bxvt7\") pod \"limitador-operator-controller-manager-859d7b78bd-xwjf5\" (UID: \"a73f87f1-cfe5-467c-a21c-8801b8399284\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:15.553190 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:15.553149 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvt7\" (UniqueName: \"kubernetes.io/projected/a73f87f1-cfe5-467c-a21c-8801b8399284-kube-api-access-bxvt7\") pod \"limitador-operator-controller-manager-859d7b78bd-xwjf5\" (UID: \"a73f87f1-cfe5-467c-a21c-8801b8399284\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:15.562046 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:15.562016 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvt7\" (UniqueName: \"kubernetes.io/projected/a73f87f1-cfe5-467c-a21c-8801b8399284-kube-api-access-bxvt7\") pod \"limitador-operator-controller-manager-859d7b78bd-xwjf5\" (UID: \"a73f87f1-cfe5-467c-a21c-8801b8399284\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:15.710233 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:15.710135 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:16.901899 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:16.901873 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5"] Jun 08 19:47:16.903286 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:47:16.903257 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73f87f1_cfe5_467c_a21c_8801b8399284.slice/crio-f93a0eca22469b43ca9bbf8aa6709ea0f3bf6fa2443aec945f8d200c7ced9041 WatchSource:0}: Error finding container f93a0eca22469b43ca9bbf8aa6709ea0f3bf6fa2443aec945f8d200c7ced9041: Status 404 returned error can't find the container with id f93a0eca22469b43ca9bbf8aa6709ea0f3bf6fa2443aec945f8d200c7ced9041 Jun 08 19:47:17.370298 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:17.370263 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" event={"ID":"7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f","Type":"ContainerStarted","Data":"9f9bedc257ea58e3adb5a2867bf61633c9e197ed7621a668e00dde323eb65824"} Jun 08 19:47:17.370512 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:17.370464 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" Jun 08 19:47:17.372070 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:17.372044 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" event={"ID":"c7ae0579-6fd7-4028-84ff-225c48a7e172","Type":"ContainerStarted","Data":"7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1"} Jun 08 19:47:17.372171 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:17.372096 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:17.373504 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:17.373484 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" event={"ID":"a73f87f1-cfe5-467c-a21c-8801b8399284","Type":"ContainerStarted","Data":"f93a0eca22469b43ca9bbf8aa6709ea0f3bf6fa2443aec945f8d200c7ced9041"} Jun 08 19:47:17.397297 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:17.397233 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" podStartSLOduration=1.332955996 podStartE2EDuration="4.397209268s" totalImagesPullingTime="3.064253272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:17.394171948 +0000 UTC m=+1245.374442960" watchObservedRunningTime="2026-06-08 19:47:17.397209268 +0000 UTC m=+1245.377480280" Jun 08 19:47:17.448346 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:17.448288 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" podStartSLOduration=1.523560678 podStartE2EDuration="9.448268593s" totalImagesPullingTime="7.924707915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:17.446548255 +0000 UTC m=+1245.426819266" watchObservedRunningTime="2026-06-08 19:47:17.448268593 +0000 UTC m=+1245.428539670" Jun 08 19:47:19.387156 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.387114 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" event={"ID":"a73f87f1-cfe5-467c-a21c-8801b8399284","Type":"ContainerStarted","Data":"8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e"} Jun 08 19:47:19.387620 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.387252 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:19.405747 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.405686 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" podStartSLOduration=2.756649904 podStartE2EDuration="4.405670354s" totalImagesPullingTime="1.64902045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:19.403012192 +0000 UTC m=+1247.383283205" watchObservedRunningTime="2026-06-08 19:47:19.405670354 +0000 UTC m=+1247.385941365" Jun 08 19:47:19.953376 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.953336 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d"] Jun 08 19:47:19.956973 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.956947 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:19.959755 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.959728 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 19:47:19.959755 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.959742 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 19:47:19.959897 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.959742 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n8rpr\"" Jun 08 19:47:19.965386 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.965358 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d"] Jun 08 19:47:19.993883 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.993843 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d514ad52-89af-431d-9078-06ce5747f0b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:19.994070 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.993929 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d514ad52-89af-431d-9078-06ce5747f0b0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:19.994070 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:19.993952 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5m5c\" (UniqueName: \"kubernetes.io/projected/d514ad52-89af-431d-9078-06ce5747f0b0-kube-api-access-d5m5c\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:20.095339 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:20.095298 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d514ad52-89af-431d-9078-06ce5747f0b0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:20.095533 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:20.095352 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5m5c\" (UniqueName: \"kubernetes.io/projected/d514ad52-89af-431d-9078-06ce5747f0b0-kube-api-access-d5m5c\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:20.095533 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:20.095419 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d514ad52-89af-431d-9078-06ce5747f0b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:20.095533 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:20.095525 2549 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 08 19:47:20.095664 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:20.095602 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d514ad52-89af-431d-9078-06ce5747f0b0-plugin-serving-cert podName:d514ad52-89af-431d-9078-06ce5747f0b0 nodeName:}" failed. No retries permitted until 2026-06-08 19:47:20.595578682 +0000 UTC m=+1248.575849684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/d514ad52-89af-431d-9078-06ce5747f0b0-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-5xl5d" (UID: "d514ad52-89af-431d-9078-06ce5747f0b0") : secret "plugin-serving-cert" not found Jun 08 19:47:20.096165 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:20.096141 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d514ad52-89af-431d-9078-06ce5747f0b0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:20.104021 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:20.103985 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5m5c\" (UniqueName: \"kubernetes.io/projected/d514ad52-89af-431d-9078-06ce5747f0b0-kube-api-access-d5m5c\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:20.600049 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:20.600009 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d514ad52-89af-431d-9078-06ce5747f0b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:20.602574 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:20.602548 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d514ad52-89af-431d-9078-06ce5747f0b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5xl5d\" (UID: \"d514ad52-89af-431d-9078-06ce5747f0b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:20.868218 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:20.868116 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" Jun 08 19:47:21.003556 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:21.003525 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d"] Jun 08 19:47:21.004826 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:47:21.004800 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd514ad52_89af_431d_9078_06ce5747f0b0.slice/crio-208004b3b7e5dad517e0476177746cee15431bfa4ed8db97761466d122cb021e WatchSource:0}: Error finding container 208004b3b7e5dad517e0476177746cee15431bfa4ed8db97761466d122cb021e: Status 404 returned error can't find the container with id 208004b3b7e5dad517e0476177746cee15431bfa4ed8db97761466d122cb021e Jun 08 19:47:21.399294 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:21.399257 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" event={"ID":"d514ad52-89af-431d-9078-06ce5747f0b0","Type":"ContainerStarted","Data":"208004b3b7e5dad517e0476177746cee15431bfa4ed8db97761466d122cb021e"} Jun 08 19:47:28.382872 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:28.382840 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:28.383366 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:28.382946 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sgxdt" Jun 08 19:47:30.208825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.208791 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb"] Jun 08 19:47:30.209288 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.208990 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" containerName="manager" containerID="cri-o://7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1" gracePeriod=2 Jun 08 19:47:30.221942 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:30.221875 2549 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c7ae0579-6fd7-4028-84ff-225c48a7e172\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\": pods \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:30.225555 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.224894 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb"] Jun 08 19:47:30.233733 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.233696 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml"] Jun 08 19:47:30.241702 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.241135 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" containerName="manager" Jun 08 19:47:30.241702 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.241176 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" containerName="manager" Jun 08 19:47:30.241702 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.241388 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" containerName="manager" Jun 08 19:47:30.251663 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.251611 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:30.253028 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.252997 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5"] Jun 08 19:47:30.254185 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.254149 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" containerName="manager" containerID="cri-o://8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e" gracePeriod=2 Jun 08 19:47:30.255863 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.255783 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:30.257242 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.257216 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml"] Jun 08 19:47:30.260553 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:30.260368 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:30.263726 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.263700 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5"] Jun 08 19:47:30.283947 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.283889 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58"] Jun 08 19:47:30.284372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.284350 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" containerName="manager" Jun 08 19:47:30.284372 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.284374 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" containerName="manager" Jun 08 19:47:30.284538 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.284499 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" containerName="manager" Jun 08 19:47:30.289947 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.289920 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" Jun 08 19:47:30.294086 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:30.294035 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:30.304843 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.304644 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58"] Jun 08 19:47:30.328443 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:30.328403 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xwjf5\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:30.392344 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.392305 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kw72\" (UniqueName: \"kubernetes.io/projected/0b1c348c-4174-4deb-b76d-5630b0a0e51d-kube-api-access-9kw72\") pod \"limitador-operator-controller-manager-859d7b78bd-9zj58\" (UID: \"0b1c348c-4174-4deb-b76d-5630b0a0e51d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" Jun 08 19:47:30.392527 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.392361 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3efbd786-d55d-4718-b96a-34ef514f228e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bbzml\" (UID: \"3efbd786-d55d-4718-b96a-34ef514f228e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:30.392527 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.392449 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmftg\" (UniqueName: \"kubernetes.io/projected/3efbd786-d55d-4718-b96a-34ef514f228e-kube-api-access-lmftg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bbzml\" (UID: \"3efbd786-d55d-4718-b96a-34ef514f228e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:30.493800 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.493692 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmftg\" (UniqueName: \"kubernetes.io/projected/3efbd786-d55d-4718-b96a-34ef514f228e-kube-api-access-lmftg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bbzml\" (UID: \"3efbd786-d55d-4718-b96a-34ef514f228e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:30.493800 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.493797 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kw72\" (UniqueName: \"kubernetes.io/projected/0b1c348c-4174-4deb-b76d-5630b0a0e51d-kube-api-access-9kw72\") pod \"limitador-operator-controller-manager-859d7b78bd-9zj58\" (UID: \"0b1c348c-4174-4deb-b76d-5630b0a0e51d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" Jun 08 19:47:30.494105 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.493846 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3efbd786-d55d-4718-b96a-34ef514f228e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bbzml\" (UID: \"3efbd786-d55d-4718-b96a-34ef514f228e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:30.494356 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.494335 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3efbd786-d55d-4718-b96a-34ef514f228e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bbzml\" (UID: \"3efbd786-d55d-4718-b96a-34ef514f228e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:30.503989 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.503956 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kw72\" (UniqueName: \"kubernetes.io/projected/0b1c348c-4174-4deb-b76d-5630b0a0e51d-kube-api-access-9kw72\") pod \"limitador-operator-controller-manager-859d7b78bd-9zj58\" (UID: \"0b1c348c-4174-4deb-b76d-5630b0a0e51d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" Jun 08 19:47:30.504145 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.504006 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmftg\" (UniqueName: \"kubernetes.io/projected/3efbd786-d55d-4718-b96a-34ef514f228e-kube-api-access-lmftg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bbzml\" (UID: \"3efbd786-d55d-4718-b96a-34ef514f228e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:30.618578 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.618537 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:30.626187 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:30.626152 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" Jun 08 19:47:44.981611 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:44.981582 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:44.983889 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:44.983851 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xwjf5\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:44.984857 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:44.984827 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml"] Jun 08 19:47:44.985688 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:47:44.985662 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efbd786_d55d_4718_b96a_34ef514f228e.slice/crio-4537acafc6fff3cefc3a7aacbcd57262e6d7fdcfba126c342bc8067ef8ad5904 WatchSource:0}: Error finding container 4537acafc6fff3cefc3a7aacbcd57262e6d7fdcfba126c342bc8067ef8ad5904: Status 404 returned error can't find the container with id 4537acafc6fff3cefc3a7aacbcd57262e6d7fdcfba126c342bc8067ef8ad5904 Jun 08 19:47:44.985792 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:44.985769 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:44.988104 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:44.987980 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:44.990035 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:44.990004 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xwjf5\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:45.011144 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.011112 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58"] Jun 08 19:47:45.019139 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:47:45.019112 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1c348c_4174_4deb_b76d_5630b0a0e51d.slice/crio-598fa82e8794ad50f49ba846c40a9392d3a45d348fb6b1dbc759403e4258d6e5 WatchSource:0}: Error finding container 598fa82e8794ad50f49ba846c40a9392d3a45d348fb6b1dbc759403e4258d6e5: Status 404 returned error can't find the container with id 598fa82e8794ad50f49ba846c40a9392d3a45d348fb6b1dbc759403e4258d6e5 Jun 08 19:47:45.044273 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.044246 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxvt7\" (UniqueName: \"kubernetes.io/projected/a73f87f1-cfe5-467c-a21c-8801b8399284-kube-api-access-bxvt7\") pod \"a73f87f1-cfe5-467c-a21c-8801b8399284\" (UID: \"a73f87f1-cfe5-467c-a21c-8801b8399284\") " Jun 08 19:47:45.044416 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.044283 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j9wf\" (UniqueName: \"kubernetes.io/projected/c7ae0579-6fd7-4028-84ff-225c48a7e172-kube-api-access-5j9wf\") pod \"c7ae0579-6fd7-4028-84ff-225c48a7e172\" (UID: \"c7ae0579-6fd7-4028-84ff-225c48a7e172\") " Jun 08 19:47:45.044416 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.044321 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7ae0579-6fd7-4028-84ff-225c48a7e172-extensions-socket-volume\") pod \"c7ae0579-6fd7-4028-84ff-225c48a7e172\" (UID: \"c7ae0579-6fd7-4028-84ff-225c48a7e172\") " Jun 08 19:47:45.044986 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.044960 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ae0579-6fd7-4028-84ff-225c48a7e172-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c7ae0579-6fd7-4028-84ff-225c48a7e172" (UID: "c7ae0579-6fd7-4028-84ff-225c48a7e172"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:47:45.047077 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.047054 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ae0579-6fd7-4028-84ff-225c48a7e172-kube-api-access-5j9wf" (OuterVolumeSpecName: "kube-api-access-5j9wf") pod "c7ae0579-6fd7-4028-84ff-225c48a7e172" (UID: "c7ae0579-6fd7-4028-84ff-225c48a7e172"). InnerVolumeSpecName "kube-api-access-5j9wf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:47:45.047168 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.047086 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73f87f1-cfe5-467c-a21c-8801b8399284-kube-api-access-bxvt7" (OuterVolumeSpecName: "kube-api-access-bxvt7") pod "a73f87f1-cfe5-467c-a21c-8801b8399284" (UID: "a73f87f1-cfe5-467c-a21c-8801b8399284"). InnerVolumeSpecName "kube-api-access-bxvt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:47:45.145643 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.145605 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxvt7\" (UniqueName: \"kubernetes.io/projected/a73f87f1-cfe5-467c-a21c-8801b8399284-kube-api-access-bxvt7\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:47:45.145643 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.145640 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j9wf\" (UniqueName: \"kubernetes.io/projected/c7ae0579-6fd7-4028-84ff-225c48a7e172-kube-api-access-5j9wf\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:47:45.145643 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.145650 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7ae0579-6fd7-4028-84ff-225c48a7e172-extensions-socket-volume\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:47:45.561721 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.561685 2549 generic.go:356] "Generic (PLEG): container finished" podID="c7ae0579-6fd7-4028-84ff-225c48a7e172" containerID="7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1" exitCode=0 Jun 08 19:47:45.561987 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.561729 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:45.561987 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.561775 2549 scope.go:117] "RemoveContainer" containerID="7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1" Jun 08 19:47:45.563259 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.563233 2549 generic.go:356] "Generic (PLEG): container finished" podID="a73f87f1-cfe5-467c-a21c-8801b8399284" containerID="8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e" exitCode=0 Jun 08 19:47:45.563388 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.563275 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:45.564221 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:45.564189 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:45.565455 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.565393 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" event={"ID":"d514ad52-89af-431d-9078-06ce5747f0b0","Type":"ContainerStarted","Data":"b52006503cecee7fc11df6100bd320d575478c91e21770c41eb45083ea7c6656"} Jun 08 19:47:45.568095 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:45.567998 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xwjf5\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:45.568839 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.568297 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" event={"ID":"0b1c348c-4174-4deb-b76d-5630b0a0e51d","Type":"ContainerStarted","Data":"abed3b8624500de5d0a2c4d1af75a6ec5f267483c54b52111369b663789abbc1"} Jun 08 19:47:45.568839 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.568407 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" event={"ID":"0b1c348c-4174-4deb-b76d-5630b0a0e51d","Type":"ContainerStarted","Data":"598fa82e8794ad50f49ba846c40a9392d3a45d348fb6b1dbc759403e4258d6e5"} Jun 08 19:47:45.573099 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.569243 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" Jun 08 19:47:45.573099 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:45.570520 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:45.574833 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.574638 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" event={"ID":"3efbd786-d55d-4718-b96a-34ef514f228e","Type":"ContainerStarted","Data":"a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f"} Jun 08 19:47:45.574833 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.574711 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" event={"ID":"3efbd786-d55d-4718-b96a-34ef514f228e","Type":"ContainerStarted","Data":"4537acafc6fff3cefc3a7aacbcd57262e6d7fdcfba126c342bc8067ef8ad5904"} Jun 08 19:47:45.576258 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.575480 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:45.577483 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.577463 2549 scope.go:117] "RemoveContainer" containerID="7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1" Jun 08 19:47:45.577787 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:45.577763 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1\": container with ID starting with 7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1 not found: ID does not exist" containerID="7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1" Jun 08 19:47:45.577881 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.577795 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1"} err="failed to get container status \"7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1\": rpc error: code = NotFound desc = could not find container \"7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1\": container with ID starting with 7be4c7c25c877685629858753573bf2ccdc8b42814bd077b9404ccb3a52668e1 not found: ID does not exist" Jun 08 19:47:45.577881 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.577812 2549 scope.go:117] "RemoveContainer" containerID="8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e" Jun 08 19:47:45.585976 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.585894 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xl5d" podStartSLOduration=2.700662314 podStartE2EDuration="26.585875433s" totalImagesPullingTime="23.885213119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:45.585201024 +0000 UTC m=+1273.565472036" watchObservedRunningTime="2026-06-08 19:47:45.585875433 +0000 UTC m=+1273.566146444" Jun 08 19:47:45.587587 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:45.587484 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xwjf5\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:45.587703 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.587681 2549 scope.go:117] "RemoveContainer" containerID="8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e" Jun 08 19:47:45.588035 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:45.588015 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e\": container with ID starting with 8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e not found: ID does not exist" containerID="8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e" Jun 08 19:47:45.588105 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.588048 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e"} err="failed to get container status \"8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e\": rpc error: code = NotFound desc = could not find container \"8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e\": container with ID starting with 8f40eb7f2dd913153794cb1949393e213b4685b26a335b4945c8e8d384f9676e not found: ID does not exist" Jun 08 19:47:45.609502 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.609445 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" podStartSLOduration=15.609422118 podStartE2EDuration="15.609422118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:45.607357338 +0000 UTC m=+1273.587628351" watchObservedRunningTime="2026-06-08 19:47:45.609422118 +0000 UTC m=+1273.589693130" Jun 08 19:47:45.624169 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:45.624119 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xwjf5\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xwjf5" Jun 08 19:47:45.624386 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:45.624349 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" podStartSLOduration=15.624338432 podStartE2EDuration="15.624338432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:45.622094447 +0000 UTC m=+1273.602365461" watchObservedRunningTime="2026-06-08 19:47:45.624338432 +0000 UTC m=+1273.604609443" Jun 08 19:47:45.626146 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:45.626117 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gwrkb\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gwrkb" Jun 08 19:47:46.470226 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:46.470189 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a73f87f1-cfe5-467c-a21c-8801b8399284" path="/var/lib/kubelet/pods/a73f87f1-cfe5-467c-a21c-8801b8399284/volumes" Jun 08 19:47:46.470610 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:46.470544 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ae0579-6fd7-4028-84ff-225c48a7e172" path="/var/lib/kubelet/pods/c7ae0579-6fd7-4028-84ff-225c48a7e172/volumes" Jun 08 19:47:46.579558 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:46.579520 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml"] Jun 08 19:47:47.591136 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:47.591094 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" podUID="3efbd786-d55d-4718-b96a-34ef514f228e" containerName="manager" containerID="cri-o://a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f" gracePeriod=10 Jun 08 19:47:47.922637 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:47.922600 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:47.970258 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:47.970228 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmftg\" (UniqueName: \"kubernetes.io/projected/3efbd786-d55d-4718-b96a-34ef514f228e-kube-api-access-lmftg\") pod \"3efbd786-d55d-4718-b96a-34ef514f228e\" (UID: \"3efbd786-d55d-4718-b96a-34ef514f228e\") " Jun 08 19:47:47.970407 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:47.970279 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3efbd786-d55d-4718-b96a-34ef514f228e-extensions-socket-volume\") pod \"3efbd786-d55d-4718-b96a-34ef514f228e\" (UID: \"3efbd786-d55d-4718-b96a-34ef514f228e\") " Jun 08 19:47:47.970635 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:47.970612 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efbd786-d55d-4718-b96a-34ef514f228e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3efbd786-d55d-4718-b96a-34ef514f228e" (UID: "3efbd786-d55d-4718-b96a-34ef514f228e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:47:47.972409 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:47.972385 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efbd786-d55d-4718-b96a-34ef514f228e-kube-api-access-lmftg" (OuterVolumeSpecName: "kube-api-access-lmftg") pod "3efbd786-d55d-4718-b96a-34ef514f228e" (UID: "3efbd786-d55d-4718-b96a-34ef514f228e"). InnerVolumeSpecName "kube-api-access-lmftg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:47:48.071386 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.071347 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmftg\" (UniqueName: \"kubernetes.io/projected/3efbd786-d55d-4718-b96a-34ef514f228e-kube-api-access-lmftg\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:47:48.071386 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.071379 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3efbd786-d55d-4718-b96a-34ef514f228e-extensions-socket-volume\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:47:48.598036 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.597999 2549 generic.go:356] "Generic (PLEG): container finished" podID="3efbd786-d55d-4718-b96a-34ef514f228e" containerID="a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f" exitCode=0 Jun 08 19:47:48.598469 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.598045 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" Jun 08 19:47:48.598469 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.598088 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" event={"ID":"3efbd786-d55d-4718-b96a-34ef514f228e","Type":"ContainerDied","Data":"a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f"} Jun 08 19:47:48.598469 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.598141 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml" event={"ID":"3efbd786-d55d-4718-b96a-34ef514f228e","Type":"ContainerDied","Data":"4537acafc6fff3cefc3a7aacbcd57262e6d7fdcfba126c342bc8067ef8ad5904"} Jun 08 19:47:48.598469 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.598163 2549 scope.go:117] "RemoveContainer" containerID="a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f" Jun 08 19:47:48.607343 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.607324 2549 scope.go:117] "RemoveContainer" containerID="a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f" Jun 08 19:47:48.607589 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:47:48.607571 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f\": container with ID starting with a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f not found: ID does not exist" containerID="a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f" Jun 08 19:47:48.607647 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.607597 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f"} err="failed to get container status \"a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f\": rpc error: code = NotFound desc = could not find container \"a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f\": container with ID starting with a62239adbdd5bc285c9c3ea5166db48cef7995d887b708c2844113b683f3542f not found: ID does not exist" Jun 08 19:47:48.617983 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.617957 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml"] Jun 08 19:47:48.619992 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:48.619971 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bbzml"] Jun 08 19:47:50.470065 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:50.470025 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3efbd786-d55d-4718-b96a-34ef514f228e" path="/var/lib/kubelet/pods/3efbd786-d55d-4718-b96a-34ef514f228e/volumes" Jun 08 19:47:56.585689 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:47:56.585652 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zj58" Jun 08 19:48:02.900524 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.900490 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm"] Jun 08 19:48:02.900890 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.900823 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efbd786-d55d-4718-b96a-34ef514f228e" containerName="manager" Jun 08 19:48:02.900890 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.900834 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efbd786-d55d-4718-b96a-34ef514f228e" containerName="manager" Jun 08 19:48:02.901027 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.900920 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efbd786-d55d-4718-b96a-34ef514f228e" containerName="manager" Jun 08 19:48:02.959488 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.959440 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm"] Jun 08 19:48:02.959691 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.959581 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:02.961954 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.961933 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jr8xf\"" Jun 08 19:48:02.975487 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.975459 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:02.975617 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.975595 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:02.975717 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.975660 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:02.975717 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.975687 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:02.975814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.975719 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:02.975814 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.975778 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49mpz\" (UniqueName: \"kubernetes.io/projected/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-kube-api-access-49mpz\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:02.975917 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.975835 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:02.975917 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.975874 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:02.976037 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:02.975930 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077264 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077224 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077449 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077275 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077449 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077292 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077449 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077312 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077449 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077329 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49mpz\" (UniqueName: \"kubernetes.io/projected/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-kube-api-access-49mpz\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077449 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077352 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077449 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077383 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077449 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077400 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077821 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077670 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.077821 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077688 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.078023 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.077715 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.078505 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.078468 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.078505 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.078489 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.078665 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.078607 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.085472 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.081078 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.085472 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.082160 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.085790 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.085766 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49mpz\" (UniqueName: \"kubernetes.io/projected/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-kube-api-access-49mpz\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.087548 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.087526 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da0a977-b2ab-4c03-87f8-db53b0bb1e22-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-vbbtm\" (UID: \"4da0a977-b2ab-4c03-87f8-db53b0bb1e22\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.269376 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.269274 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:03.407753 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.407720 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm"] Jun 08 19:48:03.409027 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:48:03.408992 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da0a977_b2ab_4c03_87f8_db53b0bb1e22.slice/crio-34bd8e489fd357e6b0d92dc076a90c7fab31cdab930c750877f5b3b7b160e61c WatchSource:0}: Error finding container 34bd8e489fd357e6b0d92dc076a90c7fab31cdab930c750877f5b3b7b160e61c: Status 404 returned error can't find the container with id 34bd8e489fd357e6b0d92dc076a90c7fab31cdab930c750877f5b3b7b160e61c Jun 08 19:48:03.411312 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.411276 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:48:03.411394 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.411345 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:48:03.411433 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.411395 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:48:03.689325 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.689285 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" event={"ID":"4da0a977-b2ab-4c03-87f8-db53b0bb1e22","Type":"ContainerStarted","Data":"5533d6bf6c69fc5f9a223c9e6c4a985e90031a2c38eabdab5dade8a7b89c3476"} Jun 08 19:48:03.689567 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.689357 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" event={"ID":"4da0a977-b2ab-4c03-87f8-db53b0bb1e22","Type":"ContainerStarted","Data":"34bd8e489fd357e6b0d92dc076a90c7fab31cdab930c750877f5b3b7b160e61c"} Jun 08 19:48:03.710139 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:03.710084 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" podStartSLOduration=1.7100654149999999 podStartE2EDuration="1.710065415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:48:03.708354771 +0000 UTC m=+1291.688625794" watchObservedRunningTime="2026-06-08 19:48:03.710065415 +0000 UTC m=+1291.690336425" Jun 08 19:48:04.269961 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:04.269894 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:04.274724 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:04.274699 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:04.694934 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:04.694877 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:04.696059 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:04.696037 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:48:07.710688 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.710648 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:48:07.713472 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.713452 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:07.716211 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.716188 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 19:48:07.722355 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.722330 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:48:07.745839 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.745802 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:48:07.818677 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.818630 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/84b9b341-b9a0-446d-b29f-496b38c78119-config-file\") pod \"limitador-limitador-54d6d988d5-dvhk9\" (UID: \"84b9b341-b9a0-446d-b29f-496b38c78119\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:07.818841 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.818685 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqsxx\" (UniqueName: \"kubernetes.io/projected/84b9b341-b9a0-446d-b29f-496b38c78119-kube-api-access-bqsxx\") pod \"limitador-limitador-54d6d988d5-dvhk9\" (UID: \"84b9b341-b9a0-446d-b29f-496b38c78119\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:07.919986 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.919947 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/84b9b341-b9a0-446d-b29f-496b38c78119-config-file\") pod \"limitador-limitador-54d6d988d5-dvhk9\" (UID: \"84b9b341-b9a0-446d-b29f-496b38c78119\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:07.920187 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.919998 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqsxx\" (UniqueName: \"kubernetes.io/projected/84b9b341-b9a0-446d-b29f-496b38c78119-kube-api-access-bqsxx\") pod \"limitador-limitador-54d6d988d5-dvhk9\" (UID: \"84b9b341-b9a0-446d-b29f-496b38c78119\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:07.920641 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.920616 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/84b9b341-b9a0-446d-b29f-496b38c78119-config-file\") pod \"limitador-limitador-54d6d988d5-dvhk9\" (UID: \"84b9b341-b9a0-446d-b29f-496b38c78119\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:07.928260 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:07.928233 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqsxx\" (UniqueName: \"kubernetes.io/projected/84b9b341-b9a0-446d-b29f-496b38c78119-kube-api-access-bqsxx\") pod \"limitador-limitador-54d6d988d5-dvhk9\" (UID: \"84b9b341-b9a0-446d-b29f-496b38c78119\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:08.026668 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.026572 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:08.107454 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.107415 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7l4bg"] Jun 08 19:48:08.110361 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.110339 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7l4bg" Jun 08 19:48:08.116350 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.116326 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9wlzl\"" Jun 08 19:48:08.121335 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.121269 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md2dw\" (UniqueName: \"kubernetes.io/projected/947f04da-c74c-4aa9-af99-456379499f09-kube-api-access-md2dw\") pod \"authorino-75d556bd77-7l4bg\" (UID: \"947f04da-c74c-4aa9-af99-456379499f09\") " pod="kuadrant-system/authorino-75d556bd77-7l4bg" Jun 08 19:48:08.122017 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.121975 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7l4bg"] Jun 08 19:48:08.168826 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.168794 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:48:08.170558 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:48:08.170525 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b9b341_b9a0_446d_b29f_496b38c78119.slice/crio-8c8ca1b63b0df16f598ebc4195bcd880f3c71d7195fca3c57126c84a7a0741ba WatchSource:0}: Error finding container 8c8ca1b63b0df16f598ebc4195bcd880f3c71d7195fca3c57126c84a7a0741ba: Status 404 returned error can't find the container with id 8c8ca1b63b0df16f598ebc4195bcd880f3c71d7195fca3c57126c84a7a0741ba Jun 08 19:48:08.222337 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.222300 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md2dw\" (UniqueName: \"kubernetes.io/projected/947f04da-c74c-4aa9-af99-456379499f09-kube-api-access-md2dw\") pod \"authorino-75d556bd77-7l4bg\" (UID: \"947f04da-c74c-4aa9-af99-456379499f09\") " pod="kuadrant-system/authorino-75d556bd77-7l4bg" Jun 08 19:48:08.230162 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.230137 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md2dw\" (UniqueName: \"kubernetes.io/projected/947f04da-c74c-4aa9-af99-456379499f09-kube-api-access-md2dw\") pod \"authorino-75d556bd77-7l4bg\" (UID: \"947f04da-c74c-4aa9-af99-456379499f09\") " pod="kuadrant-system/authorino-75d556bd77-7l4bg" Jun 08 19:48:08.424566 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.424527 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7l4bg" Jun 08 19:48:08.569995 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.569940 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7l4bg"] Jun 08 19:48:08.571726 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:48:08.571695 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod947f04da_c74c_4aa9_af99_456379499f09.slice/crio-b12a9f9585432baabe3e5fcb5025d10178db57ff9e50d10347cdd980f5e595ee WatchSource:0}: Error finding container b12a9f9585432baabe3e5fcb5025d10178db57ff9e50d10347cdd980f5e595ee: Status 404 returned error can't find the container with id b12a9f9585432baabe3e5fcb5025d10178db57ff9e50d10347cdd980f5e595ee Jun 08 19:48:08.725350 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.725260 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7l4bg" event={"ID":"947f04da-c74c-4aa9-af99-456379499f09","Type":"ContainerStarted","Data":"b12a9f9585432baabe3e5fcb5025d10178db57ff9e50d10347cdd980f5e595ee"} Jun 08 19:48:08.728292 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:08.728258 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" event={"ID":"84b9b341-b9a0-446d-b29f-496b38c78119","Type":"ContainerStarted","Data":"8c8ca1b63b0df16f598ebc4195bcd880f3c71d7195fca3c57126c84a7a0741ba"} Jun 08 19:48:12.763575 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:12.763471 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7l4bg" event={"ID":"947f04da-c74c-4aa9-af99-456379499f09","Type":"ContainerStarted","Data":"7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7"} Jun 08 19:48:12.765168 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:12.765134 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" event={"ID":"84b9b341-b9a0-446d-b29f-496b38c78119","Type":"ContainerStarted","Data":"ad42e7f3ec3affdcbd63a67b9ac499d837c66dd53e726dc3151f84cc49b43983"} Jun 08 19:48:12.765318 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:12.765217 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:12.811102 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:12.811048 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7l4bg" podStartSLOduration=0.896635718 podStartE2EDuration="4.811032421s" totalImagesPullingTime="3.914396703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:48:12.808189542 +0000 UTC m=+1300.788460552" watchObservedRunningTime="2026-06-08 19:48:12.811032421 +0000 UTC m=+1300.791303431" Jun 08 19:48:12.849740 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:12.849676 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" podStartSLOduration=1.5342701220000001 podStartE2EDuration="5.849656407s" totalImagesPullingTime="4.315386285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:48:12.848615597 +0000 UTC m=+1300.828886621" watchObservedRunningTime="2026-06-08 19:48:12.849656407 +0000 UTC m=+1300.829927399" Jun 08 19:48:23.771986 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:23.771951 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dvhk9" Jun 08 19:48:39.148783 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.148743 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn"] Jun 08 19:48:39.151979 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.151959 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.154760 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.154737 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 19:48:39.155929 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.155887 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 19:48:39.156047 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.155897 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6ckmw\"" Jun 08 19:48:39.205185 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.205146 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn"] Jun 08 19:48:39.309413 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.309365 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.309413 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.309412 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.309693 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.309493 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwf48\" (UniqueName: \"kubernetes.io/projected/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-kube-api-access-qwf48\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.410631 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.410531 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.410631 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.410574 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.410631 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.410611 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwf48\" (UniqueName: \"kubernetes.io/projected/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-kube-api-access-qwf48\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.410982 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.410959 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.411034 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.410994 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.419577 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.419547 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwf48\" (UniqueName: \"kubernetes.io/projected/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-kube-api-access-qwf48\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.462240 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.462202 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:39.600299 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.600272 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn"] Jun 08 19:48:39.601837 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:48:39.601813 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9733e6b_6fe4_4c33_9975_d41bb549d6b7.slice/crio-6bf70215da328dd4978da91f660fa12b32ac86b0270014342078871bdcdced17 WatchSource:0}: Error finding container 6bf70215da328dd4978da91f660fa12b32ac86b0270014342078871bdcdced17: Status 404 returned error can't find the container with id 6bf70215da328dd4978da91f660fa12b32ac86b0270014342078871bdcdced17 Jun 08 19:48:39.916478 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.916437 2549 generic.go:356] "Generic (PLEG): container finished" podID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerID="197f3e3c69b5b1b44e907e57c89d02c933e993556fe6df0d962f529e63b263c9" exitCode=0 Jun 08 19:48:39.916678 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.916530 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" event={"ID":"e9733e6b-6fe4-4c33-9975-d41bb549d6b7","Type":"ContainerDied","Data":"197f3e3c69b5b1b44e907e57c89d02c933e993556fe6df0d962f529e63b263c9"} Jun 08 19:48:39.916678 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:39.916589 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" event={"ID":"e9733e6b-6fe4-4c33-9975-d41bb549d6b7","Type":"ContainerStarted","Data":"6bf70215da328dd4978da91f660fa12b32ac86b0270014342078871bdcdced17"} Jun 08 19:48:40.924605 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:40.924525 2549 generic.go:356] "Generic (PLEG): container finished" podID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerID="3bb93c3cc1373265e2a73d77144e309cdad59a415e856ed699cf25bd0b7b6197" exitCode=0 Jun 08 19:48:40.925021 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:40.924616 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" event={"ID":"e9733e6b-6fe4-4c33-9975-d41bb549d6b7","Type":"ContainerDied","Data":"3bb93c3cc1373265e2a73d77144e309cdad59a415e856ed699cf25bd0b7b6197"} Jun 08 19:48:41.938602 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:41.938563 2549 generic.go:356] "Generic (PLEG): container finished" podID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerID="e49aee79c5290c33cebf0ce385f0726e6900b6e82362aed0b9992e8a473b4fdb" exitCode=0 Jun 08 19:48:41.939016 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:41.938622 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" event={"ID":"e9733e6b-6fe4-4c33-9975-d41bb549d6b7","Type":"ContainerDied","Data":"e49aee79c5290c33cebf0ce385f0726e6900b6e82362aed0b9992e8a473b4fdb"} Jun 08 19:48:43.134008 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.133969 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:43.245079 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.244984 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-bundle\") pod \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " Jun 08 19:48:43.245079 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.245052 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwf48\" (UniqueName: \"kubernetes.io/projected/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-kube-api-access-qwf48\") pod \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " Jun 08 19:48:43.245079 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.245070 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-util\") pod \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\" (UID: \"e9733e6b-6fe4-4c33-9975-d41bb549d6b7\") " Jun 08 19:48:43.245606 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.245579 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-bundle" (OuterVolumeSpecName: "bundle") pod "e9733e6b-6fe4-4c33-9975-d41bb549d6b7" (UID: "e9733e6b-6fe4-4c33-9975-d41bb549d6b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:48:43.247324 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.247285 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-kube-api-access-qwf48" (OuterVolumeSpecName: "kube-api-access-qwf48") pod "e9733e6b-6fe4-4c33-9975-d41bb549d6b7" (UID: "e9733e6b-6fe4-4c33-9975-d41bb549d6b7"). InnerVolumeSpecName "kube-api-access-qwf48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:48:43.251211 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.251188 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-util" (OuterVolumeSpecName: "util") pod "e9733e6b-6fe4-4c33-9975-d41bb549d6b7" (UID: "e9733e6b-6fe4-4c33-9975-d41bb549d6b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:48:43.345737 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.345688 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwf48\" (UniqueName: \"kubernetes.io/projected/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-kube-api-access-qwf48\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:48:43.345737 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.345727 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-util\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:48:43.345737 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.345740 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9733e6b-6fe4-4c33-9975-d41bb549d6b7-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:48:43.951758 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.951732 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" Jun 08 19:48:43.951972 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.951723 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489n6tn" event={"ID":"e9733e6b-6fe4-4c33-9975-d41bb549d6b7","Type":"ContainerDied","Data":"6bf70215da328dd4978da91f660fa12b32ac86b0270014342078871bdcdced17"} Jun 08 19:48:43.951972 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:48:43.951857 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bf70215da328dd4978da91f660fa12b32ac86b0270014342078871bdcdced17" Jun 08 19:49:32.708708 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.708669 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m8mjc"] Jun 08 19:49:32.709150 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.709038 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerName="pull" Jun 08 19:49:32.709150 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.709050 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerName="pull" Jun 08 19:49:32.709150 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.709059 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerName="extract" Jun 08 19:49:32.709150 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.709065 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerName="extract" Jun 08 19:49:32.709150 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.709080 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerName="util" Jun 08 19:49:32.709150 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.709085 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerName="util" Jun 08 19:49:32.709150 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.709142 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9733e6b-6fe4-4c33-9975-d41bb549d6b7" containerName="extract" Jun 08 19:49:32.711525 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.711508 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m8mjc" Jun 08 19:49:32.719568 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.719087 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m8mjc"] Jun 08 19:49:32.797165 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.797136 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sczmm\" (UniqueName: \"kubernetes.io/projected/285f9a8d-063d-48f2-84f2-14de512ef946-kube-api-access-sczmm\") pod \"authorino-5d4b67c446-m8mjc\" (UID: \"285f9a8d-063d-48f2-84f2-14de512ef946\") " pod="kuadrant-system/authorino-5d4b67c446-m8mjc" Jun 08 19:49:32.885112 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.885074 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m8mjc"] Jun 08 19:49:32.885380 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:49:32.885359 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sczmm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-m8mjc" podUID="285f9a8d-063d-48f2-84f2-14de512ef946" Jun 08 19:49:32.897754 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.897721 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sczmm\" (UniqueName: \"kubernetes.io/projected/285f9a8d-063d-48f2-84f2-14de512ef946-kube-api-access-sczmm\") pod \"authorino-5d4b67c446-m8mjc\" (UID: \"285f9a8d-063d-48f2-84f2-14de512ef946\") " pod="kuadrant-system/authorino-5d4b67c446-m8mjc" Jun 08 19:49:32.910161 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.910128 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sczmm\" (UniqueName: \"kubernetes.io/projected/285f9a8d-063d-48f2-84f2-14de512ef946-kube-api-access-sczmm\") pod \"authorino-5d4b67c446-m8mjc\" (UID: \"285f9a8d-063d-48f2-84f2-14de512ef946\") " pod="kuadrant-system/authorino-5d4b67c446-m8mjc" Jun 08 19:49:32.913456 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.913431 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-8zg5j"] Jun 08 19:49:32.916473 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.916454 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:32.918956 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.918936 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 19:49:32.925142 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.925113 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-8zg5j"] Jun 08 19:49:32.963550 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.963448 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-8zg5j"] Jun 08 19:49:32.964201 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:49:32.964165 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-h47kc tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-h47kc tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-8zg5j" podUID="ad0cc7b7-c534-4072-b47f-a85472f5ccfe" Jun 08 19:49:32.989210 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.989174 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6759d8b7f7-v6bvl"] Jun 08 19:49:32.991717 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.991694 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:49:32.998602 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.998571 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h47kc\" (UniqueName: \"kubernetes.io/projected/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-kube-api-access-h47kc\") pod \"authorino-76877994-8zg5j\" (UID: \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\") " pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:32.998782 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.998766 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cp9r\" (UniqueName: \"kubernetes.io/projected/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-kube-api-access-4cp9r\") pod \"authorino-6759d8b7f7-v6bvl\" (UID: \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\") " pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:49:32.999020 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.999000 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-tls-cert\") pod \"authorino-76877994-8zg5j\" (UID: \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\") " pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:32.999169 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:32.999154 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-tls-cert\") pod \"authorino-6759d8b7f7-v6bvl\" (UID: \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\") " pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:49:33.001736 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.001711 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6759d8b7f7-v6bvl"] Jun 08 19:49:33.099722 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.099685 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-tls-cert\") pod \"authorino-76877994-8zg5j\" (UID: \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\") " pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:33.099947 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.099737 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-tls-cert\") pod \"authorino-6759d8b7f7-v6bvl\" (UID: \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\") " pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:49:33.100042 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.099947 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h47kc\" (UniqueName: \"kubernetes.io/projected/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-kube-api-access-h47kc\") pod \"authorino-76877994-8zg5j\" (UID: \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\") " pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:33.100042 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.100017 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cp9r\" (UniqueName: \"kubernetes.io/projected/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-kube-api-access-4cp9r\") pod \"authorino-6759d8b7f7-v6bvl\" (UID: \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\") " pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:49:33.102773 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.102743 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-tls-cert\") pod \"authorino-76877994-8zg5j\" (UID: \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\") " pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:33.102880 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.102744 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-tls-cert\") pod \"authorino-6759d8b7f7-v6bvl\" (UID: \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\") " pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:49:33.108722 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.108688 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h47kc\" (UniqueName: \"kubernetes.io/projected/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-kube-api-access-h47kc\") pod \"authorino-76877994-8zg5j\" (UID: \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\") " pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:33.108972 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.108955 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cp9r\" (UniqueName: \"kubernetes.io/projected/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-kube-api-access-4cp9r\") pod \"authorino-6759d8b7f7-v6bvl\" (UID: \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\") " pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:49:33.231181 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.231102 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:33.231181 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.231102 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m8mjc" Jun 08 19:49:33.237786 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.237759 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:33.241058 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.241034 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m8mjc" Jun 08 19:49:33.301708 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.301672 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:49:33.301900 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.301788 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-tls-cert\") pod \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\" (UID: \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\") " Jun 08 19:49:33.301900 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.301869 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h47kc\" (UniqueName: \"kubernetes.io/projected/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-kube-api-access-h47kc\") pod \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\" (UID: \"ad0cc7b7-c534-4072-b47f-a85472f5ccfe\") " Jun 08 19:49:33.302073 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.301928 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sczmm\" (UniqueName: \"kubernetes.io/projected/285f9a8d-063d-48f2-84f2-14de512ef946-kube-api-access-sczmm\") pod \"285f9a8d-063d-48f2-84f2-14de512ef946\" (UID: \"285f9a8d-063d-48f2-84f2-14de512ef946\") " Jun 08 19:49:33.304481 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.304134 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ad0cc7b7-c534-4072-b47f-a85472f5ccfe" (UID: "ad0cc7b7-c534-4072-b47f-a85472f5ccfe"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:49:33.304481 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.304172 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-kube-api-access-h47kc" (OuterVolumeSpecName: "kube-api-access-h47kc") pod "ad0cc7b7-c534-4072-b47f-a85472f5ccfe" (UID: "ad0cc7b7-c534-4072-b47f-a85472f5ccfe"). InnerVolumeSpecName "kube-api-access-h47kc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:49:33.304481 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.304195 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/285f9a8d-063d-48f2-84f2-14de512ef946-kube-api-access-sczmm" (OuterVolumeSpecName: "kube-api-access-sczmm") pod "285f9a8d-063d-48f2-84f2-14de512ef946" (UID: "285f9a8d-063d-48f2-84f2-14de512ef946"). InnerVolumeSpecName "kube-api-access-sczmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:49:33.403126 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.403098 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h47kc\" (UniqueName: \"kubernetes.io/projected/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-kube-api-access-h47kc\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:49:33.403126 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.403122 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sczmm\" (UniqueName: \"kubernetes.io/projected/285f9a8d-063d-48f2-84f2-14de512ef946-kube-api-access-sczmm\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:49:33.403126 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.403135 2549 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0cc7b7-c534-4072-b47f-a85472f5ccfe-tls-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:49:33.466730 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.466703 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6759d8b7f7-v6bvl"] Jun 08 19:49:33.467748 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:49:33.467722 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc3cad55_daf9_4fcb_a7a2_c9c96e05d7c5.slice/crio-c4f894c28a858b2ba539e65a30c8a2fe45e82195754d83f4afb6635cbfaea645 WatchSource:0}: Error finding container c4f894c28a858b2ba539e65a30c8a2fe45e82195754d83f4afb6635cbfaea645: Status 404 returned error can't find the container with id c4f894c28a858b2ba539e65a30c8a2fe45e82195754d83f4afb6635cbfaea645 Jun 08 19:49:33.469074 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:33.469057 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:49:34.237678 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.237580 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" event={"ID":"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5","Type":"ContainerStarted","Data":"45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214"} Jun 08 19:49:34.237678 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.237616 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-8zg5j" Jun 08 19:49:34.237678 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.237624 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m8mjc" Jun 08 19:49:34.237678 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.237623 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" event={"ID":"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5","Type":"ContainerStarted","Data":"c4f894c28a858b2ba539e65a30c8a2fe45e82195754d83f4afb6635cbfaea645"} Jun 08 19:49:34.253204 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.253161 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" podStartSLOduration=1.7946845329999999 podStartE2EDuration="2.253145121s" totalImagesPullingTime="458.460588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:49:34.252296801 +0000 UTC m=+1382.232567812" watchObservedRunningTime="2026-06-08 19:49:34.253145121 +0000 UTC m=+1382.233416131" Jun 08 19:49:34.276987 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.276960 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m8mjc"] Jun 08 19:49:34.281485 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.281453 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m8mjc"] Jun 08 19:49:34.283819 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.283796 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7l4bg"] Jun 08 19:49:34.283992 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.283972 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7l4bg" podUID="947f04da-c74c-4aa9-af99-456379499f09" containerName="authorino" containerID="cri-o://7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7" gracePeriod=30 Jun 08 19:49:34.305825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.305795 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-8zg5j"] Jun 08 19:49:34.311157 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.311131 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-8zg5j"] Jun 08 19:49:34.471769 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.471725 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="285f9a8d-063d-48f2-84f2-14de512ef946" path="/var/lib/kubelet/pods/285f9a8d-063d-48f2-84f2-14de512ef946/volumes" Jun 08 19:49:34.472203 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.472179 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0cc7b7-c534-4072-b47f-a85472f5ccfe" path="/var/lib/kubelet/pods/ad0cc7b7-c534-4072-b47f-a85472f5ccfe/volumes" Jun 08 19:49:34.512970 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.512945 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7l4bg" Jun 08 19:49:34.612967 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.612900 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md2dw\" (UniqueName: \"kubernetes.io/projected/947f04da-c74c-4aa9-af99-456379499f09-kube-api-access-md2dw\") pod \"947f04da-c74c-4aa9-af99-456379499f09\" (UID: \"947f04da-c74c-4aa9-af99-456379499f09\") " Jun 08 19:49:34.615052 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.615021 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947f04da-c74c-4aa9-af99-456379499f09-kube-api-access-md2dw" (OuterVolumeSpecName: "kube-api-access-md2dw") pod "947f04da-c74c-4aa9-af99-456379499f09" (UID: "947f04da-c74c-4aa9-af99-456379499f09"). InnerVolumeSpecName "kube-api-access-md2dw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:49:34.714144 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:34.714111 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md2dw\" (UniqueName: \"kubernetes.io/projected/947f04da-c74c-4aa9-af99-456379499f09-kube-api-access-md2dw\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:49:35.243877 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:35.243792 2549 generic.go:356] "Generic (PLEG): container finished" podID="947f04da-c74c-4aa9-af99-456379499f09" containerID="7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7" exitCode=0 Jun 08 19:49:35.243877 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:35.243837 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7l4bg" Jun 08 19:49:35.244352 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:35.243884 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7l4bg" event={"ID":"947f04da-c74c-4aa9-af99-456379499f09","Type":"ContainerDied","Data":"7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7"} Jun 08 19:49:35.244352 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:35.243954 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7l4bg" event={"ID":"947f04da-c74c-4aa9-af99-456379499f09","Type":"ContainerDied","Data":"b12a9f9585432baabe3e5fcb5025d10178db57ff9e50d10347cdd980f5e595ee"} Jun 08 19:49:35.244352 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:35.243974 2549 scope.go:117] "RemoveContainer" containerID="7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7" Jun 08 19:49:35.253728 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:35.253708 2549 scope.go:117] "RemoveContainer" containerID="7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7" Jun 08 19:49:35.254010 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:49:35.253991 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7\": container with ID starting with 7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7 not found: ID does not exist" containerID="7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7" Jun 08 19:49:35.254077 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:35.254017 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7"} err="failed to get container status \"7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7\": rpc error: code = NotFound desc = could not find container \"7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7\": container with ID starting with 7cedfc44a4a9e7473f7199e189424fe93adb2093ac71accf66449e026d31d4e7 not found: ID does not exist" Jun 08 19:49:35.265610 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:35.265585 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7l4bg"] Jun 08 19:49:35.269505 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:35.269476 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7l4bg"] Jun 08 19:49:36.469531 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:49:36.469499 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947f04da-c74c-4aa9-af99-456379499f09" path="/var/lib/kubelet/pods/947f04da-c74c-4aa9-af99-456379499f09/volumes" Jun 08 19:50:13.236114 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.236022 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-ccntv"] Jun 08 19:50:13.236660 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.236442 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947f04da-c74c-4aa9-af99-456379499f09" containerName="authorino" Jun 08 19:50:13.236660 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.236456 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="947f04da-c74c-4aa9-af99-456379499f09" containerName="authorino" Jun 08 19:50:13.236660 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.236518 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="947f04da-c74c-4aa9-af99-456379499f09" containerName="authorino" Jun 08 19:50:13.238677 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.238659 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:50:13.241531 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.241513 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 19:50:13.241654 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.241532 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kq67t\"" Jun 08 19:50:13.259415 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.259382 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:50:13.261934 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.261880 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-ccntv"] Jun 08 19:50:13.360513 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.360475 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gct88\" (UniqueName: \"kubernetes.io/projected/6d3f521e-187a-45cc-bf2c-b3b7858cfb1b-kube-api-access-gct88\") pod \"payload-processing-7c6c859784-ccntv\" (UID: \"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b\") " pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:50:13.461643 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.461605 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gct88\" (UniqueName: \"kubernetes.io/projected/6d3f521e-187a-45cc-bf2c-b3b7858cfb1b-kube-api-access-gct88\") pod \"payload-processing-7c6c859784-ccntv\" (UID: \"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b\") " pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:50:13.469534 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.469506 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gct88\" (UniqueName: \"kubernetes.io/projected/6d3f521e-187a-45cc-bf2c-b3b7858cfb1b-kube-api-access-gct88\") pod \"payload-processing-7c6c859784-ccntv\" (UID: \"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b\") " pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:50:13.558378 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.558348 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:50:13.698608 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:13.698573 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-ccntv"] Jun 08 19:50:13.699168 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:50:13.699136 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3f521e_187a_45cc_bf2c_b3b7858cfb1b.slice/crio-9ba291b1f4b797f2c9deb75ea65c825cd99e37d2a4f8659a3f0cfd59e9304bb4 WatchSource:0}: Error finding container 9ba291b1f4b797f2c9deb75ea65c825cd99e37d2a4f8659a3f0cfd59e9304bb4: Status 404 returned error can't find the container with id 9ba291b1f4b797f2c9deb75ea65c825cd99e37d2a4f8659a3f0cfd59e9304bb4 Jun 08 19:50:14.472153 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:14.472079 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerStarted","Data":"9ba291b1f4b797f2c9deb75ea65c825cd99e37d2a4f8659a3f0cfd59e9304bb4"} Jun 08 19:50:16.477284 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:16.477247 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerStarted","Data":"022caee4b37a528d6712375794ebe6ddbf3fa2c4cc622b56c1271446261fb576"} Jun 08 19:50:16.477657 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:16.477405 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:50:16.492774 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:16.492725 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podStartSLOduration=0.851190996 podStartE2EDuration="3.492705591s" totalImagesPullingTime="2.641514595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:50:16.492209325 +0000 UTC m=+1424.472480350" watchObservedRunningTime="2026-06-08 19:50:16.492705591 +0000 UTC m=+1424.472976605" Jun 08 19:50:20.737099 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:20.737055 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-vbbtm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 08 19:50:20.737639 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:20.737140 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" podUID="4da0a977-b2ab-4c03-87f8-db53b0bb1e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 08 19:50:21.513435 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:21.513392 2549 generic.go:356] "Generic (PLEG): container finished" podID="4da0a977-b2ab-4c03-87f8-db53b0bb1e22" containerID="5533d6bf6c69fc5f9a223c9e6c4a985e90031a2c38eabdab5dade8a7b89c3476" exitCode=0 Jun 08 19:50:21.513644 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:21.513467 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" event={"ID":"4da0a977-b2ab-4c03-87f8-db53b0bb1e22","Type":"ContainerDied","Data":"5533d6bf6c69fc5f9a223c9e6c4a985e90031a2c38eabdab5dade8a7b89c3476"} Jun 08 19:50:21.513902 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:21.513882 2549 scope.go:117] "RemoveContainer" containerID="5533d6bf6c69fc5f9a223c9e6c4a985e90031a2c38eabdab5dade8a7b89c3476" Jun 08 19:50:21.514903 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:21.514881 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:50:21.514989 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:21.514966 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:50:21.515026 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:21.515001 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:50:22.521276 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:22.521242 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" event={"ID":"4da0a977-b2ab-4c03-87f8-db53b0bb1e22","Type":"ContainerStarted","Data":"c7fb9f41a0eb2544b934dd6b4da1eec4cada9984119fba1937628be8c7712379"} Jun 08 19:50:23.270406 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:23.270363 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:50:23.270623 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:23.270601 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-vbbtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jun 08 19:50:23.270684 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:23.270648 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" podUID="4da0a977-b2ab-4c03-87f8-db53b0bb1e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jun 08 19:50:24.270532 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:24.270494 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-vbbtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jun 08 19:50:24.270960 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:24.270564 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" podUID="4da0a977-b2ab-4c03-87f8-db53b0bb1e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jun 08 19:50:25.270373 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:25.270333 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-vbbtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jun 08 19:50:25.270601 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:25.270418 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" podUID="4da0a977-b2ab-4c03-87f8-db53b0bb1e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jun 08 19:50:26.270356 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:26.270320 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-vbbtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jun 08 19:50:26.270533 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:26.270375 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" podUID="4da0a977-b2ab-4c03-87f8-db53b0bb1e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jun 08 19:50:27.273383 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:27.273349 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:50:27.273746 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:27.273698 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:50:27.274329 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:27.274311 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-vbbtm" Jun 08 19:50:27.485390 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:50:27.485363 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:51:01.567889 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.567852 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-768df5499c-hqhpq"] Jun 08 19:51:01.571435 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.571417 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.573960 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.573937 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 08 19:51:01.579166 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.579144 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768df5499c-hqhpq"] Jun 08 19:51:01.691010 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.690969 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/577dafe1-0260-4904-874c-f30e33d7c2b1-oidc-ca\") pod \"authorino-768df5499c-hqhpq\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.691205 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.691028 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/577dafe1-0260-4904-874c-f30e33d7c2b1-tls-cert\") pod \"authorino-768df5499c-hqhpq\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.691205 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.691109 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bhfd\" (UniqueName: \"kubernetes.io/projected/577dafe1-0260-4904-874c-f30e33d7c2b1-kube-api-access-2bhfd\") pod \"authorino-768df5499c-hqhpq\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.792108 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.792071 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/577dafe1-0260-4904-874c-f30e33d7c2b1-oidc-ca\") pod \"authorino-768df5499c-hqhpq\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.792280 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.792117 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/577dafe1-0260-4904-874c-f30e33d7c2b1-tls-cert\") pod \"authorino-768df5499c-hqhpq\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.792280 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.792155 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bhfd\" (UniqueName: \"kubernetes.io/projected/577dafe1-0260-4904-874c-f30e33d7c2b1-kube-api-access-2bhfd\") pod \"authorino-768df5499c-hqhpq\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.792765 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.792741 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/577dafe1-0260-4904-874c-f30e33d7c2b1-oidc-ca\") pod \"authorino-768df5499c-hqhpq\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.794580 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.794553 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/577dafe1-0260-4904-874c-f30e33d7c2b1-tls-cert\") pod \"authorino-768df5499c-hqhpq\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.800595 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.800572 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bhfd\" (UniqueName: \"kubernetes.io/projected/577dafe1-0260-4904-874c-f30e33d7c2b1-kube-api-access-2bhfd\") pod \"authorino-768df5499c-hqhpq\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:01.882083 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:01.882003 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:51:02.043968 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:02.043940 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768df5499c-hqhpq"] Jun 08 19:51:02.044827 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:51:02.044797 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod577dafe1_0260_4904_874c_f30e33d7c2b1.slice/crio-d6dc1cd22fc11d91848d00ae72ce93f206ff3bd2dfec5d67de3363c2227fa178 WatchSource:0}: Error finding container d6dc1cd22fc11d91848d00ae72ce93f206ff3bd2dfec5d67de3363c2227fa178: Status 404 returned error can't find the container with id d6dc1cd22fc11d91848d00ae72ce93f206ff3bd2dfec5d67de3363c2227fa178 Jun 08 19:51:02.763750 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:02.763666 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768df5499c-hqhpq" event={"ID":"577dafe1-0260-4904-874c-f30e33d7c2b1","Type":"ContainerStarted","Data":"2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8"} Jun 08 19:51:02.763750 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:02.763719 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768df5499c-hqhpq" event={"ID":"577dafe1-0260-4904-874c-f30e33d7c2b1","Type":"ContainerStarted","Data":"d6dc1cd22fc11d91848d00ae72ce93f206ff3bd2dfec5d67de3363c2227fa178"} Jun 08 19:51:02.782096 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:02.782033 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-768df5499c-hqhpq" podStartSLOduration=1.410738684 podStartE2EDuration="1.782010263s" totalImagesPullingTime="371.271579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:51:02.779055452 +0000 UTC m=+1470.759326491" watchObservedRunningTime="2026-06-08 19:51:02.782010263 +0000 UTC m=+1470.762281276" Jun 08 19:51:02.812383 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:02.812345 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6759d8b7f7-v6bvl"] Jun 08 19:51:02.812608 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:02.812549 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" podUID="fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5" containerName="authorino" containerID="cri-o://45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214" gracePeriod=30 Jun 08 19:51:03.074942 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.074891 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:51:03.204787 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.204753 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-tls-cert\") pod \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\" (UID: \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\") " Jun 08 19:51:03.204968 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.204871 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cp9r\" (UniqueName: \"kubernetes.io/projected/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-kube-api-access-4cp9r\") pod \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\" (UID: \"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5\") " Jun 08 19:51:03.207216 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.207184 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-kube-api-access-4cp9r" (OuterVolumeSpecName: "kube-api-access-4cp9r") pod "fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5" (UID: "fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5"). InnerVolumeSpecName "kube-api-access-4cp9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:51:03.217588 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.217564 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5" (UID: "fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:51:03.306471 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.306387 2549 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-tls-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:51:03.306471 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.306416 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cp9r\" (UniqueName: \"kubernetes.io/projected/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5-kube-api-access-4cp9r\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:51:03.771209 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.771111 2549 generic.go:356] "Generic (PLEG): container finished" podID="fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5" containerID="45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214" exitCode=0 Jun 08 19:51:03.771209 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.771158 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" Jun 08 19:51:03.771682 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.771218 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" event={"ID":"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5","Type":"ContainerDied","Data":"45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214"} Jun 08 19:51:03.771682 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.771253 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6759d8b7f7-v6bvl" event={"ID":"fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5","Type":"ContainerDied","Data":"c4f894c28a858b2ba539e65a30c8a2fe45e82195754d83f4afb6635cbfaea645"} Jun 08 19:51:03.771682 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.771275 2549 scope.go:117] "RemoveContainer" containerID="45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214" Jun 08 19:51:03.786344 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.786322 2549 scope.go:117] "RemoveContainer" containerID="45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214" Jun 08 19:51:03.786657 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:51:03.786630 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214\": container with ID starting with 45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214 not found: ID does not exist" containerID="45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214" Jun 08 19:51:03.786745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.786661 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214"} err="failed to get container status \"45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214\": rpc error: code = NotFound desc = could not find container \"45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214\": container with ID starting with 45171fc6526f3fdadd66fdef254f4aa8c8f04f9d3f65d9ec3a6fd7cb35831214 not found: ID does not exist" Jun 08 19:51:03.803056 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.803030 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6759d8b7f7-v6bvl"] Jun 08 19:51:03.809287 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:03.809260 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6759d8b7f7-v6bvl"] Jun 08 19:51:04.470406 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:04.470365 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5" path="/var/lib/kubelet/pods/fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5/volumes" Jun 08 19:51:17.625182 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:17.625137 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:51:32.524029 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:32.523999 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:51:32.525327 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:32.525301 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:51:32.533208 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:32.533185 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:51:32.534617 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:32.534596 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:51:37.803549 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:37.803510 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:51:44.695890 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:44.695809 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:51:48.092348 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.092315 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r"] Jun 08 19:51:48.092698 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.092667 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5" containerName="authorino" Jun 08 19:51:48.092698 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.092678 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5" containerName="authorino" Jun 08 19:51:48.093070 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.092758 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc3cad55-daf9-4fcb-a7a2-c9c96e05d7c5" containerName="authorino" Jun 08 19:51:48.097579 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.097555 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.100057 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.099993 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 19:51:48.100272 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.100251 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 19:51:48.100356 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.100341 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8pmmg\"" Jun 08 19:51:48.101249 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.101195 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 19:51:48.105635 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.105284 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r"] Jun 08 19:51:48.195323 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.195288 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ade297e-a0d6-45b4-b603-7ce16c5830ef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.195323 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.195326 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.195543 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.195346 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mhfm\" (UniqueName: \"kubernetes.io/projected/2ade297e-a0d6-45b4-b603-7ce16c5830ef-kube-api-access-8mhfm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.195543 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.195449 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.195543 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.195479 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.195543 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.195510 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.296591 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.296557 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ade297e-a0d6-45b4-b603-7ce16c5830ef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.296591 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.296593 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.296846 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.296615 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mhfm\" (UniqueName: \"kubernetes.io/projected/2ade297e-a0d6-45b4-b603-7ce16c5830ef-kube-api-access-8mhfm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.296846 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.296663 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.296846 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.296686 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.296846 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.296727 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.297167 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.297142 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.297312 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.297214 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.297312 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.297252 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.298890 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.298867 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ade297e-a0d6-45b4-b603-7ce16c5830ef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.299198 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.299181 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ade297e-a0d6-45b4-b603-7ce16c5830ef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.305752 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.305727 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mhfm\" (UniqueName: \"kubernetes.io/projected/2ade297e-a0d6-45b4-b603-7ce16c5830ef-kube-api-access-8mhfm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r\" (UID: \"2ade297e-a0d6-45b4-b603-7ce16c5830ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.409313 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.409212 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:48.546877 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.546847 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r"] Jun 08 19:51:48.548043 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:51:48.548013 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ade297e_a0d6_45b4_b603_7ce16c5830ef.slice/crio-00eae43f9a914c373e1ff07e882697fe1ae2e8123bcda906be35fc26a4110355 WatchSource:0}: Error finding container 00eae43f9a914c373e1ff07e882697fe1ae2e8123bcda906be35fc26a4110355: Status 404 returned error can't find the container with id 00eae43f9a914c373e1ff07e882697fe1ae2e8123bcda906be35fc26a4110355 Jun 08 19:51:48.576565 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:48.576533 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:51:49.031151 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:49.031117 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" event={"ID":"2ade297e-a0d6-45b4-b603-7ce16c5830ef","Type":"ContainerStarted","Data":"00eae43f9a914c373e1ff07e882697fe1ae2e8123bcda906be35fc26a4110355"} Jun 08 19:51:53.058953 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:53.058903 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" event={"ID":"2ade297e-a0d6-45b4-b603-7ce16c5830ef","Type":"ContainerStarted","Data":"a6cfaa425abe5d3095f123b6b75238a55ca106e93886ce7d0030bc5007a6cec2"} Jun 08 19:51:54.066218 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:54.066181 2549 generic.go:356] "Generic (PLEG): container finished" podID="2ade297e-a0d6-45b4-b603-7ce16c5830ef" containerID="a6cfaa425abe5d3095f123b6b75238a55ca106e93886ce7d0030bc5007a6cec2" exitCode=0 Jun 08 19:51:54.066615 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:54.066266 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" event={"ID":"2ade297e-a0d6-45b4-b603-7ce16c5830ef","Type":"ContainerDied","Data":"a6cfaa425abe5d3095f123b6b75238a55ca106e93886ce7d0030bc5007a6cec2"} Jun 08 19:51:54.088899 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:54.088862 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:51:56.081745 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:56.081707 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" event={"ID":"2ade297e-a0d6-45b4-b603-7ce16c5830ef","Type":"ContainerStarted","Data":"a6adf8bdfc0625948fa9a504bf170ad2e0d771d3e2dc0da99f34b4a5ae3768d6"} Jun 08 19:51:56.100869 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:56.100813 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" podStartSLOduration=1.6029137580000001 podStartE2EDuration="8.100799411s" totalImagesPullingTime="4.650920668s" totalInitContainerRuntime="1.846964985s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:51:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:51:56.098511301 +0000 UTC m=+1524.078782312" watchObservedRunningTime="2026-06-08 19:51:56.100799411 +0000 UTC m=+1524.081070421" Jun 08 19:51:58.409627 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:58.409588 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:58.410033 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:58.409651 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:58.422638 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:58.422613 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:51:59.110214 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:51:59.110183 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r" Jun 08 19:52:02.290514 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:52:02.290470 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:52:17.201010 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:52:17.200972 2549 generic.go:356] "Generic (PLEG): container finished" podID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" containerID="022caee4b37a528d6712375794ebe6ddbf3fa2c4cc622b56c1271446261fb576" exitCode=1 Jun 08 19:52:17.201420 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:52:17.201039 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerDied","Data":"022caee4b37a528d6712375794ebe6ddbf3fa2c4cc622b56c1271446261fb576"} Jun 08 19:52:17.201420 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:52:17.201362 2549 scope.go:117] "RemoveContainer" containerID="022caee4b37a528d6712375794ebe6ddbf3fa2c4cc622b56c1271446261fb576" Jun 08 19:52:17.483497 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:52:17.483412 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:52:18.208584 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:52:18.208545 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerStarted","Data":"438ddc3d805741fd317b86ae7eb2c7ed55229fd5b2a7c51b7bf6207f4e496992"} Jun 08 19:52:18.208984 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:52:18.208652 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:52:29.216114 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:52:29.216075 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:53:24.996944 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:24.996900 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59d7fcffb4-czdk8"] Jun 08 19:53:25.000390 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.000371 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.028454 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.028424 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59d7fcffb4-czdk8"] Jun 08 19:53:25.079557 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.079525 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bbfc222a-6770-49c8-a4c7-2f69907186e8-oidc-ca\") pod \"authorino-59d7fcffb4-czdk8\" (UID: \"bbfc222a-6770-49c8-a4c7-2f69907186e8\") " pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.079557 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.079559 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svvvp\" (UniqueName: \"kubernetes.io/projected/bbfc222a-6770-49c8-a4c7-2f69907186e8-kube-api-access-svvvp\") pod \"authorino-59d7fcffb4-czdk8\" (UID: \"bbfc222a-6770-49c8-a4c7-2f69907186e8\") " pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.079789 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.079646 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbfc222a-6770-49c8-a4c7-2f69907186e8-tls-cert\") pod \"authorino-59d7fcffb4-czdk8\" (UID: \"bbfc222a-6770-49c8-a4c7-2f69907186e8\") " pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.180310 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.180275 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbfc222a-6770-49c8-a4c7-2f69907186e8-tls-cert\") pod \"authorino-59d7fcffb4-czdk8\" (UID: \"bbfc222a-6770-49c8-a4c7-2f69907186e8\") " pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.180478 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.180335 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bbfc222a-6770-49c8-a4c7-2f69907186e8-oidc-ca\") pod \"authorino-59d7fcffb4-czdk8\" (UID: \"bbfc222a-6770-49c8-a4c7-2f69907186e8\") " pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.180478 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.180351 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvvp\" (UniqueName: \"kubernetes.io/projected/bbfc222a-6770-49c8-a4c7-2f69907186e8-kube-api-access-svvvp\") pod \"authorino-59d7fcffb4-czdk8\" (UID: \"bbfc222a-6770-49c8-a4c7-2f69907186e8\") " pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.181181 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.181152 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bbfc222a-6770-49c8-a4c7-2f69907186e8-oidc-ca\") pod \"authorino-59d7fcffb4-czdk8\" (UID: \"bbfc222a-6770-49c8-a4c7-2f69907186e8\") " pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.182842 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.182822 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbfc222a-6770-49c8-a4c7-2f69907186e8-tls-cert\") pod \"authorino-59d7fcffb4-czdk8\" (UID: \"bbfc222a-6770-49c8-a4c7-2f69907186e8\") " pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.196091 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.196069 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svvvp\" (UniqueName: \"kubernetes.io/projected/bbfc222a-6770-49c8-a4c7-2f69907186e8-kube-api-access-svvvp\") pod \"authorino-59d7fcffb4-czdk8\" (UID: \"bbfc222a-6770-49c8-a4c7-2f69907186e8\") " pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.309401 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.309362 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d7fcffb4-czdk8" Jun 08 19:53:25.527961 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.527930 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59d7fcffb4-czdk8"] Jun 08 19:53:25.528650 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:53:25.528622 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbfc222a_6770_49c8_a4c7_2f69907186e8.slice/crio-02c4fd76255d8b779bc440ace0d25cbc955ec877c9c018b1d32c63be5f57237c WatchSource:0}: Error finding container 02c4fd76255d8b779bc440ace0d25cbc955ec877c9c018b1d32c63be5f57237c: Status 404 returned error can't find the container with id 02c4fd76255d8b779bc440ace0d25cbc955ec877c9c018b1d32c63be5f57237c Jun 08 19:53:25.592413 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:25.592325 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59d7fcffb4-czdk8" event={"ID":"bbfc222a-6770-49c8-a4c7-2f69907186e8","Type":"ContainerStarted","Data":"02c4fd76255d8b779bc440ace0d25cbc955ec877c9c018b1d32c63be5f57237c"} Jun 08 19:53:26.600389 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:26.600351 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59d7fcffb4-czdk8" event={"ID":"bbfc222a-6770-49c8-a4c7-2f69907186e8","Type":"ContainerStarted","Data":"0629343c986ceef4edce2b40eef61658c942dddcce9dd40e84db6175d0ec2df6"} Jun 08 19:53:26.652500 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:26.652448 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59d7fcffb4-czdk8" podStartSLOduration=2.22225444 podStartE2EDuration="2.652431788s" totalImagesPullingTime="430.177348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:53:26.651789039 +0000 UTC m=+1614.632060052" watchObservedRunningTime="2026-06-08 19:53:26.652431788 +0000 UTC m=+1614.632702799" Jun 08 19:53:26.803859 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:26.803822 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768df5499c-hqhpq"] Jun 08 19:53:26.804093 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:26.804016 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-768df5499c-hqhpq" podUID="577dafe1-0260-4904-874c-f30e33d7c2b1" containerName="authorino" containerID="cri-o://2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8" gracePeriod=30 Jun 08 19:53:27.052158 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.052133 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:53:27.199132 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.199038 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/577dafe1-0260-4904-874c-f30e33d7c2b1-oidc-ca\") pod \"577dafe1-0260-4904-874c-f30e33d7c2b1\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " Jun 08 19:53:27.199132 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.199077 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bhfd\" (UniqueName: \"kubernetes.io/projected/577dafe1-0260-4904-874c-f30e33d7c2b1-kube-api-access-2bhfd\") pod \"577dafe1-0260-4904-874c-f30e33d7c2b1\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " Jun 08 19:53:27.199361 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.199141 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/577dafe1-0260-4904-874c-f30e33d7c2b1-tls-cert\") pod \"577dafe1-0260-4904-874c-f30e33d7c2b1\" (UID: \"577dafe1-0260-4904-874c-f30e33d7c2b1\") " Jun 08 19:53:27.201206 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.201166 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577dafe1-0260-4904-874c-f30e33d7c2b1-kube-api-access-2bhfd" (OuterVolumeSpecName: "kube-api-access-2bhfd") pod "577dafe1-0260-4904-874c-f30e33d7c2b1" (UID: "577dafe1-0260-4904-874c-f30e33d7c2b1"). InnerVolumeSpecName "kube-api-access-2bhfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:53:27.204208 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.204130 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/577dafe1-0260-4904-874c-f30e33d7c2b1-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "577dafe1-0260-4904-874c-f30e33d7c2b1" (UID: "577dafe1-0260-4904-874c-f30e33d7c2b1"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:53:27.209503 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.209473 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577dafe1-0260-4904-874c-f30e33d7c2b1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "577dafe1-0260-4904-874c-f30e33d7c2b1" (UID: "577dafe1-0260-4904-874c-f30e33d7c2b1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:53:27.300235 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.300201 2549 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/577dafe1-0260-4904-874c-f30e33d7c2b1-oidc-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:53:27.300235 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.300228 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bhfd\" (UniqueName: \"kubernetes.io/projected/577dafe1-0260-4904-874c-f30e33d7c2b1-kube-api-access-2bhfd\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:53:27.300235 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.300238 2549 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/577dafe1-0260-4904-874c-f30e33d7c2b1-tls-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 19:53:27.607367 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.607329 2549 generic.go:356] "Generic (PLEG): container finished" podID="577dafe1-0260-4904-874c-f30e33d7c2b1" containerID="2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8" exitCode=0 Jun 08 19:53:27.607821 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.607370 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768df5499c-hqhpq" Jun 08 19:53:27.607821 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.607407 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768df5499c-hqhpq" event={"ID":"577dafe1-0260-4904-874c-f30e33d7c2b1","Type":"ContainerDied","Data":"2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8"} Jun 08 19:53:27.607821 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.607442 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768df5499c-hqhpq" event={"ID":"577dafe1-0260-4904-874c-f30e33d7c2b1","Type":"ContainerDied","Data":"d6dc1cd22fc11d91848d00ae72ce93f206ff3bd2dfec5d67de3363c2227fa178"} Jun 08 19:53:27.607821 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.607459 2549 scope.go:117] "RemoveContainer" containerID="2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8" Jun 08 19:53:27.617439 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.617420 2549 scope.go:117] "RemoveContainer" containerID="2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8" Jun 08 19:53:27.617714 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:53:27.617699 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8\": container with ID starting with 2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8 not found: ID does not exist" containerID="2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8" Jun 08 19:53:27.617770 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.617721 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8"} err="failed to get container status \"2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8\": rpc error: code = NotFound desc = could not find container \"2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8\": container with ID starting with 2b855a44602170e90036ec788c678dfb43ab2133f1bf96be2900ac1a9ebcb1b8 not found: ID does not exist" Jun 08 19:53:27.708810 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.708768 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768df5499c-hqhpq"] Jun 08 19:53:27.714979 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:27.714948 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-768df5499c-hqhpq"] Jun 08 19:53:28.469716 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:28.469679 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="577dafe1-0260-4904-874c-f30e33d7c2b1" path="/var/lib/kubelet/pods/577dafe1-0260-4904-874c-f30e33d7c2b1/volumes" Jun 08 19:53:48.519017 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:48.518983 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:53:52.447768 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:52.447731 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:53:59.923331 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:53:59.923294 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:54:09.645474 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:09.645436 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:54:17.903964 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:17.903891 2549 generic.go:356] "Generic (PLEG): container finished" podID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" containerID="438ddc3d805741fd317b86ae7eb2c7ed55229fd5b2a7c51b7bf6207f4e496992" exitCode=1 Jun 08 19:54:17.904369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:17.903964 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerDied","Data":"438ddc3d805741fd317b86ae7eb2c7ed55229fd5b2a7c51b7bf6207f4e496992"} Jun 08 19:54:17.904369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:17.904031 2549 scope.go:117] "RemoveContainer" containerID="022caee4b37a528d6712375794ebe6ddbf3fa2c4cc622b56c1271446261fb576" Jun 08 19:54:17.904369 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:17.904335 2549 scope.go:117] "RemoveContainer" containerID="438ddc3d805741fd317b86ae7eb2c7ed55229fd5b2a7c51b7bf6207f4e496992" Jun 08 19:54:17.904606 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:54:17.904583 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:54:19.215274 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:19.215232 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:54:19.215690 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:19.215638 2549 scope.go:117] "RemoveContainer" containerID="438ddc3d805741fd317b86ae7eb2c7ed55229fd5b2a7c51b7bf6207f4e496992" Jun 08 19:54:19.215834 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:54:19.215814 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:54:19.403664 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:19.403626 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:54:29.417607 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:29.417563 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:54:31.463716 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:31.463682 2549 scope.go:117] "RemoveContainer" containerID="438ddc3d805741fd317b86ae7eb2c7ed55229fd5b2a7c51b7bf6207f4e496992" Jun 08 19:54:31.992175 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:31.992139 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerStarted","Data":"9b75cce86a212710cf25e90e02681c5e4af3c163a1d02647efb780869b9b5805"} Jun 08 19:54:31.992361 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:31.992348 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:54:39.000143 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:39.000101 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:54:43.000262 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:43.000192 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:54:48.787654 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:48.787610 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:54:58.635777 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.635738 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56b77869d6-2jmt4"] Jun 08 19:54:58.636286 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.636126 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577dafe1-0260-4904-874c-f30e33d7c2b1" containerName="authorino" Jun 08 19:54:58.636286 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.636139 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="577dafe1-0260-4904-874c-f30e33d7c2b1" containerName="authorino" Jun 08 19:54:58.636286 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.636216 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="577dafe1-0260-4904-874c-f30e33d7c2b1" containerName="authorino" Jun 08 19:54:58.639438 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.639420 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:54:58.643121 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.643096 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 19:54:58.643121 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.643114 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2w7qj\"" Jun 08 19:54:58.643322 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.643119 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 19:54:58.648830 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.648807 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a122046-bdad-41d8-a815-48fea0b02af2-webhook-cert\") pod \"maas-controller-56b77869d6-2jmt4\" (UID: \"9a122046-bdad-41d8-a815-48fea0b02af2\") " pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:54:58.648978 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.648845 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npksj\" (UniqueName: \"kubernetes.io/projected/9a122046-bdad-41d8-a815-48fea0b02af2-kube-api-access-npksj\") pod \"maas-controller-56b77869d6-2jmt4\" (UID: \"9a122046-bdad-41d8-a815-48fea0b02af2\") " pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:54:58.649431 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.649412 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56b77869d6-2jmt4"] Jun 08 19:54:58.750074 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.750039 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a122046-bdad-41d8-a815-48fea0b02af2-webhook-cert\") pod \"maas-controller-56b77869d6-2jmt4\" (UID: \"9a122046-bdad-41d8-a815-48fea0b02af2\") " pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:54:58.750074 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.750075 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npksj\" (UniqueName: \"kubernetes.io/projected/9a122046-bdad-41d8-a815-48fea0b02af2-kube-api-access-npksj\") pod \"maas-controller-56b77869d6-2jmt4\" (UID: \"9a122046-bdad-41d8-a815-48fea0b02af2\") " pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:54:58.752564 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.752542 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a122046-bdad-41d8-a815-48fea0b02af2-webhook-cert\") pod \"maas-controller-56b77869d6-2jmt4\" (UID: \"9a122046-bdad-41d8-a815-48fea0b02af2\") " pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:54:58.758727 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.758705 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npksj\" (UniqueName: \"kubernetes.io/projected/9a122046-bdad-41d8-a815-48fea0b02af2-kube-api-access-npksj\") pod \"maas-controller-56b77869d6-2jmt4\" (UID: \"9a122046-bdad-41d8-a815-48fea0b02af2\") " pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:54:58.950641 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:58.950545 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:54:59.090410 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:59.090380 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56b77869d6-2jmt4"] Jun 08 19:54:59.090778 ip-10-0-132-26 kubenswrapper[2549]: W0608 19:54:59.090747 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a122046_bdad_41d8_a815_48fea0b02af2.slice/crio-ec9d9cfa1292048bc780364ada3faf6d2958581fefb8bd941b7fa73eefb7a658 WatchSource:0}: Error finding container ec9d9cfa1292048bc780364ada3faf6d2958581fefb8bd941b7fa73eefb7a658: Status 404 returned error can't find the container with id ec9d9cfa1292048bc780364ada3faf6d2958581fefb8bd941b7fa73eefb7a658 Jun 08 19:54:59.092262 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:59.092239 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:54:59.164364 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:54:59.164326 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56b77869d6-2jmt4" event={"ID":"9a122046-bdad-41d8-a815-48fea0b02af2","Type":"ContainerStarted","Data":"ec9d9cfa1292048bc780364ada3faf6d2958581fefb8bd941b7fa73eefb7a658"} Jun 08 19:55:02.183897 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:55:02.183858 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56b77869d6-2jmt4" event={"ID":"9a122046-bdad-41d8-a815-48fea0b02af2","Type":"ContainerStarted","Data":"009f2b10b1020a8d33a1a05245d2e805f11a0a99503076e96a40556fd61bdc2a"} Jun 08 19:55:02.184412 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:55:02.183984 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:55:02.202510 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:55:02.202456 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56b77869d6-2jmt4" podStartSLOduration=2.129088982 podStartE2EDuration="4.202441049s" totalImagesPullingTime="2.073352067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:55:02.200751433 +0000 UTC m=+1710.181022443" watchObservedRunningTime="2026-06-08 19:55:02.202441049 +0000 UTC m=+1710.182712065" Jun 08 19:55:13.196490 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:55:13.196455 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56b77869d6-2jmt4" Jun 08 19:55:23.896451 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:55:23.896409 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:55:26.890421 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:55:26.890385 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:56:04.403766 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:04.403727 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:56:20.491670 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:20.491629 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:56:31.718062 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:31.718028 2549 generic.go:356] "Generic (PLEG): container finished" podID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" containerID="9b75cce86a212710cf25e90e02681c5e4af3c163a1d02647efb780869b9b5805" exitCode=1 Jun 08 19:56:31.718530 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:31.718079 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerDied","Data":"9b75cce86a212710cf25e90e02681c5e4af3c163a1d02647efb780869b9b5805"} Jun 08 19:56:31.718530 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:31.718129 2549 scope.go:117] "RemoveContainer" containerID="438ddc3d805741fd317b86ae7eb2c7ed55229fd5b2a7c51b7bf6207f4e496992" Jun 08 19:56:31.718530 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:31.718505 2549 scope.go:117] "RemoveContainer" containerID="9b75cce86a212710cf25e90e02681c5e4af3c163a1d02647efb780869b9b5805" Jun 08 19:56:31.718789 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:56:31.718768 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:56:32.565757 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:32.565728 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:56:32.569509 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:32.569483 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 19:56:32.572277 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:32.572256 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:56:32.575825 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:32.575806 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 19:56:32.999541 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:32.999434 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:56:32.999958 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:32.999813 2549 scope.go:117] "RemoveContainer" containerID="9b75cce86a212710cf25e90e02681c5e4af3c163a1d02647efb780869b9b5805" Jun 08 19:56:33.000070 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:56:33.000049 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:56:33.558900 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:33.558863 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:56:33.734207 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:33.734177 2549 scope.go:117] "RemoveContainer" containerID="9b75cce86a212710cf25e90e02681c5e4af3c163a1d02647efb780869b9b5805" Jun 08 19:56:33.734441 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:56:33.734419 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:56:47.464193 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:47.464165 2549 scope.go:117] "RemoveContainer" containerID="9b75cce86a212710cf25e90e02681c5e4af3c163a1d02647efb780869b9b5805" Jun 08 19:56:47.464670 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:56:47.464392 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:56:58.798136 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:58.798100 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:56:59.464094 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:59.464059 2549 scope.go:117] "RemoveContainer" containerID="9b75cce86a212710cf25e90e02681c5e4af3c163a1d02647efb780869b9b5805" Jun 08 19:56:59.886194 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:59.886159 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerStarted","Data":"d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748"} Jun 08 19:56:59.886588 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:56:59.886371 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:57:10.893709 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:57:10.893671 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:57:16.198009 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:57:16.197972 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:57:30.587741 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:57:30.587697 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:57:45.826897 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:57:45.826855 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:57:48.487796 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:57:48.487754 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:58:26.905778 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:58:26.905731 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:58:29.786977 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:58:29.786937 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:58:52.193290 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:58:52.193245 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:59:00.586410 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:00.586367 2549 generic.go:356] "Generic (PLEG): container finished" podID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" containerID="d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748" exitCode=1 Jun 08 19:59:00.586855 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:00.586437 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerDied","Data":"d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748"} Jun 08 19:59:00.586855 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:00.586506 2549 scope.go:117] "RemoveContainer" containerID="9b75cce86a212710cf25e90e02681c5e4af3c163a1d02647efb780869b9b5805" Jun 08 19:59:00.586992 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:00.586860 2549 scope.go:117] "RemoveContainer" containerID="d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748" Jun 08 19:59:00.587175 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:59:00.587150 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:59:00.892733 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:00.892644 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:59:00.986264 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:00.986225 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:59:01.593852 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:01.593823 2549 scope.go:117] "RemoveContainer" containerID="d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748" Jun 08 19:59:01.594244 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:59:01.594055 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:59:13.558482 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:13.558444 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 19:59:13.558869 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:13.558805 2549 scope.go:117] "RemoveContainer" containerID="d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748" Jun 08 19:59:13.559062 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:59:13.559040 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:59:17.200245 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:17.200205 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:59:26.111578 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:26.111537 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:59:27.464483 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:27.464451 2549 scope.go:117] "RemoveContainer" containerID="d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748" Jun 08 19:59:27.464876 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:59:27.464696 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:59:34.095134 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:34.095100 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 19:59:38.464651 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:38.464613 2549 scope.go:117] "RemoveContainer" containerID="d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748" Jun 08 19:59:38.465076 ip-10-0-132-26 kubenswrapper[2549]: E0608 19:59:38.464810 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 19:59:53.463640 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:53.463608 2549 scope.go:117] "RemoveContainer" containerID="d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748" Jun 08 19:59:53.902206 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:53.902167 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerStarted","Data":"50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2"} Jun 08 19:59:53.902410 ip-10-0-132-26 kubenswrapper[2549]: I0608 19:59:53.902378 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 20:00:00.168978 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.168938 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29682480-k8wvc"] Jun 08 20:00:00.171624 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.171605 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" Jun 08 20:00:00.175270 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.175242 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-dsr8m\"" Jun 08 20:00:00.181649 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.181619 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29682480-k8wvc"] Jun 08 20:00:00.234612 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.234573 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmtn7\" (UniqueName: \"kubernetes.io/projected/6306e87f-cb18-4255-b3be-49671141a01e-kube-api-access-fmtn7\") pod \"maas-api-key-cleanup-29682480-k8wvc\" (UID: \"6306e87f-cb18-4255-b3be-49671141a01e\") " pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" Jun 08 20:00:00.335341 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.335300 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmtn7\" (UniqueName: \"kubernetes.io/projected/6306e87f-cb18-4255-b3be-49671141a01e-kube-api-access-fmtn7\") pod \"maas-api-key-cleanup-29682480-k8wvc\" (UID: \"6306e87f-cb18-4255-b3be-49671141a01e\") " pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" Jun 08 20:00:00.349334 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.349292 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmtn7\" (UniqueName: \"kubernetes.io/projected/6306e87f-cb18-4255-b3be-49671141a01e-kube-api-access-fmtn7\") pod \"maas-api-key-cleanup-29682480-k8wvc\" (UID: \"6306e87f-cb18-4255-b3be-49671141a01e\") " pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" Jun 08 20:00:00.483797 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.483710 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" Jun 08 20:00:00.627299 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.627264 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29682480-k8wvc"] Jun 08 20:00:00.628229 ip-10-0-132-26 kubenswrapper[2549]: W0608 20:00:00.628201 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6306e87f_cb18_4255_b3be_49671141a01e.slice/crio-f4b9a6c0233e453d0535d7cb2faaa746ef37b3ceed3d457482952619133fb7f0 WatchSource:0}: Error finding container f4b9a6c0233e453d0535d7cb2faaa746ef37b3ceed3d457482952619133fb7f0: Status 404 returned error can't find the container with id f4b9a6c0233e453d0535d7cb2faaa746ef37b3ceed3d457482952619133fb7f0 Jun 08 20:00:00.630389 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.630369 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 20:00:00.944282 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:00.944239 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" event={"ID":"6306e87f-cb18-4255-b3be-49671141a01e","Type":"ContainerStarted","Data":"f4b9a6c0233e453d0535d7cb2faaa746ef37b3ceed3d457482952619133fb7f0"} Jun 08 20:00:04.909957 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:04.909924 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 20:00:07.089194 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:07.089156 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:00:15.804688 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:15.803951 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:00:17.044549 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:17.044511 2549 generic.go:356] "Generic (PLEG): container finished" podID="6306e87f-cb18-4255-b3be-49671141a01e" containerID="b5219b4ec9eea85a6baaa1e645f69f4e3d7b0a89795ac086d2713e17c2d6224f" exitCode=0 Jun 08 20:00:17.044944 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:17.044600 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" event={"ID":"6306e87f-cb18-4255-b3be-49671141a01e","Type":"ContainerDied","Data":"b5219b4ec9eea85a6baaa1e645f69f4e3d7b0a89795ac086d2713e17c2d6224f"} Jun 08 20:00:18.188016 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:18.187980 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" Jun 08 20:00:18.301573 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:18.301478 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmtn7\" (UniqueName: \"kubernetes.io/projected/6306e87f-cb18-4255-b3be-49671141a01e-kube-api-access-fmtn7\") pod \"6306e87f-cb18-4255-b3be-49671141a01e\" (UID: \"6306e87f-cb18-4255-b3be-49671141a01e\") " Jun 08 20:00:18.303779 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:18.303736 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6306e87f-cb18-4255-b3be-49671141a01e-kube-api-access-fmtn7" (OuterVolumeSpecName: "kube-api-access-fmtn7") pod "6306e87f-cb18-4255-b3be-49671141a01e" (UID: "6306e87f-cb18-4255-b3be-49671141a01e"). InnerVolumeSpecName "kube-api-access-fmtn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 20:00:18.402184 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:18.402151 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmtn7\" (UniqueName: \"kubernetes.io/projected/6306e87f-cb18-4255-b3be-49671141a01e-kube-api-access-fmtn7\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jun 08 20:00:19.057859 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:19.057833 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" Jun 08 20:00:19.058060 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:19.057830 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682480-k8wvc" event={"ID":"6306e87f-cb18-4255-b3be-49671141a01e","Type":"ContainerDied","Data":"f4b9a6c0233e453d0535d7cb2faaa746ef37b3ceed3d457482952619133fb7f0"} Jun 08 20:00:19.058060 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:19.057975 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4b9a6c0233e453d0535d7cb2faaa746ef37b3ceed3d457482952619133fb7f0" Jun 08 20:00:24.399773 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:24.399731 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:00:56.889598 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:00:56.889509 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:01:05.488549 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:05.488500 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:01:14.396398 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:14.396359 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:01:21.988902 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:21.988855 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:01:30.398452 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:30.398412 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:01:32.604848 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:32.604816 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 20:01:32.610462 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:32.610440 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 20:01:32.610616 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:32.610598 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 20:01:32.616517 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:32.616497 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69rrr_77cb9a8d-ed29-4cda-a410-90e077ebf77b/ovn-acl-logging/0.log" Jun 08 20:01:38.797001 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:38.796965 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:01:41.403777 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:41.403742 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:01:47.588981 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:47.588941 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:01:53.558891 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:53.558848 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.55:9004: connect: connection refused" Jun 08 20:01:53.616081 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:53.616048 2549 generic.go:356] "Generic (PLEG): container finished" podID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" exitCode=1 Jun 08 20:01:53.616226 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:53.616095 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerDied","Data":"50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2"} Jun 08 20:01:53.616226 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:53.616144 2549 scope.go:117] "RemoveContainer" containerID="d8edafda784c1eee53d2c6d696eeaccde93d6bc2226a09000173abf678e22748" Jun 08 20:01:53.616451 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:53.616428 2549 scope.go:117] "RemoveContainer" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" Jun 08 20:01:53.616676 ip-10-0-132-26 kubenswrapper[2549]: E0608 20:01:53.616654 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 20:01:54.908542 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:54.908488 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 20:01:54.909022 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:54.908816 2549 scope.go:117] "RemoveContainer" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" Jun 08 20:01:54.909071 ip-10-0-132-26 kubenswrapper[2549]: E0608 20:01:54.909050 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 20:01:56.004161 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:01:56.004116 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:02:08.464279 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:08.464248 2549 scope.go:117] "RemoveContainer" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" Jun 08 20:02:08.464771 ip-10-0-132-26 kubenswrapper[2549]: E0608 20:02:08.464467 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 20:02:13.558816 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:13.558774 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 20:02:13.559225 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:13.559200 2549 scope.go:117] "RemoveContainer" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" Jun 08 20:02:13.559398 ip-10-0-132-26 kubenswrapper[2549]: E0608 20:02:13.559378 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 20:02:27.464159 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:27.464122 2549 scope.go:117] "RemoveContainer" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" Jun 08 20:02:27.464619 ip-10-0-132-26 kubenswrapper[2549]: E0608 20:02:27.464289 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 20:02:35.022501 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:35.022460 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:02:37.032716 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:37.032681 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dvhk9"] Jun 08 20:02:40.464934 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:40.464879 2549 scope.go:117] "RemoveContainer" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" Jun 08 20:02:40.465361 ip-10-0-132-26 kubenswrapper[2549]: E0608 20:02:40.465056 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 20:02:52.468899 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:52.468868 2549 scope.go:117] "RemoveContainer" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" Jun 08 20:02:52.469302 ip-10-0-132-26 kubenswrapper[2549]: E0608 20:02:52.469091 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 20:02:53.142794 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:53.142753 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59d7fcffb4-czdk8_bbfc222a-6770-49c8-a4c7-2f69907186e8/authorino/0.log" Jun 08 20:02:57.976061 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:57.976031 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7759946b58-g5dts_a2fe1867-79ad-40be-a3d5-e160b2558f2f/nginx/0.log" Jun 08 20:02:58.714087 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:58.714059 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29682480-k8wvc_6306e87f-cb18-4255-b3be-49671141a01e/cleanup/0.log" Jun 08 20:02:58.856014 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:58.855979 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56b77869d6-2jmt4_9a122046-bdad-41d8-a815-48fea0b02af2/manager/0.log" Jun 08 20:02:59.229151 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:59.229120 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b795f8b7b-c6f5v_9abf0212-2cde-4e6b-a50e-efeda3146aa3/copy-manifests/0.log" Jun 08 20:02:59.242119 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:02:59.242057 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b795f8b7b-c6f5v_9abf0212-2cde-4e6b-a50e-efeda3146aa3/manager/0.log" Jun 08 20:03:00.549047 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.549014 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx_5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54/pull/0.log" Jun 08 20:03:00.558008 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.557978 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx_5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54/extract/0.log" Jun 08 20:03:00.565154 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.565133 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx_5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54/util/0.log" Jun 08 20:03:00.678612 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.678583 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c_f1dadce4-56db-4bf6-906d-193fc26fe87e/util/0.log" Jun 08 20:03:00.685623 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.685598 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c_f1dadce4-56db-4bf6-906d-193fc26fe87e/pull/0.log" Jun 08 20:03:00.692570 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.692549 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c_f1dadce4-56db-4bf6-906d-193fc26fe87e/extract/0.log" Jun 08 20:03:00.813400 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.813323 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw_93faa170-0c75-49ca-9616-bf03777fdfb4/util/0.log" Jun 08 20:03:00.820510 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.820488 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw_93faa170-0c75-49ca-9616-bf03777fdfb4/pull/0.log" Jun 08 20:03:00.828322 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.828292 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw_93faa170-0c75-49ca-9616-bf03777fdfb4/extract/0.log" Jun 08 20:03:00.988942 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.988899 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv_be55ddab-934f-4cb0-b205-2a53aca6d10e/util/0.log" Jun 08 20:03:00.996060 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:00.996029 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv_be55ddab-934f-4cb0-b205-2a53aca6d10e/pull/0.log" Jun 08 20:03:01.002954 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:01.002901 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv_be55ddab-934f-4cb0-b205-2a53aca6d10e/extract/0.log" Jun 08 20:03:01.169687 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:01.169592 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59d7fcffb4-czdk8_bbfc222a-6770-49c8-a4c7-2f69907186e8/authorino/0.log" Jun 08 20:03:01.419138 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:01.419107 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-sgxdt_7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f/manager/0.log" Jun 08 20:03:01.540262 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:01.540238 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5xl5d_d514ad52-89af-431d-9078-06ce5747f0b0/kuadrant-console-plugin/0.log" Jun 08 20:03:01.663248 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:01.663218 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xvbv6_0f93e47b-218a-45e3-9805-09c6a6a6edea/registry-server/0.log" Jun 08 20:03:01.908604 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:01.908521 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dvhk9_84b9b341-b9a0-446d-b29f-496b38c78119/limitador/0.log" Jun 08 20:03:02.025992 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:02.025952 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9zj58_0b1c348c-4174-4deb-b76d-5630b0a0e51d/manager/0.log" Jun 08 20:03:02.480118 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:02.480086 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gdldz_eb78299c-868f-4fa9-a48f-b778202b6134/istio-proxy/0.log" Jun 08 20:03:02.974787 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:02.974755 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-vbbtm_4da0a977-b2ab-4c03-87f8-db53b0bb1e22/istio-proxy/1.log" Jun 08 20:03:03.220600 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:03.220567 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ccntv_6d3f521e-187a-45cc-bf2c-b3b7858cfb1b/payload-processing/4.log" Jun 08 20:03:04.225423 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:04.225347 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r_2ade297e-a0d6-45b4-b603-7ce16c5830ef/storage-initializer/0.log" Jun 08 20:03:04.241096 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:04.241045 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cz8k8r_2ade297e-a0d6-45b4-b603-7ce16c5830ef/main/0.log" Jun 08 20:03:05.463837 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:05.463805 2549 scope.go:117] "RemoveContainer" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" Jun 08 20:03:05.464290 ip-10-0-132-26 kubenswrapper[2549]: E0608 20:03:05.464025 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-ccntv_openshift-ingress(6d3f521e-187a-45cc-bf2c-b3b7858cfb1b)\"" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" podUID="6d3f521e-187a-45cc-bf2c-b3b7858cfb1b" Jun 08 20:03:08.897547 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.897499 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t9btz/must-gather-gkcnk"] Jun 08 20:03:08.899119 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.899084 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6306e87f-cb18-4255-b3be-49671141a01e" containerName="cleanup" Jun 08 20:03:08.899119 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.899114 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="6306e87f-cb18-4255-b3be-49671141a01e" containerName="cleanup" Jun 08 20:03:08.899331 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.899201 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="6306e87f-cb18-4255-b3be-49671141a01e" containerName="cleanup" Jun 08 20:03:08.902540 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.902519 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t9btz/must-gather-gkcnk" Jun 08 20:03:08.906890 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.906865 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t9btz\"/\"default-dockercfg-vbxdv\"" Jun 08 20:03:08.907519 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.907502 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t9btz\"/\"openshift-service-ca.crt\"" Jun 08 20:03:08.909095 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.909075 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t9btz\"/\"kube-root-ca.crt\"" Jun 08 20:03:08.924726 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.924695 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t9btz/must-gather-gkcnk"] Jun 08 20:03:08.938946 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.938898 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eb6c141c-327e-4d3e-88ce-ac4274b3a9d5-must-gather-output\") pod \"must-gather-gkcnk\" (UID: \"eb6c141c-327e-4d3e-88ce-ac4274b3a9d5\") " pod="openshift-must-gather-t9btz/must-gather-gkcnk" Jun 08 20:03:08.939127 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:08.938979 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcnjk\" (UniqueName: \"kubernetes.io/projected/eb6c141c-327e-4d3e-88ce-ac4274b3a9d5-kube-api-access-tcnjk\") pod \"must-gather-gkcnk\" (UID: \"eb6c141c-327e-4d3e-88ce-ac4274b3a9d5\") " pod="openshift-must-gather-t9btz/must-gather-gkcnk" Jun 08 20:03:09.040041 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:09.039985 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eb6c141c-327e-4d3e-88ce-ac4274b3a9d5-must-gather-output\") pod \"must-gather-gkcnk\" (UID: \"eb6c141c-327e-4d3e-88ce-ac4274b3a9d5\") " pod="openshift-must-gather-t9btz/must-gather-gkcnk" Jun 08 20:03:09.040253 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:09.040088 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcnjk\" (UniqueName: \"kubernetes.io/projected/eb6c141c-327e-4d3e-88ce-ac4274b3a9d5-kube-api-access-tcnjk\") pod \"must-gather-gkcnk\" (UID: \"eb6c141c-327e-4d3e-88ce-ac4274b3a9d5\") " pod="openshift-must-gather-t9btz/must-gather-gkcnk" Jun 08 20:03:09.040439 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:09.040412 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eb6c141c-327e-4d3e-88ce-ac4274b3a9d5-must-gather-output\") pod \"must-gather-gkcnk\" (UID: \"eb6c141c-327e-4d3e-88ce-ac4274b3a9d5\") " pod="openshift-must-gather-t9btz/must-gather-gkcnk" Jun 08 20:03:09.083521 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:09.083484 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcnjk\" (UniqueName: \"kubernetes.io/projected/eb6c141c-327e-4d3e-88ce-ac4274b3a9d5-kube-api-access-tcnjk\") pod \"must-gather-gkcnk\" (UID: \"eb6c141c-327e-4d3e-88ce-ac4274b3a9d5\") " pod="openshift-must-gather-t9btz/must-gather-gkcnk" Jun 08 20:03:09.211986 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:09.211878 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t9btz/must-gather-gkcnk" Jun 08 20:03:09.375021 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:09.374983 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t9btz/must-gather-gkcnk"] Jun 08 20:03:09.375583 ip-10-0-132-26 kubenswrapper[2549]: W0608 20:03:09.375560 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb6c141c_327e_4d3e_88ce_ac4274b3a9d5.slice/crio-ab0549bf6c554a95bbefe4d62ff061a430201486e682b9cf581764bcee6e8c03 WatchSource:0}: Error finding container ab0549bf6c554a95bbefe4d62ff061a430201486e682b9cf581764bcee6e8c03: Status 404 returned error can't find the container with id ab0549bf6c554a95bbefe4d62ff061a430201486e682b9cf581764bcee6e8c03 Jun 08 20:03:10.073371 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:10.073327 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t9btz/must-gather-gkcnk" event={"ID":"eb6c141c-327e-4d3e-88ce-ac4274b3a9d5","Type":"ContainerStarted","Data":"ab0549bf6c554a95bbefe4d62ff061a430201486e682b9cf581764bcee6e8c03"} Jun 08 20:03:11.082979 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:11.082942 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t9btz/must-gather-gkcnk" event={"ID":"eb6c141c-327e-4d3e-88ce-ac4274b3a9d5","Type":"ContainerStarted","Data":"12c09943e4e21dcc12c22e10300e577363083c787c52149e99204641213b7361"} Jun 08 20:03:11.083475 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:11.082989 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t9btz/must-gather-gkcnk" event={"ID":"eb6c141c-327e-4d3e-88ce-ac4274b3a9d5","Type":"ContainerStarted","Data":"86b950c0806685acceaeec0ff4f32f0ef70be1ae7a78de2e1eb494fa77b56689"} Jun 08 20:03:11.153929 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:11.153852 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t9btz/must-gather-gkcnk" podStartSLOduration=2.338132594 podStartE2EDuration="3.153814766s" totalImagesPullingTime="815.682172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:03:11.148984842 +0000 UTC m=+2199.129255855" watchObservedRunningTime="2026-06-08 20:03:11.153814766 +0000 UTC m=+2199.134085778" Jun 08 20:03:12.767506 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:12.767469 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ctdmm_747ed8f3-e7b3-49a0-9fe6-968e42212258/global-pull-secret-syncer/0.log" Jun 08 20:03:13.131160 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:13.131125 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tr58h_3d8ad786-aa67-4968-8ce2-d1273c7abc86/konnectivity-agent/0.log" Jun 08 20:03:13.183587 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:13.183537 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-26.ec2.internal_18e86d904aaa5a0b5b95eb0f9feb0537/haproxy/0.log" Jun 08 20:03:17.882803 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:17.882769 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx_5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54/extract/0.log" Jun 08 20:03:17.969737 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:17.969710 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx_5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54/util/0.log" Jun 08 20:03:18.074456 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.074416 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t9nqx_5bfee0a4-bd56-4fd5-9ac5-8c88b780ab54/pull/0.log" Jun 08 20:03:18.182002 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.181835 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c_f1dadce4-56db-4bf6-906d-193fc26fe87e/extract/0.log" Jun 08 20:03:18.278084 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.278052 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c_f1dadce4-56db-4bf6-906d-193fc26fe87e/util/0.log" Jun 08 20:03:18.376428 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.376349 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jmt5c_f1dadce4-56db-4bf6-906d-193fc26fe87e/pull/0.log" Jun 08 20:03:18.442032 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.441880 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw_93faa170-0c75-49ca-9616-bf03777fdfb4/extract/0.log" Jun 08 20:03:18.498517 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.498484 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw_93faa170-0c75-49ca-9616-bf03777fdfb4/util/0.log" Jun 08 20:03:18.559303 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.559261 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d86hw_93faa170-0c75-49ca-9616-bf03777fdfb4/pull/0.log" Jun 08 20:03:18.669075 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.669040 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv_be55ddab-934f-4cb0-b205-2a53aca6d10e/extract/0.log" Jun 08 20:03:18.732246 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.732114 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv_be55ddab-934f-4cb0-b205-2a53aca6d10e/util/0.log" Jun 08 20:03:18.798161 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.798107 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z6cfv_be55ddab-934f-4cb0-b205-2a53aca6d10e/pull/0.log" Jun 08 20:03:18.932236 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:18.932202 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59d7fcffb4-czdk8_bbfc222a-6770-49c8-a4c7-2f69907186e8/authorino/0.log" Jun 08 20:03:19.063216 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:19.063169 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-sgxdt_7d8b3be4-f746-4dc8-bb9f-89a22e0bc37f/manager/0.log" Jun 08 20:03:19.106782 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:19.106753 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5xl5d_d514ad52-89af-431d-9078-06ce5747f0b0/kuadrant-console-plugin/0.log" Jun 08 20:03:19.170866 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:19.170741 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xvbv6_0f93e47b-218a-45e3-9805-09c6a6a6edea/registry-server/0.log" Jun 08 20:03:19.333650 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:19.333566 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dvhk9_84b9b341-b9a0-446d-b29f-496b38c78119/limitador/0.log" Jun 08 20:03:19.414866 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:19.414829 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9zj58_0b1c348c-4174-4deb-b76d-5630b0a0e51d/manager/0.log" Jun 08 20:03:19.464256 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:19.464218 2549 scope.go:117] "RemoveContainer" containerID="50f9428d00183888f279c76ff5050708f64bb87815308b582e6b99c927fa35d2" Jun 08 20:03:20.168143 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:20.168105 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" event={"ID":"6d3f521e-187a-45cc-bf2c-b3b7858cfb1b","Type":"ContainerStarted","Data":"442b8805893bf78dfe09f4b112835f895988b7c16d7f9a32cf07ba0acf01d6de"} Jun 08 20:03:20.168647 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:20.168507 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 20:03:22.043186 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:22.043153 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-fblgq_ff33bd99-9a6e-4bae-9b0c-19765607fba0/monitoring-plugin/0.log" Jun 08 20:03:22.500842 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:22.500754 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zgwx5_d64773dd-e96d-4806-af92-eb212b62c4cf/node-exporter/0.log" Jun 08 20:03:22.545344 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:22.545297 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zgwx5_d64773dd-e96d-4806-af92-eb212b62c4cf/kube-rbac-proxy/0.log" Jun 08 20:03:22.624182 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:22.624151 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zgwx5_d64773dd-e96d-4806-af92-eb212b62c4cf/init-textfile/0.log" Jun 08 20:03:23.422434 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.422392 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-q87dk_fa87c32d-19b9-481a-be08-9f6b8c83c427/prometheus-operator/0.log" Jun 08 20:03:23.463197 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.463155 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-q87dk_fa87c32d-19b9-481a-be08-9f6b8c83c427/kube-rbac-proxy/0.log" Jun 08 20:03:23.747004 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.746875 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs"] Jun 08 20:03:23.752510 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.752483 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.783560 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.783527 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs"] Jun 08 20:03:23.803123 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.803072 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-podres\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.803320 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.803147 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-proc\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.803320 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.803193 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbngh\" (UniqueName: \"kubernetes.io/projected/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-kube-api-access-qbngh\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.803320 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.803256 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-lib-modules\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.803320 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.803291 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-sys\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.904599 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.904561 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-proc\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.904796 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.904629 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbngh\" (UniqueName: \"kubernetes.io/projected/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-kube-api-access-qbngh\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.904796 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.904675 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-proc\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.904796 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.904691 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-lib-modules\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.904796 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.904746 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-sys\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.905038 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.904801 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-podres\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.905038 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.904899 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-sys\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.905038 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.904947 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-lib-modules\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.905038 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.904950 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-podres\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:23.933269 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:23.933236 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbngh\" (UniqueName: \"kubernetes.io/projected/cd628c48-48bb-4701-b2bf-4ee2efb4d1a8-kube-api-access-qbngh\") pod \"perf-node-gather-daemonset-t2xrs\" (UID: \"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:24.063538 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:24.063483 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:24.261729 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:24.261686 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs"] Jun 08 20:03:24.262120 ip-10-0-132-26 kubenswrapper[2549]: W0608 20:03:24.262093 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcd628c48_48bb_4701_b2bf_4ee2efb4d1a8.slice/crio-98667dc9614c6a656809f1ead4323196942c650688128a8dede0ac00db19f880 WatchSource:0}: Error finding container 98667dc9614c6a656809f1ead4323196942c650688128a8dede0ac00db19f880: Status 404 returned error can't find the container with id 98667dc9614c6a656809f1ead4323196942c650688128a8dede0ac00db19f880 Jun 08 20:03:25.213274 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:25.213227 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" event={"ID":"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8","Type":"ContainerStarted","Data":"4c4a7f1b7149a2e311c19c60e44a2c3b072cbedf641759a4524a8f0accb4637a"} Jun 08 20:03:25.213676 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:25.213292 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" event={"ID":"cd628c48-48bb-4701-b2bf-4ee2efb4d1a8","Type":"ContainerStarted","Data":"98667dc9614c6a656809f1ead4323196942c650688128a8dede0ac00db19f880"} Jun 08 20:03:25.213676 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:25.213419 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:25.251557 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:25.251500 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" podStartSLOduration=2.251483022 podStartE2EDuration="2.251483022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:03:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:03:25.248566261 +0000 UTC m=+2213.228837273" watchObservedRunningTime="2026-06-08 20:03:25.251483022 +0000 UTC m=+2213.231754033" Jun 08 20:03:25.564689 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:25.564657 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-svswr_953173bb-813a-4daa-a199-d1ec635252bd/networking-console-plugin/0.log" Jun 08 20:03:26.354787 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:26.354748 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/1.log" Jun 08 20:03:26.358723 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:26.358697 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-md6b7_9c1db2c1-91c2-40d0-bd43-039c9ce03232/console-operator/2.log" Jun 08 20:03:26.985330 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:26.985293 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-94bb447bc-zbh7d_af1a7891-be37-4ac6-ab74-8814cf8df5c2/console/0.log" Jun 08 20:03:27.036246 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:27.036205 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-ss4g2_c940890e-f3e7-4eb2-99ed-851020c74780/download-server/0.log" Jun 08 20:03:29.424398 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:29.424365 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8lzsn_1a9c2142-6d73-414a-bdf6-9b4662669244/dns/0.log" Jun 08 20:03:29.466572 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:29.466540 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8lzsn_1a9c2142-6d73-414a-bdf6-9b4662669244/kube-rbac-proxy/0.log" Jun 08 20:03:29.794891 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:29.794860 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cktnw_4df82b22-3f2a-462b-aa9a-2ec20a55f82a/dns-node-resolver/0.log" Jun 08 20:03:30.699722 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:30.699687 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68cd8c5474-fk74v_ced11cd7-0788-45f2-89a3-baba9f5e4110/registry/0.log" Jun 08 20:03:30.707793 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:30.707761 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68cd8c5474-fk74v_ced11cd7-0788-45f2-89a3-baba9f5e4110/registry/1.log" Jun 08 20:03:30.814973 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:30.814940 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kzvj8_87128f8d-6e20-4850-80f5-cbdec1a08016/node-ca/0.log" Jun 08 20:03:31.180022 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:31.179988 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-ccntv" Jun 08 20:03:31.239301 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:31.239274 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-t2xrs" Jun 08 20:03:32.301578 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:32.301529 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gdldz_eb78299c-868f-4fa9-a48f-b778202b6134/istio-proxy/0.log" Jun 08 20:03:32.620805 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:32.620692 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-vbbtm_4da0a977-b2ab-4c03-87f8-db53b0bb1e22/istio-proxy/0.log" Jun 08 20:03:32.640830 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:32.640800 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-vbbtm_4da0a977-b2ab-4c03-87f8-db53b0bb1e22/istio-proxy/1.log" Jun 08 20:03:32.762113 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:32.762076 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ccntv_6d3f521e-187a-45cc-bf2c-b3b7858cfb1b/payload-processing/5.log" Jun 08 20:03:32.765016 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:32.764992 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ccntv_6d3f521e-187a-45cc-bf2c-b3b7858cfb1b/payload-processing/4.log" Jun 08 20:03:33.938585 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:33.938509 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4vt28_a36c67fc-408f-4321-8607-988163a9b912/serve-healthcheck-canary/0.log" Jun 08 20:03:34.998021 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:34.997929 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-r5pp5_24bfa9f9-cb85-40db-add0-37736c0a3d40/insights-operator/0.log" Jun 08 20:03:34.998748 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:34.998727 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-r5pp5_24bfa9f9-cb85-40db-add0-37736c0a3d40/insights-operator/1.log" Jun 08 20:03:35.040197 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:35.040169 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9js4_12e78c9f-57c4-4c5e-9724-ee13613f6851/kube-rbac-proxy/0.log" Jun 08 20:03:35.091819 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:35.091792 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9js4_12e78c9f-57c4-4c5e-9724-ee13613f6851/exporter/0.log" Jun 08 20:03:35.138704 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:35.138664 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9js4_12e78c9f-57c4-4c5e-9724-ee13613f6851/extractor/0.log" Jun 08 20:03:38.473373 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:38.473345 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gdldz_eb78299c-868f-4fa9-a48f-b778202b6134/istio-proxy/0.log" Jun 08 20:03:38.558937 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:38.558877 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7759946b58-g5dts_a2fe1867-79ad-40be-a3d5-e160b2558f2f/nginx/0.log" Jun 08 20:03:38.781742 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:38.781717 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-vbbtm_4da0a977-b2ab-4c03-87f8-db53b0bb1e22/istio-proxy/0.log" Jun 08 20:03:38.797226 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:38.797195 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-vbbtm_4da0a977-b2ab-4c03-87f8-db53b0bb1e22/istio-proxy/1.log" Jun 08 20:03:38.875319 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:38.875288 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ccntv_6d3f521e-187a-45cc-bf2c-b3b7858cfb1b/payload-processing/5.log" Jun 08 20:03:38.876234 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:38.876214 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ccntv_6d3f521e-187a-45cc-bf2c-b3b7858cfb1b/payload-processing/4.log" Jun 08 20:03:39.208711 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:39.208631 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29682480-k8wvc_6306e87f-cb18-4255-b3be-49671141a01e/cleanup/0.log" Jun 08 20:03:39.301296 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:39.301224 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56b77869d6-2jmt4_9a122046-bdad-41d8-a815-48fea0b02af2/manager/0.log" Jun 08 20:03:39.709229 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:39.709193 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b795f8b7b-c6f5v_9abf0212-2cde-4e6b-a50e-efeda3146aa3/manager/0.log" Jun 08 20:03:39.758804 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:39.758770 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b795f8b7b-c6f5v_9abf0212-2cde-4e6b-a50e-efeda3146aa3/copy-manifests/0.log" Jun 08 20:03:40.310379 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:40.310343 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gdldz_eb78299c-868f-4fa9-a48f-b778202b6134/istio-proxy/0.log" Jun 08 20:03:40.637142 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:40.637056 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-vbbtm_4da0a977-b2ab-4c03-87f8-db53b0bb1e22/istio-proxy/0.log" Jun 08 20:03:40.654717 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:40.654684 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-vbbtm_4da0a977-b2ab-4c03-87f8-db53b0bb1e22/istio-proxy/1.log" Jun 08 20:03:40.750005 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:40.749968 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ccntv_6d3f521e-187a-45cc-bf2c-b3b7858cfb1b/payload-processing/5.log" Jun 08 20:03:40.752214 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:40.752193 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ccntv_6d3f521e-187a-45cc-bf2c-b3b7858cfb1b/payload-processing/4.log" Jun 08 20:03:42.029475 ip-10-0-132-26 kubenswrapper[2549]: I0608 20:03:42.029443 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c5d7bcdc4-hwlw9_45890e7e-979a-45a9-a217-b8fcd8ae3b6a/manager/0.log"