Jun 02 21:39:53.441724 ip-10-0-135-204 systemd[1]: Starting Kubernetes Kubelet... Jun 02 21:39:53.873698 ip-10-0-135-204 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:39:53.873698 ip-10-0-135-204 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 21:39:53.873698 ip-10-0-135-204 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:39:53.873698 ip-10-0-135-204 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 21:39:53.873698 ip-10-0-135-204 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:39:53.874604 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.874507 2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 21:39:53.880430 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880395 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:39:53.880430 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880427 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:39:53.880430 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880431 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:39:53.880430 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880434 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:39:53.880430 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880437 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:39:53.880430 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880440 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880446 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880449 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880451 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880454 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880457 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880460 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880463 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880466 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880469 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880472 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880475 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880477 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880480 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880482 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880485 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880488 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880490 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880493 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880496 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:39:53.880691 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880499 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880501 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880504 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880507 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880514 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880517 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880520 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880523 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880526 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880529 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880532 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880534 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880537 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880540 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880544 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880549 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880553 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880556 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880559 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:39:53.881176 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880565 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880568 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880571 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880573 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880576 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880579 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880582 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880584 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880587 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880590 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880592 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880596 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880601 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880605 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880608 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880612 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880615 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880618 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880621 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:39:53.881668 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880624 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880626 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880630 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880632 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880635 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880637 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880640 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880642 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880646 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880649 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880652 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880655 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880657 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880660 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880663 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880676 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880679 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880682 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880685 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880688 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:39:53.882133 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880690 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880693 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.880695 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881782 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881790 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881794 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881797 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881800 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881802 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881807 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881811 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881814 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881817 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881820 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881823 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881826 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881828 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881831 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881833 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:39:53.882646 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881836 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881840 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881842 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881845 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881848 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881850 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881853 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881856 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881864 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881868 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881870 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881872 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881875 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881877 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881880 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881882 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881885 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881887 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881890 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881893 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:39:53.883118 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881896 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881898 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881901 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881903 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881906 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881908 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881911 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881914 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881917 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881920 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881922 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881925 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881927 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881930 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881933 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881936 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881938 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881941 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881945 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881948 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:39:53.883710 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881951 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881961 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881964 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881966 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881969 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881972 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881974 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881977 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881979 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881982 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881984 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881987 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881990 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881994 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.881997 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882000 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882003 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882005 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882008 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882011 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:39:53.884214 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882014 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882017 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882020 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882022 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882025 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882027 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882030 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882032 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882035 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882037 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882122 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882131 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882147 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882152 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882163 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882167 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882171 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882177 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882180 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882183 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882187 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882190 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 21:39:53.884739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882193 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882196 2567 flags.go:64] FLAG: --cgroup-root="" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882200 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882203 2567 flags.go:64] FLAG: --client-ca-file="" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882206 2567 flags.go:64] FLAG: --cloud-config="" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882209 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882212 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882219 2567 flags.go:64] FLAG: --cluster-domain="" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882222 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882226 2567 flags.go:64] FLAG: --config-dir="" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882229 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882232 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882237 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882240 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882243 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882247 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882250 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882252 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882255 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882258 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882261 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882265 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882268 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882271 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882274 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 21:39:53.885291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882283 2567 flags.go:64] FLAG: --enable-server="true" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882286 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882293 2567 flags.go:64] FLAG: --event-burst="100" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882297 2567 flags.go:64] FLAG: --event-qps="50" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882299 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882303 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882306 2567 flags.go:64] FLAG: --eviction-hard="" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882310 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882313 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882316 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882334 2567 flags.go:64] FLAG: --eviction-soft="" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882337 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882340 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882343 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882346 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882349 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882352 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882355 2567 flags.go:64] FLAG: --feature-gates="" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882359 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882362 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882365 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882368 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882371 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882374 2567 flags.go:64] FLAG: --help="false" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882377 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-135-204.ec2.internal" Jun 02 21:39:53.885931 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882380 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882383 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882386 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882390 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882393 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882396 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882399 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882402 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882411 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882415 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882418 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882422 2567 flags.go:64] FLAG: --kube-reserved="" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882425 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882427 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882431 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882436 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882439 2567 flags.go:64] FLAG: --lock-file="" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882442 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882445 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882448 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882458 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882461 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882464 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 21:39:53.886555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882467 2567 flags.go:64] FLAG: --logging-format="text" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882470 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882474 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882476 2567 flags.go:64] FLAG: --manifest-url="" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882479 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882497 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882501 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882505 2567 flags.go:64] FLAG: --max-pods="110" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882508 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882511 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882514 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882517 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882520 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882523 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882526 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882535 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882538 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882541 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882550 2567 flags.go:64] FLAG: --pod-cidr="" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882553 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882559 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882562 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882566 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882568 2567 flags.go:64] FLAG: --port="10250" Jun 02 21:39:53.887109 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882574 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882577 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b31a2871c03359ad" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882580 2567 flags.go:64] FLAG: --qos-reserved="" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882583 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882586 2567 flags.go:64] FLAG: --register-node="true" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882589 2567 flags.go:64] FLAG: --register-schedulable="true" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882592 2567 flags.go:64] FLAG: --register-with-taints="" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882596 2567 flags.go:64] FLAG: --registry-burst="10" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882599 2567 flags.go:64] FLAG: --registry-qps="5" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882602 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882605 2567 flags.go:64] FLAG: --reserved-memory="" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882608 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882612 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882615 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882617 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882620 2567 flags.go:64] FLAG: --runonce="false" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882623 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882626 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882629 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882632 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882634 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882638 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882641 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882644 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882647 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882651 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 21:39:53.887725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882654 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882665 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882668 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882671 2567 flags.go:64] FLAG: --system-cgroups="" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882674 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882679 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882683 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882686 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882692 2567 flags.go:64] FLAG: --tls-min-version="" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882696 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882699 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882702 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882705 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882708 2567 flags.go:64] FLAG: --v="2" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882712 2567 flags.go:64] FLAG: --version="false" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882716 2567 flags.go:64] FLAG: --vmodule="" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882721 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.882724 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882834 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882838 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882841 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882844 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882847 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:39:53.888407 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882850 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882853 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882855 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882859 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882861 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882864 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882867 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882869 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882872 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882875 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882878 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882886 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882889 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882892 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882894 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882898 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882900 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882903 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882906 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:39:53.889049 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882909 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882913 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882917 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882920 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882923 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882926 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882929 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882931 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882934 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882936 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882939 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882941 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882943 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882946 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882948 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882951 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882955 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882958 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882960 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:39:53.889631 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882963 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882965 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882968 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882970 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882974 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882976 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882985 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882988 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882990 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882993 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882995 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.882997 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883004 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883006 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883008 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883011 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883013 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883016 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883018 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883021 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:39:53.890105 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883024 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883026 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883029 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883032 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883034 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883037 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883040 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883042 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883045 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883048 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883050 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883052 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883055 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883058 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883060 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883063 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883065 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883067 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883070 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883079 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:39:53.890635 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883082 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:39:53.891168 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883084 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:39:53.891168 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.883086 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:39:53.891168 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.883785 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:39:53.892424 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.892397 2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 21:39:53.892465 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.892425 2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 21:39:53.892501 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892480 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:39:53.892501 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892486 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:39:53.892501 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892489 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:39:53.892501 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892493 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:39:53.892501 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892496 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:39:53.892501 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892499 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:39:53.892501 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892502 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892505 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892508 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892512 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892517 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892520 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892523 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892525 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892528 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892531 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892534 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892536 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892539 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892543 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892547 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892550 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892553 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892556 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892559 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:39:53.892681 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892561 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892564 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892567 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892569 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892572 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892575 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892578 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892582 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892584 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892587 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892589 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892592 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892594 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892597 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892600 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892603 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892606 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892610 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892612 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892615 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:39:53.893162 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892617 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892620 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892623 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892626 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892628 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892631 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892634 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892636 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892639 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892641 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892644 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892646 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892649 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892652 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892654 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892656 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892659 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892662 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892664 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892667 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:39:53.893723 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892670 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892672 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892675 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892677 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892680 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892682 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892685 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892689 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892691 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892694 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892697 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892700 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892702 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892704 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892707 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892709 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892712 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892714 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892717 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:39:53.894217 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892720 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892722 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.892727 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892841 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892848 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892851 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892854 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892857 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892860 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892862 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892865 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892867 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892871 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892877 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892880 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:39:53.894707 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892883 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892887 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892889 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892892 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892895 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892899 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892903 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892907 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892910 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892913 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892916 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892919 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892921 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892924 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892927 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892929 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892932 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892934 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892937 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892940 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:39:53.895089 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892942 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892945 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892947 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892949 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892952 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892955 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892957 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892960 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892962 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892965 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892968 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892971 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892974 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892976 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892979 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892981 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892984 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892987 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892990 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:39:53.895610 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892993 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892995 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.892999 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893001 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893005 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893007 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893010 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893012 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893015 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893017 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893020 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893023 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893025 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893028 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893030 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893033 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893035 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893037 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893040 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893043 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:39:53.896144 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893045 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893048 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893050 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893053 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893055 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893058 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893061 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893064 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893066 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893069 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893072 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893075 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893078 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893080 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:53.893083 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.893089 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:39:53.896663 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.893748 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 21:39:53.897180 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.895831 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 21:39:53.897180 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.896870 2567 server.go:1019] "Starting client certificate rotation" Jun 02 21:39:53.897180 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.896990 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 21:39:53.897180 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.897047 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 21:39:53.920690 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.920658 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 21:39:53.922426 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.922403 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 21:39:53.947784 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.947751 2567 log.go:25] "Validated CRI v1 runtime API" Jun 02 21:39:53.953649 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.953623 2567 log.go:25] "Validated CRI v1 image API" Jun 02 21:39:53.955050 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.955013 2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 21:39:53.959119 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.959087 2567 fs.go:135] Filesystem UUIDs: map[186afe7b-f54e-4814-90b4-0fe6118bd0c6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f0538c88-3e8a-4410-a9a9-8e731742fca6:/dev/nvme0n1p4] Jun 02 21:39:53.959119 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.959112 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 21:39:53.960665 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.960645 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 21:39:53.963641 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.963509 2567 manager.go:217] Machine: {Timestamp:2026-06-02 21:39:53.962921734 +0000 UTC m=+0.404369744 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092410 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2306f60e4aaac340987a63e56356e8 SystemUUID:ec2306f6-0e4a-aac3-4098-7a63e56356e8 BootID:95bcb9b0-ad3c-4db4-86ec-40562bb2e613 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:5a:b3:6c:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:5a:b3:6c:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:ef:c6:23:0e:68 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 21:39:53.965175 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.965156 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 21:39:53.965291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.965276 2567 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 21:39:53.967389 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.967351 2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 21:39:53.967563 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.967392 2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 21:39:53.967613 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.967573 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 21:39:53.967613 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.967584 2567 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 21:39:53.967613 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.967596 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 21:39:53.969065 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.969050 2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 21:39:53.970443 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.970428 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 02 21:39:53.970758 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.970747 2567 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 21:39:53.973282 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.973267 2567 kubelet.go:491] "Attempting to sync node with API server" Jun 02 21:39:53.973348 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.973286 2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 21:39:53.973348 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.973305 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 21:39:53.973348 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.973316 2567 kubelet.go:397] "Adding apiserver pod source" Jun 02 21:39:53.973348 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.973339 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 21:39:53.974406 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.974391 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 21:39:53.974452 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.974413 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 21:39:53.977661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.977644 2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 21:39:53.979607 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.979592 2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 21:39:53.981606 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981590 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 21:39:53.981606 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981610 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 21:39:53.981606 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981616 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 21:39:53.981742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981622 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 21:39:53.981742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981632 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 21:39:53.981742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981637 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 21:39:53.981742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981658 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 21:39:53.981742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981664 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 21:39:53.981742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981671 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 21:39:53.981742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981676 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 21:39:53.981742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981689 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 21:39:53.981742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.981694 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 21:39:53.982481 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.982471 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 21:39:53.982518 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.982482 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 21:39:53.985774 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.985751 2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 21:39:53.985864 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:53.985813 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 21:39:53.986073 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.986059 2567 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 21:39:53.986105 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.986100 2567 server.go:1295] "Started kubelet" Jun 02 21:39:53.986474 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:53.986456 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 21:39:53.986522 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.986501 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 21:39:53.986914 ip-10-0-135-204 systemd[1]: Started Kubernetes Kubelet. Jun 02 21:39:53.987822 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.987682 2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 21:39:53.987822 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.987801 2567 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 21:39:53.988952 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.988933 2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 21:39:53.989046 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.989013 2567 server.go:317] "Adding debug handlers to kubelet server" Jun 02 21:39:53.993545 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.993518 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2jjcs" Jun 02 21:39:53.993633 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.993622 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 21:39:53.994427 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.994407 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 21:39:53.994877 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.994860 2567 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 21:39:53.994877 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.994875 2567 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 21:39:53.995015 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.994958 2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 21:39:53.995479 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.995459 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 02 21:39:53.995479 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.995479 2567 reconciler.go:26] "Reconciler: start to sync state" Jun 02 21:39:53.996009 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.995990 2567 factory.go:153] Registering CRI-O factory Jun 02 21:39:53.996084 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.996023 2567 factory.go:223] Registration of the crio container factory successfully Jun 02 21:39:53.996084 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:53.996054 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:53.996183 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.996085 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 21:39:53.996183 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.996097 2567 factory.go:55] Registering systemd factory Jun 02 21:39:53.996183 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.996105 2567 factory.go:223] Registration of the systemd container factory successfully Jun 02 21:39:53.996183 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.996123 2567 factory.go:103] Registering Raw factory Jun 02 21:39:53.996183 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.996141 2567 manager.go:1196] Started watching for new ooms in manager Jun 02 21:39:53.997719 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:53.997701 2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 21:39:53.999593 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:53.996180 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-204.ec2.internal.18b5617798b7ac53 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-204.ec2.internal,UID:ip-10-0-135-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-204.ec2.internal,},FirstTimestamp:2026-06-02 21:39:53.986075731 +0000 UTC m=+0.427523742,LastTimestamp:2026-06-02 21:39:53.986075731 +0000 UTC m=+0.427523742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-204.ec2.internal,}" Jun 02 21:39:53.999821 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:53.999788 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 21:39:53.999885 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:53.999876 2567 manager.go:319] Starting recovery of all containers Jun 02 21:39:54.003742 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.003704 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 21:39:54.004976 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.004925 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2jjcs" Jun 02 21:39:54.010735 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.010610 2567 manager.go:324] Recovery completed Jun 02 21:39:54.014834 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.014822 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:39:54.016979 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.016962 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:39:54.017051 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.016995 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:39:54.017051 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.017012 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:39:54.017604 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.017592 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 21:39:54.017604 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.017603 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 21:39:54.017707 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.017621 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 02 21:39:54.019580 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.019566 2567 policy_none.go:49] "None policy: Start" Jun 02 21:39:54.019633 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.019585 2567 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 21:39:54.019633 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.019596 2567 state_mem.go:35] "Initializing new in-memory state store" Jun 02 21:39:54.020838 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.020745 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-204.ec2.internal.18b561779a8f3976 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-204.ec2.internal,UID:ip-10-0-135-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-204.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-204.ec2.internal,},FirstTimestamp:2026-06-02 21:39:54.016979318 +0000 UTC m=+0.458427328,LastTimestamp:2026-06-02 21:39:54.016979318 +0000 UTC m=+0.458427328,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-204.ec2.internal,}" Jun 02 21:39:54.062882 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.062865 2567 manager.go:341] "Starting Device Plugin manager" Jun 02 21:39:54.063010 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.062902 2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 21:39:54.063010 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.062915 2567 server.go:85] "Starting device plugin registration server" Jun 02 21:39:54.063209 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.063196 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 21:39:54.063295 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.063213 2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 21:39:54.063366 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.063312 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 21:39:54.063421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.063409 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 21:39:54.063421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.063419 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 21:39:54.063882 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.063864 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 21:39:54.063952 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.063905 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:54.121564 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.121526 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 21:39:54.122930 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.122906 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 21:39:54.122930 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.122933 2567 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 21:39:54.123090 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.122952 2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 21:39:54.123090 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.122958 2567 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 21:39:54.123090 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.122998 2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 21:39:54.125961 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.125912 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:39:54.164178 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.164159 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:39:54.165064 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.165041 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:39:54.165162 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.165081 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:39:54.165162 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.165095 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:39:54.165162 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.165117 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.175840 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.175824 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.175901 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.175844 2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-204.ec2.internal\": node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:54.209986 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.209957 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:54.223347 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.223297 2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal"] Jun 02 21:39:54.223402 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.223389 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:39:54.225073 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.225054 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:39:54.225191 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.225088 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:39:54.225191 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.225102 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:39:54.226340 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.226309 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:39:54.226449 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.226435 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.226497 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.226462 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:39:54.227036 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.227022 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:39:54.227112 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.227046 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:39:54.227112 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.227060 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:39:54.227112 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.227084 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:39:54.227112 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.227107 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:39:54.227294 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.227117 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:39:54.228492 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.228476 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.228555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.228504 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:39:54.229251 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.229233 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:39:54.229356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.229261 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:39:54.229356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.229274 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:39:54.258958 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.258941 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-204.ec2.internal\" not found" node="ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.263203 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.263188 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-204.ec2.internal\" not found" node="ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.297440 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.297414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3565e658620396a87d3c9f90705a49e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal\" (UID: \"b3565e658620396a87d3c9f90705a49e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.297529 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.297448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3565e658620396a87d3c9f90705a49e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal\" (UID: \"b3565e658620396a87d3c9f90705a49e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.297529 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.297466 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d5b0ffb4b9babff687ba04be52a82fe-config\") pod \"kube-apiserver-proxy-ip-10-0-135-204.ec2.internal\" (UID: \"5d5b0ffb4b9babff687ba04be52a82fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.310717 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.310700 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:54.397826 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.397763 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d5b0ffb4b9babff687ba04be52a82fe-config\") pod \"kube-apiserver-proxy-ip-10-0-135-204.ec2.internal\" (UID: \"5d5b0ffb4b9babff687ba04be52a82fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.397826 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.397794 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3565e658620396a87d3c9f90705a49e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal\" (UID: \"b3565e658620396a87d3c9f90705a49e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.397826 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.397816 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3565e658620396a87d3c9f90705a49e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal\" (UID: \"b3565e658620396a87d3c9f90705a49e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.397998 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.397874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3565e658620396a87d3c9f90705a49e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal\" (UID: \"b3565e658620396a87d3c9f90705a49e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.397998 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.397880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3565e658620396a87d3c9f90705a49e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal\" (UID: \"b3565e658620396a87d3c9f90705a49e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.397998 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.397874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d5b0ffb4b9babff687ba04be52a82fe-config\") pod \"kube-apiserver-proxy-ip-10-0-135-204.ec2.internal\" (UID: \"5d5b0ffb4b9babff687ba04be52a82fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.411533 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.411512 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:54.512403 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.512361 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:54.561570 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.561549 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.566204 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.566184 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.613341 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.613285 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:54.713857 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.713790 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:54.814313 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.814272 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-204.ec2.internal\" not found" Jun 02 21:39:54.860055 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.860030 2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:39:54.895342 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.895292 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.896381 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.896359 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 21:39:54.896500 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.896474 2567 kubelet.go:3342] "Failed creating a mirror pod" err="Post \"https://ae7b30179235449378614702fc1f7766-3a700961480ca053.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": write tcp 10.0.135.204:36908->18.214.33.169:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.896555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.896487 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection force closed via ClientConn.Close\") has prevented the request from succeeding" Jun 02 21:39:54.896555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.896508 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" Jun 02 21:39:54.896644 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.896481 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection force closed via ClientConn.Close\") has prevented the request from succeeding" Jun 02 21:39:54.923806 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.923780 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 21:39:54.974416 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.974307 2567 apiserver.go:52] "Watching apiserver" Jun 02 21:39:54.984577 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.983931 2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 21:39:54.985903 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.985868 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-vhshf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal","openshift-multus/network-metrics-daemon-s78vq","openshift-network-diagnostics/network-check-target-q2f2h","openshift-ovn-kubernetes/ovnkube-node-qccxd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9","openshift-cluster-node-tuning-operator/tuned-vs8xb","openshift-dns/node-resolver-p6w7x","openshift-image-registry/node-ca-7vwsn","openshift-multus/multus-additional-cni-plugins-fsmb4","openshift-multus/multus-rph7j","openshift-network-operator/iptables-alerter-tzl74"] Jun 02 21:39:54.987361 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.987317 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:39:54.989191 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.989169 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:54.989318 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.989244 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:39:54.989318 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.989260 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:39:54.989318 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:54.989295 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:39:54.990280 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.990261 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:54.991195 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.991175 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:54.992271 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.992247 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:54.992482 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.992459 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jdh7g\"" Jun 02 21:39:54.992554 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.992256 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 21:39:54.992554 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.992509 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 21:39:54.993531 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.993511 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:54.993803 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.993777 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 21:39:54.993935 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.993919 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 21:39:54.993996 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.993968 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 21:39:54.994053 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.994006 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 21:39:54.994106 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.993974 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 21:39:54.997082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.994730 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 21:39:54.997082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.995032 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 21:39:54.997082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.995043 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 21:39:54.997082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.995510 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 21:39:54.997082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.995967 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lh942\"" Jun 02 21:39:54.997082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.995995 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sk2tz\"" Jun 02 21:39:54.997082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.996131 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:39:54.997082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.996482 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 21:39:54.997082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.997007 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 21:39:54.997588 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.997131 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 21:39:54.997588 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.997436 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b9p9q\"" Jun 02 21:39:54.997678 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.997615 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6wrhv\"" Jun 02 21:39:54.998004 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.997984 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 21:39:54.998860 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.998841 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:54.999091 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.999071 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.000018 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:54.999998 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.000270 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2347edd3-4cda-4b9f-bc0a-bd85c68d58ba-tmp-dir\") pod \"node-resolver-p6w7x\" (UID: \"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba\") " pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.000372 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-kubernetes\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.000372 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000352 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-sysctl-conf\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.000471 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000384 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-run\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.000471 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-node-log\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.000471 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-registration-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.000612 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1902331-28a2-41c2-8800-3e31f1d6579e-konnectivity-ca\") pod \"konnectivity-agent-vhshf\" (UID: \"e1902331-28a2-41c2-8800-3e31f1d6579e\") " pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:39:55.000612 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-systemd\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.000612 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-var-lib-kubelet\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.000612 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000578 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-systemd-units\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.000804 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-run-netns\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.000804 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.000804 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2347edd3-4cda-4b9f-bc0a-bd85c68d58ba-hosts-file\") pod \"node-resolver-p6w7x\" (UID: \"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba\") " pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.000804 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-run-openvswitch\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.000804 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-cni-bin\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.000804 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-cni-netd\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-sysconfig\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.001022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000910 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-sysctl-d\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.001022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:55.001022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-slash\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-etc-openvswitch\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.000989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-log-socket\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001024 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/747723c7-1eef-4a2c-a61a-1b1c5cde181b-ovnkube-script-lib\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001078 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-host\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-kubelet\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001126 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-var-lib-openvswitch\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001163 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhpk7\" (UniqueName: \"kubernetes.io/projected/747723c7-1eef-4a2c-a61a-1b1c5cde181b-kube-api-access-zhpk7\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001185 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001206 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06cf6962-db9f-4f50-95c4-af6decb2627e-host\") pod \"node-ca-7vwsn\" (UID: \"06cf6962-db9f-4f50-95c4-af6decb2627e\") " pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001183 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.001260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001228 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06cf6962-db9f-4f50-95c4-af6decb2627e-serviceca\") pod \"node-ca-7vwsn\" (UID: \"06cf6962-db9f-4f50-95c4-af6decb2627e\") " pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-sys\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001294 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-lib-modules\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-run-systemd\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-run-ovn\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001388 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/747723c7-1eef-4a2c-a61a-1b1c5cde181b-ovnkube-config\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001429 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/747723c7-1eef-4a2c-a61a-1b1c5cde181b-env-overrides\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6btq\" (UniqueName: \"kubernetes.io/projected/fa7d0862-db95-481e-b5b7-686a535f0fdf-kube-api-access-n6btq\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1902331-28a2-41c2-8800-3e31f1d6579e-agent-certs\") pod \"konnectivity-agent-vhshf\" (UID: \"e1902331-28a2-41c2-8800-3e31f1d6579e\") " pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001541 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-modprobe-d\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-tmp\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001606 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb47b\" (UniqueName: \"kubernetes.io/projected/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-kube-api-access-gb47b\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/747723c7-1eef-4a2c-a61a-1b1c5cde181b-ovn-node-metrics-cert\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-socket-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001695 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnqhx\" (UniqueName: \"kubernetes.io/projected/2347edd3-4cda-4b9f-bc0a-bd85c68d58ba-kube-api-access-wnqhx\") pod \"node-resolver-p6w7x\" (UID: \"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba\") " pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.001743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg724\" (UniqueName: \"kubernetes.io/projected/06cf6962-db9f-4f50-95c4-af6decb2627e-kube-api-access-kg724\") pod \"node-ca-7vwsn\" (UID: \"06cf6962-db9f-4f50-95c4-af6decb2627e\") " pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.002266 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-tuned\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.002266 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvhxm\" (UniqueName: \"kubernetes.io/projected/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-kube-api-access-rvhxm\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.002266 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-device-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.002266 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.001819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-sys-fs\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.002844 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.002820 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 21:39:55.002949 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.002877 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 21:39:55.002949 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.002937 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b8nqm\"" Jun 02 21:39:55.003189 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.003173 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 21:39:55.003278 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.003189 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 21:39:55.003278 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.003212 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 21:39:55.003412 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.003304 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 21:39:55.003412 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.003373 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8g56b\"" Jun 02 21:39:55.004518 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.004496 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 21:39:55.004616 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.004524 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 21:39:55.004616 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.004557 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 21:39:55.004616 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.004597 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lq6f5\"" Jun 02 21:39:55.004795 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.004496 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:39:55.004992 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.004799 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pm2cm\"" Jun 02 21:39:55.004992 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.004876 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 21:39:55.004992 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.004913 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 21:39:55.009996 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.009947 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 21:34:53 +0000 UTC" deadline="2027-11-29 12:55:14.493166021 +0000 UTC" Jun 02 21:39:55.009996 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.009989 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13071h15m19.483179677s" Jun 02 21:39:55.021937 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.021901 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 21:39:55.025255 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.025232 2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:39:55.040524 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.040480 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3565e658620396a87d3c9f90705a49e.slice/crio-c06a911d608a87ada46adc39c07c88f2cf1bc71b336a723625f37ab2bd5b9785 WatchSource:0}: Error finding container c06a911d608a87ada46adc39c07c88f2cf1bc71b336a723625f37ab2bd5b9785: Status 404 returned error can't find the container with id c06a911d608a87ada46adc39c07c88f2cf1bc71b336a723625f37ab2bd5b9785 Jun 02 21:39:55.040843 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.040818 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5b0ffb4b9babff687ba04be52a82fe.slice/crio-b16de65382924c457461f7aaf5b45a993bc293f59a7337956b02ac97d4a690fc WatchSource:0}: Error finding container b16de65382924c457461f7aaf5b45a993bc293f59a7337956b02ac97d4a690fc: Status 404 returned error can't find the container with id b16de65382924c457461f7aaf5b45a993bc293f59a7337956b02ac97d4a690fc Jun 02 21:39:55.044146 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.044120 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:39:55.054460 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.054427 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pm9fk" Jun 02 21:39:55.063026 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.063000 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pm9fk" Jun 02 21:39:55.095855 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.095820 2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 21:39:55.102617 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102587 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1902331-28a2-41c2-8800-3e31f1d6579e-agent-certs\") pod \"konnectivity-agent-vhshf\" (UID: \"e1902331-28a2-41c2-8800-3e31f1d6579e\") " pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:39:55.102772 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102629 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gb47b\" (UniqueName: \"kubernetes.io/projected/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-kube-api-access-gb47b\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:55.102772 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpmlr\" (UniqueName: \"kubernetes.io/projected/9b117b21-c414-4951-ac1f-455c61450457-kube-api-access-wpmlr\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.102772 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-cnibin\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.102772 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102695 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-tuned\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.102772 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102718 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-device-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.102993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102804 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-device-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.102993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102823 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-sys-fs\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.102993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-system-cni-dir\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.102993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbmh2\" (UniqueName: \"kubernetes.io/projected/61c49ca3-a281-4b56-8982-de471443988b-kube-api-access-cbmh2\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.102993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102882 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-sys-fs\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.102993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102918 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-kubernetes\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.102993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102968 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-run\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.102993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-kubernetes\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.102998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-run-netns\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/299bad1e-5232-47ee-9cca-55a62fe3ff76-host-slash\") pod \"iptables-alerter-tzl74\" (UID: \"299bad1e-5232-47ee-9cca-55a62fe3ff76\") " pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103041 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-run\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103057 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-var-lib-kubelet\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103084 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-run-netns\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103069 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b117b21-c414-4951-ac1f-455c61450457-multus-daemon-config\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103152 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-var-lib-kubelet\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103169 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-run-netns\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103182 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103221 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61c49ca3-a281-4b56-8982-de471443988b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103284 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-sysctl-d\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.103356 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103352 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-etc-openvswitch\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103382 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/747723c7-1eef-4a2c-a61a-1b1c5cde181b-ovnkube-script-lib\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103407 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhpk7\" (UniqueName: \"kubernetes.io/projected/747723c7-1eef-4a2c-a61a-1b1c5cde181b-kube-api-access-zhpk7\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-sysctl-d\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103437 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-etc-openvswitch\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b117b21-c414-4951-ac1f-455c61450457-cni-binary-copy\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-var-lib-kubelet\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/299bad1e-5232-47ee-9cca-55a62fe3ff76-iptables-alerter-script\") pod \"iptables-alerter-tzl74\" (UID: \"299bad1e-5232-47ee-9cca-55a62fe3ff76\") " pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103555 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-system-cni-dir\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103584 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103611 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06cf6962-db9f-4f50-95c4-af6decb2627e-host\") pod \"node-ca-7vwsn\" (UID: \"06cf6962-db9f-4f50-95c4-af6decb2627e\") " pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103664 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06cf6962-db9f-4f50-95c4-af6decb2627e-serviceca\") pod \"node-ca-7vwsn\" (UID: \"06cf6962-db9f-4f50-95c4-af6decb2627e\") " pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103672 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06cf6962-db9f-4f50-95c4-af6decb2627e-host\") pod \"node-ca-7vwsn\" (UID: \"06cf6962-db9f-4f50-95c4-af6decb2627e\") " pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-etc-kubernetes\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103736 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/747723c7-1eef-4a2c-a61a-1b1c5cde181b-ovnkube-config\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103762 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/747723c7-1eef-4a2c-a61a-1b1c5cde181b-env-overrides\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103788 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6btq\" (UniqueName: \"kubernetes.io/projected/fa7d0862-db95-481e-b5b7-686a535f0fdf-kube-api-access-n6btq\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.103977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103813 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-modprobe-d\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103835 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-tmp\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103858 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/747723c7-1eef-4a2c-a61a-1b1c5cde181b-ovn-node-metrics-cert\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103881 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-socket-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103904 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-multus-cni-dir\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103927 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-multus-socket-dir-parent\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-var-lib-cni-bin\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.103975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104101 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06cf6962-db9f-4f50-95c4-af6decb2627e-serviceca\") pod \"node-ca-7vwsn\" (UID: \"06cf6962-db9f-4f50-95c4-af6decb2627e\") " pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104177 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/747723c7-1eef-4a2c-a61a-1b1c5cde181b-ovnkube-script-lib\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104439 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/747723c7-1eef-4a2c-a61a-1b1c5cde181b-env-overrides\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104001 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvhxm\" (UniqueName: \"kubernetes.io/projected/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-kube-api-access-rvhxm\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104586 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-socket-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104634 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2347edd3-4cda-4b9f-bc0a-bd85c68d58ba-tmp-dir\") pod \"node-resolver-p6w7x\" (UID: \"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba\") " pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104650 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/747723c7-1eef-4a2c-a61a-1b1c5cde181b-ovnkube-config\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104674 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-sysctl-conf\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-modprobe-d\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.104969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104740 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-node-log\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104798 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-sysctl-conf\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104843 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-registration-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-run-k8s-cni-cncf-io\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104846 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-node-log\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2347edd3-4cda-4b9f-bc0a-bd85c68d58ba-tmp-dir\") pod \"node-resolver-p6w7x\" (UID: \"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba\") " pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-var-lib-cni-multus\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104908 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-registration-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-run-multus-certs\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104952 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1902331-28a2-41c2-8800-3e31f1d6579e-konnectivity-ca\") pod \"konnectivity-agent-vhshf\" (UID: \"e1902331-28a2-41c2-8800-3e31f1d6579e\") " pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.104976 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-systemd\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105003 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-systemd-units\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105028 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105032 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-systemd\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105061 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2347edd3-4cda-4b9f-bc0a-bd85c68d58ba-hosts-file\") pod \"node-resolver-p6w7x\" (UID: \"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba\") " pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105073 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105135 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2347edd3-4cda-4b9f-bc0a-bd85c68d58ba-hosts-file\") pod \"node-resolver-p6w7x\" (UID: \"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba\") " pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.105791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105167 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-systemd-units\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-cnibin\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105220 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-run-openvswitch\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105246 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-cni-bin\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105272 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-run-openvswitch\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105271 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-cni-netd\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105341 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-cni-bin\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105438 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1902331-28a2-41c2-8800-3e31f1d6579e-konnectivity-ca\") pod \"konnectivity-agent-vhshf\" (UID: \"e1902331-28a2-41c2-8800-3e31f1d6579e\") " pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105473 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-cni-netd\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-os-release\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61c49ca3-a281-4b56-8982-de471443988b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105538 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kg724\" (UniqueName: \"kubernetes.io/projected/06cf6962-db9f-4f50-95c4-af6decb2627e-kube-api-access-kg724\") pod \"node-ca-7vwsn\" (UID: \"06cf6962-db9f-4f50-95c4-af6decb2627e\") " pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105567 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-sysconfig\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105593 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105618 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-slash\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105646 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-log-socket\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105662 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-sysconfig\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.106567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcb8j\" (UniqueName: \"kubernetes.io/projected/299bad1e-5232-47ee-9cca-55a62fe3ff76-kube-api-access-gcb8j\") pod \"iptables-alerter-tzl74\" (UID: \"299bad1e-5232-47ee-9cca-55a62fe3ff76\") " pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105712 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-slash\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-os-release\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105750 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-host\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-log-socket\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105822 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-kubelet\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.105832 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105850 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-var-lib-openvswitch\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105873 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.105942 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs podName:96f66b77-910c-4cdd-9633-18f1ff5c3cfd nodeName:}" failed. No retries permitted until 2026-06-02 21:39:55.605890882 +0000 UTC m=+2.047338892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs") pod "network-metrics-daemon-s78vq" (UID: "96f66b77-910c-4cdd-9633-18f1ff5c3cfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105933 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-var-lib-openvswitch\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105966 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-host-kubelet\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.105968 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-hostroot\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106006 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-host\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-multus-conf-dir\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61c49ca3-a281-4b56-8982-de471443988b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106082 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnqhx\" (UniqueName: \"kubernetes.io/projected/2347edd3-4cda-4b9f-bc0a-bd85c68d58ba-kube-api-access-wnqhx\") pod \"node-resolver-p6w7x\" (UID: \"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba\") " pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.107227 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106088 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106109 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-sys\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106147 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-lib-modules\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106173 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-run-systemd\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106199 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-run-ovn\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106224 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-lib-modules\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106343 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa7d0862-db95-481e-b5b7-686a535f0fdf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106346 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-run-systemd\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/747723c7-1eef-4a2c-a61a-1b1c5cde181b-run-ovn\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.106181 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-sys\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.107172 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-tmp\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.107212 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-etc-tuned\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.107279 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/747723c7-1eef-4a2c-a61a-1b1c5cde181b-ovn-node-metrics-cert\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.107775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.107445 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1902331-28a2-41c2-8800-3e31f1d6579e-agent-certs\") pod \"konnectivity-agent-vhshf\" (UID: \"e1902331-28a2-41c2-8800-3e31f1d6579e\") " pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:39:55.126900 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.126848 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" event={"ID":"b3565e658620396a87d3c9f90705a49e","Type":"ContainerStarted","Data":"c06a911d608a87ada46adc39c07c88f2cf1bc71b336a723625f37ab2bd5b9785"} Jun 02 21:39:55.127758 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.127726 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:39:55.127758 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.127757 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:39:55.127758 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.127772 2567 projected.go:194] Error preparing data for projected volume kube-api-access-vvk52 for pod openshift-network-diagnostics/network-check-target-q2f2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:39:55.128018 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.127843 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52 podName:7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98 nodeName:}" failed. No retries permitted until 2026-06-02 21:39:55.627820618 +0000 UTC m=+2.069268635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vvk52" (UniqueName: "kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52") pod "network-check-target-q2f2h" (UID: "7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:39:55.128018 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.127855 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" event={"ID":"5d5b0ffb4b9babff687ba04be52a82fe","Type":"ContainerStarted","Data":"b16de65382924c457461f7aaf5b45a993bc293f59a7337956b02ac97d4a690fc"} Jun 02 21:39:55.130289 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.130258 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6btq\" (UniqueName: \"kubernetes.io/projected/fa7d0862-db95-481e-b5b7-686a535f0fdf-kube-api-access-n6btq\") pod \"aws-ebs-csi-driver-node-dtmp9\" (UID: \"fa7d0862-db95-481e-b5b7-686a535f0fdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.130417 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.130305 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb47b\" (UniqueName: \"kubernetes.io/projected/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-kube-api-access-gb47b\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:55.130417 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.130348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnqhx\" (UniqueName: \"kubernetes.io/projected/2347edd3-4cda-4b9f-bc0a-bd85c68d58ba-kube-api-access-wnqhx\") pod \"node-resolver-p6w7x\" (UID: \"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba\") " pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.130417 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.130261 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvhxm\" (UniqueName: \"kubernetes.io/projected/3ff651cf-e11e-4f8c-9a86-66d96a79b91a-kube-api-access-rvhxm\") pod \"tuned-vs8xb\" (UID: \"3ff651cf-e11e-4f8c-9a86-66d96a79b91a\") " pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.131916 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.131896 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhpk7\" (UniqueName: \"kubernetes.io/projected/747723c7-1eef-4a2c-a61a-1b1c5cde181b-kube-api-access-zhpk7\") pod \"ovnkube-node-qccxd\" (UID: \"747723c7-1eef-4a2c-a61a-1b1c5cde181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.132307 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.132292 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg724\" (UniqueName: \"kubernetes.io/projected/06cf6962-db9f-4f50-95c4-af6decb2627e-kube-api-access-kg724\") pod \"node-ca-7vwsn\" (UID: \"06cf6962-db9f-4f50-95c4-af6decb2627e\") " pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.206597 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206560 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b117b21-c414-4951-ac1f-455c61450457-multus-daemon-config\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.206597 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206593 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61c49ca3-a281-4b56-8982-de471443988b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.206776 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206610 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b117b21-c414-4951-ac1f-455c61450457-cni-binary-copy\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.206776 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206628 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-var-lib-kubelet\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.206776 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206645 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/299bad1e-5232-47ee-9cca-55a62fe3ff76-iptables-alerter-script\") pod \"iptables-alerter-tzl74\" (UID: \"299bad1e-5232-47ee-9cca-55a62fe3ff76\") " pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.206776 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206660 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-system-cni-dir\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.206776 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206699 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-system-cni-dir\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.207013 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206867 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-etc-kubernetes\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207013 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206905 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-multus-cni-dir\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207013 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206929 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-multus-socket-dir-parent\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207013 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-var-lib-kubelet\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207013 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206960 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-etc-kubernetes\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207013 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206952 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-var-lib-cni-bin\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207013 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.206986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-var-lib-cni-bin\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207013 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207010 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-multus-cni-dir\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207034 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-multus-socket-dir-parent\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207044 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-run-k8s-cni-cncf-io\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207070 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-var-lib-cni-multus\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-var-lib-cni-multus\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-run-k8s-cni-cncf-io\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207155 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-run-multus-certs\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207158 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207185 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-cnibin\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207205 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-run-multus-certs\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207212 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-os-release\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207221 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-cnibin\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207245 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61c49ca3-a281-4b56-8982-de471443988b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207272 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b117b21-c414-4951-ac1f-455c61450457-multus-daemon-config\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207285 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-os-release\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207290 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcb8j\" (UniqueName: \"kubernetes.io/projected/299bad1e-5232-47ee-9cca-55a62fe3ff76-kube-api-access-gcb8j\") pod \"iptables-alerter-tzl74\" (UID: \"299bad1e-5232-47ee-9cca-55a62fe3ff76\") " pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207293 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b117b21-c414-4951-ac1f-455c61450457-cni-binary-copy\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.207421 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207272 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/299bad1e-5232-47ee-9cca-55a62fe3ff76-iptables-alerter-script\") pod \"iptables-alerter-tzl74\" (UID: \"299bad1e-5232-47ee-9cca-55a62fe3ff76\") " pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207372 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-os-release\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207394 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-hostroot\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207410 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-multus-conf-dir\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207432 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61c49ca3-a281-4b56-8982-de471443988b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207441 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-hostroot\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-os-release\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-multus-conf-dir\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207467 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpmlr\" (UniqueName: \"kubernetes.io/projected/9b117b21-c414-4951-ac1f-455c61450457-kube-api-access-wpmlr\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207514 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-cnibin\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207552 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-system-cni-dir\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207587 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61c49ca3-a281-4b56-8982-de471443988b-cnibin\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207598 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmh2\" (UniqueName: \"kubernetes.io/projected/61c49ca3-a281-4b56-8982-de471443988b-kube-api-access-cbmh2\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207635 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-run-netns\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207668 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/299bad1e-5232-47ee-9cca-55a62fe3ff76-host-slash\") pod \"iptables-alerter-tzl74\" (UID: \"299bad1e-5232-47ee-9cca-55a62fe3ff76\") " pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207676 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-system-cni-dir\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207712 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61c49ca3-a281-4b56-8982-de471443988b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207729 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/299bad1e-5232-47ee-9cca-55a62fe3ff76-host-slash\") pod \"iptables-alerter-tzl74\" (UID: \"299bad1e-5232-47ee-9cca-55a62fe3ff76\") " pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.208032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b117b21-c414-4951-ac1f-455c61450457-host-run-netns\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.208589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207869 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61c49ca3-a281-4b56-8982-de471443988b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.208589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.207884 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61c49ca3-a281-4b56-8982-de471443988b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.228736 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.228681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbmh2\" (UniqueName: \"kubernetes.io/projected/61c49ca3-a281-4b56-8982-de471443988b-kube-api-access-cbmh2\") pod \"multus-additional-cni-plugins-fsmb4\" (UID: \"61c49ca3-a281-4b56-8982-de471443988b\") " pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.229125 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.229104 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcb8j\" (UniqueName: \"kubernetes.io/projected/299bad1e-5232-47ee-9cca-55a62fe3ff76-kube-api-access-gcb8j\") pod \"iptables-alerter-tzl74\" (UID: \"299bad1e-5232-47ee-9cca-55a62fe3ff76\") " pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.230273 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.230257 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpmlr\" (UniqueName: \"kubernetes.io/projected/9b117b21-c414-4951-ac1f-455c61450457-kube-api-access-wpmlr\") pod \"multus-rph7j\" (UID: \"9b117b21-c414-4951-ac1f-455c61450457\") " pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.320948 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.320921 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:39:55.328027 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.328002 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1902331_28a2_41c2_8800_3e31f1d6579e.slice/crio-13c6ee0f9b2d61f3669277c8f13f3566d680deb9197af22962a367e160f6c7b2 WatchSource:0}: Error finding container 13c6ee0f9b2d61f3669277c8f13f3566d680deb9197af22962a367e160f6c7b2: Status 404 returned error can't find the container with id 13c6ee0f9b2d61f3669277c8f13f3566d680deb9197af22962a367e160f6c7b2 Jun 02 21:39:55.348414 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.348392 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:39:55.354977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.354958 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" Jun 02 21:39:55.355924 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.355904 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747723c7_1eef_4a2c_a61a_1b1c5cde181b.slice/crio-ff49ce962d81944a167a802c6acd155d467a05cc3230da44f3567d5f9a4ac693 WatchSource:0}: Error finding container ff49ce962d81944a167a802c6acd155d467a05cc3230da44f3567d5f9a4ac693: Status 404 returned error can't find the container with id ff49ce962d81944a167a802c6acd155d467a05cc3230da44f3567d5f9a4ac693 Jun 02 21:39:55.359866 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.359848 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" Jun 02 21:39:55.364465 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.364443 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7d0862_db95_481e_b5b7_686a535f0fdf.slice/crio-e7cf3b1750554de30339ebda9b82fd1d6c6f11cfc06e16cf8e1684d745c9a523 WatchSource:0}: Error finding container e7cf3b1750554de30339ebda9b82fd1d6c6f11cfc06e16cf8e1684d745c9a523: Status 404 returned error can't find the container with id e7cf3b1750554de30339ebda9b82fd1d6c6f11cfc06e16cf8e1684d745c9a523 Jun 02 21:39:55.365114 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.365095 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6w7x" Jun 02 21:39:55.366363 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.366342 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff651cf_e11e_4f8c_9a86_66d96a79b91a.slice/crio-da0c79ed66a6559966311dc884558afd7b9c09f61d7b85afe45ef6b7934135e0 WatchSource:0}: Error finding container da0c79ed66a6559966311dc884558afd7b9c09f61d7b85afe45ef6b7934135e0: Status 404 returned error can't find the container with id da0c79ed66a6559966311dc884558afd7b9c09f61d7b85afe45ef6b7934135e0 Jun 02 21:39:55.371562 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.371545 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7vwsn" Jun 02 21:39:55.371823 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.371776 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2347edd3_4cda_4b9f_bc0a_bd85c68d58ba.slice/crio-7f0841a1fffb32778606b8e636ca531c6c89a36db4b1bad29fbb28a47e32f834 WatchSource:0}: Error finding container 7f0841a1fffb32778606b8e636ca531c6c89a36db4b1bad29fbb28a47e32f834: Status 404 returned error can't find the container with id 7f0841a1fffb32778606b8e636ca531c6c89a36db4b1bad29fbb28a47e32f834 Jun 02 21:39:55.376543 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.376526 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" Jun 02 21:39:55.378228 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.378211 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06cf6962_db9f_4f50_95c4_af6decb2627e.slice/crio-28c4719e4596e459290a12d74990036ace067f1899c5aaf047d01ed6d6963f71 WatchSource:0}: Error finding container 28c4719e4596e459290a12d74990036ace067f1899c5aaf047d01ed6d6963f71: Status 404 returned error can't find the container with id 28c4719e4596e459290a12d74990036ace067f1899c5aaf047d01ed6d6963f71 Jun 02 21:39:55.382669 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.382650 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rph7j" Jun 02 21:39:55.383386 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.383367 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c49ca3_a281_4b56_8982_de471443988b.slice/crio-ccbc7c97bf8a18b905efe14f2129cda7b99f2c8432a41959d3dae97b0f0c897b WatchSource:0}: Error finding container ccbc7c97bf8a18b905efe14f2129cda7b99f2c8432a41959d3dae97b0f0c897b: Status 404 returned error can't find the container with id ccbc7c97bf8a18b905efe14f2129cda7b99f2c8432a41959d3dae97b0f0c897b Jun 02 21:39:55.385576 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.385541 2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:39:55.388182 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.388164 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tzl74" Jun 02 21:39:55.388856 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.388837 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b117b21_c414_4951_ac1f_455c61450457.slice/crio-30e8bb97f685c537b8bd899da7da74e04f204e3fafc55a83ff38ed37f0177d52 WatchSource:0}: Error finding container 30e8bb97f685c537b8bd899da7da74e04f204e3fafc55a83ff38ed37f0177d52: Status 404 returned error can't find the container with id 30e8bb97f685c537b8bd899da7da74e04f204e3fafc55a83ff38ed37f0177d52 Jun 02 21:39:55.395095 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:39:55.395076 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299bad1e_5232_47ee_9cca_55a62fe3ff76.slice/crio-aa4154ee978a152e47c39a9d8c45546f1f40d220a0091e1ee4e292b4adbce9a8 WatchSource:0}: Error finding container aa4154ee978a152e47c39a9d8c45546f1f40d220a0091e1ee4e292b4adbce9a8: Status 404 returned error can't find the container with id aa4154ee978a152e47c39a9d8c45546f1f40d220a0091e1ee4e292b4adbce9a8 Jun 02 21:39:55.610668 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.610637 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:55.610849 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.610786 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:39:55.610849 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.610850 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs podName:96f66b77-910c-4cdd-9633-18f1ff5c3cfd nodeName:}" failed. No retries permitted until 2026-06-02 21:39:56.610831462 +0000 UTC m=+3.052279463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs") pod "network-metrics-daemon-s78vq" (UID: "96f66b77-910c-4cdd-9633-18f1ff5c3cfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:39:55.711794 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.711752 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:39:55.711996 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.711954 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:39:55.711996 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.711975 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:39:55.711996 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.711989 2567 projected.go:194] Error preparing data for projected volume kube-api-access-vvk52 for pod openshift-network-diagnostics/network-check-target-q2f2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:39:55.712178 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:55.712041 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52 podName:7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98 nodeName:}" failed. No retries permitted until 2026-06-02 21:39:56.712026748 +0000 UTC m=+3.153474757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvk52" (UniqueName: "kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52") pod "network-check-target-q2f2h" (UID: "7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:39:55.914147 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:55.914049 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:39:56.063756 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.063719 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 21:34:55 +0000 UTC" deadline="2027-11-23 00:43:02.829558368 +0000 UTC" Jun 02 21:39:56.063756 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.063754 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12915h3m6.765807694s" Jun 02 21:39:56.126273 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.126239 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:56.126492 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:56.126395 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:39:56.166097 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.165991 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tzl74" event={"ID":"299bad1e-5232-47ee-9cca-55a62fe3ff76","Type":"ContainerStarted","Data":"aa4154ee978a152e47c39a9d8c45546f1f40d220a0091e1ee4e292b4adbce9a8"} Jun 02 21:39:56.195522 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.193194 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7vwsn" event={"ID":"06cf6962-db9f-4f50-95c4-af6decb2627e","Type":"ContainerStarted","Data":"28c4719e4596e459290a12d74990036ace067f1899c5aaf047d01ed6d6963f71"} Jun 02 21:39:56.198682 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.198407 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6w7x" event={"ID":"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba","Type":"ContainerStarted","Data":"7f0841a1fffb32778606b8e636ca531c6c89a36db4b1bad29fbb28a47e32f834"} Jun 02 21:39:56.227772 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.227731 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" event={"ID":"3ff651cf-e11e-4f8c-9a86-66d96a79b91a","Type":"ContainerStarted","Data":"da0c79ed66a6559966311dc884558afd7b9c09f61d7b85afe45ef6b7934135e0"} Jun 02 21:39:56.234206 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.234173 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" event={"ID":"747723c7-1eef-4a2c-a61a-1b1c5cde181b","Type":"ContainerStarted","Data":"ff49ce962d81944a167a802c6acd155d467a05cc3230da44f3567d5f9a4ac693"} Jun 02 21:39:56.271291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.271232 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhshf" event={"ID":"e1902331-28a2-41c2-8800-3e31f1d6579e","Type":"ContainerStarted","Data":"13c6ee0f9b2d61f3669277c8f13f3566d680deb9197af22962a367e160f6c7b2"} Jun 02 21:39:56.283129 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.283072 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rph7j" event={"ID":"9b117b21-c414-4951-ac1f-455c61450457","Type":"ContainerStarted","Data":"30e8bb97f685c537b8bd899da7da74e04f204e3fafc55a83ff38ed37f0177d52"} Jun 02 21:39:56.297969 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.297921 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" event={"ID":"61c49ca3-a281-4b56-8982-de471443988b","Type":"ContainerStarted","Data":"ccbc7c97bf8a18b905efe14f2129cda7b99f2c8432a41959d3dae97b0f0c897b"} Jun 02 21:39:56.319168 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.319128 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" event={"ID":"fa7d0862-db95-481e-b5b7-686a535f0fdf","Type":"ContainerStarted","Data":"e7cf3b1750554de30339ebda9b82fd1d6c6f11cfc06e16cf8e1684d745c9a523"} Jun 02 21:39:56.618840 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.618801 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:56.619007 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:56.618979 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:39:56.619078 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:56.619046 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs podName:96f66b77-910c-4cdd-9633-18f1ff5c3cfd nodeName:}" failed. No retries permitted until 2026-06-02 21:39:58.619026005 +0000 UTC m=+5.060474025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs") pod "network-metrics-daemon-s78vq" (UID: "96f66b77-910c-4cdd-9633-18f1ff5c3cfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:39:56.719893 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:56.719854 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:39:56.720114 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:56.720081 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:39:56.720114 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:56.720106 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:39:56.720245 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:56.720121 2567 projected.go:194] Error preparing data for projected volume kube-api-access-vvk52 for pod openshift-network-diagnostics/network-check-target-q2f2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:39:56.720245 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:56.720197 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52 podName:7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98 nodeName:}" failed. No retries permitted until 2026-06-02 21:39:58.720175513 +0000 UTC m=+5.161623514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvk52" (UniqueName: "kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52") pod "network-check-target-q2f2h" (UID: "7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:39:57.010967 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:57.010880 2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:39:57.064137 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:57.064069 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 21:34:55 +0000 UTC" deadline="2028-03-17 19:20:23.441575268 +0000 UTC" Jun 02 21:39:57.064137 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:57.064121 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15693h40m26.377459057s" Jun 02 21:39:57.126420 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:57.123559 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:39:57.126420 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:57.123735 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:39:58.126255 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:58.125672 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:58.126255 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:58.125815 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:39:58.638418 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:58.637785 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:39:58.638418 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:58.637967 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:39:58.638418 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:58.638031 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs podName:96f66b77-910c-4cdd-9633-18f1ff5c3cfd nodeName:}" failed. No retries permitted until 2026-06-02 21:40:02.63801179 +0000 UTC m=+9.079459803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs") pod "network-metrics-daemon-s78vq" (UID: "96f66b77-910c-4cdd-9633-18f1ff5c3cfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:39:58.739193 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:58.739107 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:39:58.739454 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:58.739317 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:39:58.739454 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:58.739354 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:39:58.739454 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:58.739367 2567 projected.go:194] Error preparing data for projected volume kube-api-access-vvk52 for pod openshift-network-diagnostics/network-check-target-q2f2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:39:58.739454 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:58.739426 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52 podName:7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98 nodeName:}" failed. No retries permitted until 2026-06-02 21:40:02.739408478 +0000 UTC m=+9.180856489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvk52" (UniqueName: "kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52") pod "network-check-target-q2f2h" (UID: "7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:39:59.123291 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:39:59.123249 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:39:59.123602 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:39:59.123408 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:00.125631 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:00.125445 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:00.125631 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:00.125578 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:01.123790 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:01.123747 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:01.124035 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:01.123888 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:02.123453 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:02.123408 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:02.123904 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:02.123567 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:02.673879 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:02.673282 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:02.673879 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:02.673485 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:40:02.673879 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:02.673550 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs podName:96f66b77-910c-4cdd-9633-18f1ff5c3cfd nodeName:}" failed. No retries permitted until 2026-06-02 21:40:10.673529608 +0000 UTC m=+17.114977611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs") pod "network-metrics-daemon-s78vq" (UID: "96f66b77-910c-4cdd-9633-18f1ff5c3cfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:40:02.774375 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:02.774315 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:02.774596 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:02.774514 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:40:02.774596 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:02.774534 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:40:02.774596 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:02.774547 2567 projected.go:194] Error preparing data for projected volume kube-api-access-vvk52 for pod openshift-network-diagnostics/network-check-target-q2f2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:40:02.774778 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:02.774606 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52 podName:7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98 nodeName:}" failed. No retries permitted until 2026-06-02 21:40:10.774587675 +0000 UTC m=+17.216035691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvk52" (UniqueName: "kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52") pod "network-check-target-q2f2h" (UID: "7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:40:03.123440 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:03.123393 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:03.123635 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:03.123536 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:04.124736 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:04.124698 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:04.125180 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:04.124828 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:05.123780 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:05.123741 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:05.123964 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:05.123881 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:06.128276 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:06.128225 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:06.128756 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:06.128388 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:07.124097 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:07.124062 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:07.124263 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:07.124192 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:08.123263 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:08.123228 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:08.123711 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:08.123357 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:09.123543 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:09.123367 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:09.123929 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:09.123620 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:10.123486 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:10.123452 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:10.123639 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:10.123588 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:10.739054 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:10.739018 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:10.739248 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:10.739174 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:40:10.739310 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:10.739261 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs podName:96f66b77-910c-4cdd-9633-18f1ff5c3cfd nodeName:}" failed. No retries permitted until 2026-06-02 21:40:26.739238436 +0000 UTC m=+33.180686446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs") pod "network-metrics-daemon-s78vq" (UID: "96f66b77-910c-4cdd-9633-18f1ff5c3cfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:40:10.840192 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:10.840157 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:10.840392 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:10.840304 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:40:10.840392 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:10.840336 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:40:10.840392 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:10.840350 2567 projected.go:194] Error preparing data for projected volume kube-api-access-vvk52 for pod openshift-network-diagnostics/network-check-target-q2f2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:40:10.840523 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:10.840406 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52 podName:7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98 nodeName:}" failed. No retries permitted until 2026-06-02 21:40:26.840388958 +0000 UTC m=+33.281836971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvk52" (UniqueName: "kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52") pod "network-check-target-q2f2h" (UID: "7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:40:11.123746 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:11.123704 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:11.124237 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:11.123848 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:12.124259 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:12.124224 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:12.124756 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:12.124375 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:13.123339 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:13.123294 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:13.123492 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:13.123410 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:14.124772 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:14.124739 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:14.125204 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:14.124834 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:15.123889 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.123868 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:15.123980 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:15.123949 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:15.365145 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.364261 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" event={"ID":"3ff651cf-e11e-4f8c-9a86-66d96a79b91a","Type":"ContainerStarted","Data":"703e6fe2974260a513b3f34e812b02f402234b68fae7dbe22c174b4a8035b7a7"} Jun 02 21:40:15.370963 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.370932 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" event={"ID":"747723c7-1eef-4a2c-a61a-1b1c5cde181b","Type":"ContainerStarted","Data":"222cadcbd6b4f592667297f402fa7d2b0c723ccfd98998931d2231e25b628c9a"} Jun 02 21:40:15.372979 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.372936 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" event={"ID":"5d5b0ffb4b9babff687ba04be52a82fe","Type":"ContainerStarted","Data":"4b328ce2329eae05b53942d65e07dcfaa50992a5606dbe0b536a992579a245bb"} Jun 02 21:40:15.374802 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.373104 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" Jun 02 21:40:15.387652 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.387521 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rph7j" event={"ID":"9b117b21-c414-4951-ac1f-455c61450457","Type":"ContainerStarted","Data":"368ed54c244018122720d3aa26fb74b23f5d3559a771d336526373a014683a64"} Jun 02 21:40:15.393066 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.392885 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 21:40:15.394579 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.393561 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal"] Jun 02 21:40:15.396029 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.395841 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vs8xb" podStartSLOduration=1.6531190329999998 podStartE2EDuration="21.395825387s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:39:55.368529058 +0000 UTC m=+1.809977056" lastFinishedPulling="2026-06-02 21:40:15.111235401 +0000 UTC m=+21.552683410" observedRunningTime="2026-06-02 21:40:15.394790353 +0000 UTC m=+21.836238387" watchObservedRunningTime="2026-06-02 21:40:15.395825387 +0000 UTC m=+21.837273409" Jun 02 21:40:15.420765 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.420028 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-204.ec2.internal" podStartSLOduration=0.420010372 podStartE2EDuration="420.010372ms" podCreationTimestamp="2026-06-02 21:40:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:40:15.419637339 +0000 UTC m=+21.861085358" watchObservedRunningTime="2026-06-02 21:40:15.420010372 +0000 UTC m=+21.861458393" Jun 02 21:40:15.474613 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:15.474571 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-rph7j" podStartSLOduration=1.747212 podStartE2EDuration="21.474555055s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:39:55.391232357 +0000 UTC m=+1.832680354" lastFinishedPulling="2026-06-02 21:40:15.118575412 +0000 UTC m=+21.560023409" observedRunningTime="2026-06-02 21:40:15.474510034 +0000 UTC m=+21.915958094" watchObservedRunningTime="2026-06-02 21:40:15.474555055 +0000 UTC m=+21.916003074" Jun 02 21:40:16.123880 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.123721 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:16.124020 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:16.123962 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:16.390347 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.390301 2567 generic.go:358] "Generic (PLEG): container finished" podID="b3565e658620396a87d3c9f90705a49e" containerID="91a4147e7fee772ea6f4c7d55e191b150297b9b050fbcf83a08f1820e8e376b2" exitCode=0 Jun 02 21:40:16.391047 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.390367 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" event={"ID":"b3565e658620396a87d3c9f90705a49e","Type":"ContainerDied","Data":"91a4147e7fee772ea6f4c7d55e191b150297b9b050fbcf83a08f1820e8e376b2"} Jun 02 21:40:16.392295 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.392270 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tzl74" event={"ID":"299bad1e-5232-47ee-9cca-55a62fe3ff76","Type":"ContainerStarted","Data":"e2513d12ff0d6d35d8d0a31fbefc80f8f1667023076e62540bec64c38d31e131"} Jun 02 21:40:16.393646 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.393623 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7vwsn" event={"ID":"06cf6962-db9f-4f50-95c4-af6decb2627e","Type":"ContainerStarted","Data":"e02aba5c415291d5bde845e681dde87b27d485329966c7f8cd7e5c568593fa47"} Jun 02 21:40:16.394967 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.394933 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6w7x" event={"ID":"2347edd3-4cda-4b9f-bc0a-bd85c68d58ba","Type":"ContainerStarted","Data":"e50cdbde8cfcc73d1d8b71c50db78e203d2d5e3c01f4bf3bbd73b0ed8e149731"} Jun 02 21:40:16.397857 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.397837 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" event={"ID":"747723c7-1eef-4a2c-a61a-1b1c5cde181b","Type":"ContainerStarted","Data":"430fecd73ba3411d80410f5078d0b9d9532178f25abc53639c7ff187ac12658f"} Jun 02 21:40:16.397955 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.397864 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" event={"ID":"747723c7-1eef-4a2c-a61a-1b1c5cde181b","Type":"ContainerStarted","Data":"3a7d29ee011f766f0dd9663f1bae2c2edd0b4e0ffefdf06838a1695ef588697e"} Jun 02 21:40:16.397955 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.397881 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" event={"ID":"747723c7-1eef-4a2c-a61a-1b1c5cde181b","Type":"ContainerStarted","Data":"58126952b463d1d742ab12640f2b7445cbc041b520b7205f934e58b831acb633"} Jun 02 21:40:16.397955 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.397894 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" event={"ID":"747723c7-1eef-4a2c-a61a-1b1c5cde181b","Type":"ContainerStarted","Data":"fa5845ee70da7b531e37b0b0c3982cdeea418f5098b94ddda7604e5ed7f6ead8"} Jun 02 21:40:16.397955 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.397908 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" event={"ID":"747723c7-1eef-4a2c-a61a-1b1c5cde181b","Type":"ContainerStarted","Data":"2b2f9552805a870f880e2815ef9a2ddd3f976165cd08b4ba37aecfa18be1fe20"} Jun 02 21:40:16.399194 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.399155 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhshf" event={"ID":"e1902331-28a2-41c2-8800-3e31f1d6579e","Type":"ContainerStarted","Data":"92c26a5995bba79b71d85ca057b88032bc851bbf94f2a4ecc3faf4fac16c183a"} Jun 02 21:40:16.400643 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.400623 2567 generic.go:358] "Generic (PLEG): container finished" podID="61c49ca3-a281-4b56-8982-de471443988b" containerID="9af463f399144fde6c8eacb537c8e23c881735f086e3ad6a7bfac6abe8e09f10" exitCode=0 Jun 02 21:40:16.400745 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.400683 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" event={"ID":"61c49ca3-a281-4b56-8982-de471443988b","Type":"ContainerDied","Data":"9af463f399144fde6c8eacb537c8e23c881735f086e3ad6a7bfac6abe8e09f10"} Jun 02 21:40:16.402045 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.402025 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" event={"ID":"fa7d0862-db95-481e-b5b7-686a535f0fdf","Type":"ContainerStarted","Data":"dd46faff393ad761716d39914cc23fd46aed53d55f0fb5576e1d07f71dc18b34"} Jun 02 21:40:16.461727 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.461675 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vhshf" podStartSLOduration=2.72637278 podStartE2EDuration="22.461663s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:39:55.329503809 +0000 UTC m=+1.770951805" lastFinishedPulling="2026-06-02 21:40:15.064794027 +0000 UTC m=+21.506242025" observedRunningTime="2026-06-02 21:40:16.445177618 +0000 UTC m=+22.886625636" watchObservedRunningTime="2026-06-02 21:40:16.461663 +0000 UTC m=+22.903111018" Jun 02 21:40:16.483863 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.483826 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7vwsn" podStartSLOduration=7.567777393 podStartE2EDuration="22.483810979s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:39:55.380144099 +0000 UTC m=+1.821592096" lastFinishedPulling="2026-06-02 21:40:10.296177685 +0000 UTC m=+16.737625682" observedRunningTime="2026-06-02 21:40:16.461503601 +0000 UTC m=+22.902951621" watchObservedRunningTime="2026-06-02 21:40:16.483810979 +0000 UTC m=+22.925259021" Jun 02 21:40:16.504852 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.504818 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-p6w7x" podStartSLOduration=2.769172593 podStartE2EDuration="22.504805493s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:39:55.374106621 +0000 UTC m=+1.815554620" lastFinishedPulling="2026-06-02 21:40:15.109739509 +0000 UTC m=+21.551187520" observedRunningTime="2026-06-02 21:40:16.504572837 +0000 UTC m=+22.946020857" watchObservedRunningTime="2026-06-02 21:40:16.504805493 +0000 UTC m=+22.946253512" Jun 02 21:40:16.505079 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.505054 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tzl74" podStartSLOduration=2.8798542400000002 podStartE2EDuration="22.505047599s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:39:55.397194192 +0000 UTC m=+1.838642192" lastFinishedPulling="2026-06-02 21:40:15.02238754 +0000 UTC m=+21.463835551" observedRunningTime="2026-06-02 21:40:16.483394139 +0000 UTC m=+22.924842149" watchObservedRunningTime="2026-06-02 21:40:16.505047599 +0000 UTC m=+22.946495618" Jun 02 21:40:16.685618 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:16.685593 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 21:40:17.072892 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:17.072787 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T21:40:16.685613703Z","UUID":"31d2ba93-e1ab-4849-98a4-422eda762214","Handler":null,"Name":"","Endpoint":""} Jun 02 21:40:17.074960 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:17.074882 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 21:40:17.074960 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:17.074951 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 21:40:17.123915 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:17.123890 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:17.124048 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:17.123994 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:17.405560 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:17.405487 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" event={"ID":"fa7d0862-db95-481e-b5b7-686a535f0fdf","Type":"ContainerStarted","Data":"52f9fa5a1431b30f4874ac04efb54e0e8fb45297fec65892e1516617193c2f84"} Jun 02 21:40:17.407195 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:17.407154 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" event={"ID":"b3565e658620396a87d3c9f90705a49e","Type":"ContainerStarted","Data":"2eabb4a52b97f084c321cb6882400ae9c1c5c081155de0eb0cf65e74eee8606f"} Jun 02 21:40:17.426276 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:17.426233 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-204.ec2.internal" podStartSLOduration=23.426220138 podStartE2EDuration="23.426220138s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:40:17.426038996 +0000 UTC m=+23.867487016" watchObservedRunningTime="2026-06-02 21:40:17.426220138 +0000 UTC m=+23.867668156" Jun 02 21:40:18.124025 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:18.124006 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:18.124145 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:18.124125 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:18.411715 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:18.411680 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" event={"ID":"747723c7-1eef-4a2c-a61a-1b1c5cde181b","Type":"ContainerStarted","Data":"98a58998508fa9965d579a8e017d9a9f9f2bf60d7f38b01fdc924ed940d977f5"} Jun 02 21:40:18.414244 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:18.414220 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" event={"ID":"fa7d0862-db95-481e-b5b7-686a535f0fdf","Type":"ContainerStarted","Data":"ceb442c9c37bdfd696d1fa35312afbd1cbcd23b0464e9ab6685c3dde0525c8f8"} Jun 02 21:40:18.438145 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:18.438104 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtmp9" podStartSLOduration=1.563044428 podStartE2EDuration="24.43808715s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:39:55.366125245 +0000 UTC m=+1.807573243" lastFinishedPulling="2026-06-02 21:40:18.241167953 +0000 UTC m=+24.682615965" observedRunningTime="2026-06-02 21:40:18.437692088 +0000 UTC m=+24.879140118" watchObservedRunningTime="2026-06-02 21:40:18.43808715 +0000 UTC m=+24.879535197" Jun 02 21:40:19.124055 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:19.124029 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:19.124234 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:19.124130 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:19.771365 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:19.771318 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:40:19.772010 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:19.771992 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:40:20.123440 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:20.123414 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:20.123607 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:20.123521 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:20.422132 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:20.421624 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" event={"ID":"747723c7-1eef-4a2c-a61a-1b1c5cde181b","Type":"ContainerStarted","Data":"2944729a869cef4b344c7ae9da5d908fa75f399704254fb8f1ebc4bd3b97623e"} Jun 02 21:40:20.422752 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:20.422709 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:40:20.422896 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:20.422760 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:40:20.422896 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:20.422811 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:40:20.423621 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:20.423588 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vhshf" Jun 02 21:40:20.440443 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:20.440424 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:40:20.458083 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:20.458043 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" podStartSLOduration=6.548276895 podStartE2EDuration="26.458031999s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:39:55.360429211 +0000 UTC m=+1.801877209" lastFinishedPulling="2026-06-02 21:40:15.270184313 +0000 UTC m=+21.711632313" observedRunningTime="2026-06-02 21:40:20.457527424 +0000 UTC m=+26.898975443" watchObservedRunningTime="2026-06-02 21:40:20.458031999 +0000 UTC m=+26.899480018" Jun 02 21:40:21.123452 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:21.123418 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:21.124426 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:21.123531 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:21.424187 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:21.424115 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:40:21.449247 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:21.449133 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:40:22.123940 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:22.123909 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:22.124268 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:22.124042 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:22.426733 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:22.426448 2567 generic.go:358] "Generic (PLEG): container finished" podID="61c49ca3-a281-4b56-8982-de471443988b" containerID="f79219359a3eaad7b887adead57b045c3df8a7054297d8add2695f97d66e658d" exitCode=0 Jun 02 21:40:22.426733 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:22.426486 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" event={"ID":"61c49ca3-a281-4b56-8982-de471443988b","Type":"ContainerDied","Data":"f79219359a3eaad7b887adead57b045c3df8a7054297d8add2695f97d66e658d"} Jun 02 21:40:22.428358 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:22.428339 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q2f2h"] Jun 02 21:40:22.428458 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:22.428422 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:22.428523 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:22.428494 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:22.432186 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:22.432162 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s78vq"] Jun 02 21:40:22.432282 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:22.432269 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:22.432419 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:22.432400 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:24.124605 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:24.124573 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:24.124974 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:24.124669 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:24.124974 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:24.124689 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:24.124974 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:24.124753 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:24.431518 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:24.431448 2567 generic.go:358] "Generic (PLEG): container finished" podID="61c49ca3-a281-4b56-8982-de471443988b" containerID="7977e373ca7a53e1c833bf7b013810e0d16b31cbeb1ec0bf8ac8d0ad0674f3e1" exitCode=0 Jun 02 21:40:24.431518 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:24.431503 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" event={"ID":"61c49ca3-a281-4b56-8982-de471443988b","Type":"ContainerDied","Data":"7977e373ca7a53e1c833bf7b013810e0d16b31cbeb1ec0bf8ac8d0ad0674f3e1"} Jun 02 21:40:26.123593 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:26.123557 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:26.124061 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:26.123603 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:26.124061 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:26.123718 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:26.124061 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:26.123793 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:26.437706 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:26.437624 2567 generic.go:358] "Generic (PLEG): container finished" podID="61c49ca3-a281-4b56-8982-de471443988b" containerID="ba6e0d5cf66016f4c182d78a2045ff4a6de4f0bd174d4fcdf6daa42d16d2fd60" exitCode=0 Jun 02 21:40:26.437706 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:26.437669 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" event={"ID":"61c49ca3-a281-4b56-8982-de471443988b","Type":"ContainerDied","Data":"ba6e0d5cf66016f4c182d78a2045ff4a6de4f0bd174d4fcdf6daa42d16d2fd60"} Jun 02 21:40:26.770234 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:26.770059 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:26.770381 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:26.770213 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:40:26.770381 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:26.770297 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs podName:96f66b77-910c-4cdd-9633-18f1ff5c3cfd nodeName:}" failed. No retries permitted until 2026-06-02 21:40:58.770282156 +0000 UTC m=+65.211730153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs") pod "network-metrics-daemon-s78vq" (UID: "96f66b77-910c-4cdd-9633-18f1ff5c3cfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:40:26.871131 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:26.871096 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:26.871290 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:26.871275 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:40:26.871377 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:26.871296 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:40:26.871377 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:26.871309 2567 projected.go:194] Error preparing data for projected volume kube-api-access-vvk52 for pod openshift-network-diagnostics/network-check-target-q2f2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:40:26.871485 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:26.871379 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52 podName:7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98 nodeName:}" failed. No retries permitted until 2026-06-02 21:40:58.871359827 +0000 UTC m=+65.312807842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvk52" (UniqueName: "kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52") pod "network-check-target-q2f2h" (UID: "7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:40:28.123676 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:28.123642 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:28.124084 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:28.123783 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s78vq" podUID="96f66b77-910c-4cdd-9633-18f1ff5c3cfd" Jun 02 21:40:28.124084 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:28.123845 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:28.124084 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:28.123951 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2f2h" podUID="7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98" Jun 02 21:40:28.856732 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:28.856708 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-204.ec2.internal" event="NodeReady" Jun 02 21:40:28.856872 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:28.856810 2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 21:40:30.123493 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:30.123456 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:30.123982 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:30.123502 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:30.128122 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:30.128094 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 21:40:30.128257 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:30.128147 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 21:40:30.128257 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:30.128151 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8znwf\"" Jun 02 21:40:30.128257 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:30.128163 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 21:40:30.128257 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:30.128155 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qhklz\"" Jun 02 21:40:33.453755 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:33.453729 2567 generic.go:358] "Generic (PLEG): container finished" podID="61c49ca3-a281-4b56-8982-de471443988b" containerID="bd48c8cdce31ea137687358732942a1ed0797c7336de7c10485005e2031e2db0" exitCode=0 Jun 02 21:40:33.454250 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:33.453773 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" event={"ID":"61c49ca3-a281-4b56-8982-de471443988b","Type":"ContainerDied","Data":"bd48c8cdce31ea137687358732942a1ed0797c7336de7c10485005e2031e2db0"} Jun 02 21:40:34.458135 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:34.458105 2567 generic.go:358] "Generic (PLEG): container finished" podID="61c49ca3-a281-4b56-8982-de471443988b" containerID="8683ed9642a1e2e555124e05b24ea890e097b67b2e150b4aeaa39fd6c56ab7e1" exitCode=0 Jun 02 21:40:34.458470 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:34.458158 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" event={"ID":"61c49ca3-a281-4b56-8982-de471443988b","Type":"ContainerDied","Data":"8683ed9642a1e2e555124e05b24ea890e097b67b2e150b4aeaa39fd6c56ab7e1"} Jun 02 21:40:35.463413 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:35.463372 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" event={"ID":"61c49ca3-a281-4b56-8982-de471443988b","Type":"ContainerStarted","Data":"16cbac84bd413b68168fda8271f31cefed12a8cde6633340e5a3b98fdf8e94a1"} Jun 02 21:40:35.487412 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:35.487317 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fsmb4" podStartSLOduration=4.480704213 podStartE2EDuration="41.487299649s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:39:55.385822024 +0000 UTC m=+1.827270021" lastFinishedPulling="2026-06-02 21:40:32.392417457 +0000 UTC m=+38.833865457" observedRunningTime="2026-06-02 21:40:35.485887837 +0000 UTC m=+41.927335854" watchObservedRunningTime="2026-06-02 21:40:35.487299649 +0000 UTC m=+41.928747670" Jun 02 21:40:49.190024 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.189991 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hbkmf"] Jun 02 21:40:49.193263 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.193246 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lqq5k"] Jun 02 21:40:49.193435 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.193415 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.194724 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.194706 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lqq5k" Jun 02 21:40:49.199077 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.199048 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 21:40:49.199077 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.199073 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 21:40:49.199756 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.199531 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 21:40:49.200159 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.200140 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 21:40:49.200239 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.200230 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2vddp\"" Jun 02 21:40:49.200614 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.200600 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 21:40:49.200660 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.200635 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vfhfl\"" Jun 02 21:40:49.211898 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.211875 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hbkmf"] Jun 02 21:40:49.217630 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.217599 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lqq5k"] Jun 02 21:40:49.326849 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.326825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81acd0af-4b5e-463a-937e-1cc4f2a72bff-tmp-dir\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.326939 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.326854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrtf9\" (UniqueName: \"kubernetes.io/projected/81acd0af-4b5e-463a-937e-1cc4f2a72bff-kube-api-access-rrtf9\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.326939 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.326871 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81acd0af-4b5e-463a-937e-1cc4f2a72bff-metrics-tls\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.326939 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.326888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpfzp\" (UniqueName: \"kubernetes.io/projected/bee16cd1-dfcd-4a65-b816-a9645607b3cf-kube-api-access-tpfzp\") pod \"ingress-canary-lqq5k\" (UID: \"bee16cd1-dfcd-4a65-b816-a9645607b3cf\") " pod="openshift-ingress-canary/ingress-canary-lqq5k" Jun 02 21:40:49.326939 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.326906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bee16cd1-dfcd-4a65-b816-a9645607b3cf-cert\") pod \"ingress-canary-lqq5k\" (UID: \"bee16cd1-dfcd-4a65-b816-a9645607b3cf\") " pod="openshift-ingress-canary/ingress-canary-lqq5k" Jun 02 21:40:49.327094 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.326978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81acd0af-4b5e-463a-937e-1cc4f2a72bff-config-volume\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.427612 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.427589 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bee16cd1-dfcd-4a65-b816-a9645607b3cf-cert\") pod \"ingress-canary-lqq5k\" (UID: \"bee16cd1-dfcd-4a65-b816-a9645607b3cf\") " pod="openshift-ingress-canary/ingress-canary-lqq5k" Jun 02 21:40:49.427706 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.427628 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81acd0af-4b5e-463a-937e-1cc4f2a72bff-config-volume\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.427706 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.427669 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81acd0af-4b5e-463a-937e-1cc4f2a72bff-tmp-dir\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.427844 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.427825 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrtf9\" (UniqueName: \"kubernetes.io/projected/81acd0af-4b5e-463a-937e-1cc4f2a72bff-kube-api-access-rrtf9\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.427906 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.427857 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81acd0af-4b5e-463a-937e-1cc4f2a72bff-metrics-tls\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.427906 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.427883 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpfzp\" (UniqueName: \"kubernetes.io/projected/bee16cd1-dfcd-4a65-b816-a9645607b3cf-kube-api-access-tpfzp\") pod \"ingress-canary-lqq5k\" (UID: \"bee16cd1-dfcd-4a65-b816-a9645607b3cf\") " pod="openshift-ingress-canary/ingress-canary-lqq5k" Jun 02 21:40:49.427989 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.427948 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81acd0af-4b5e-463a-937e-1cc4f2a72bff-tmp-dir\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.428136 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.428115 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81acd0af-4b5e-463a-937e-1cc4f2a72bff-config-volume\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.431522 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.431504 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81acd0af-4b5e-463a-937e-1cc4f2a72bff-metrics-tls\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.431634 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.431622 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bee16cd1-dfcd-4a65-b816-a9645607b3cf-cert\") pod \"ingress-canary-lqq5k\" (UID: \"bee16cd1-dfcd-4a65-b816-a9645607b3cf\") " pod="openshift-ingress-canary/ingress-canary-lqq5k" Jun 02 21:40:49.438893 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.438872 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrtf9\" (UniqueName: \"kubernetes.io/projected/81acd0af-4b5e-463a-937e-1cc4f2a72bff-kube-api-access-rrtf9\") pod \"dns-default-hbkmf\" (UID: \"81acd0af-4b5e-463a-937e-1cc4f2a72bff\") " pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.439132 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.439115 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpfzp\" (UniqueName: \"kubernetes.io/projected/bee16cd1-dfcd-4a65-b816-a9645607b3cf-kube-api-access-tpfzp\") pod \"ingress-canary-lqq5k\" (UID: \"bee16cd1-dfcd-4a65-b816-a9645607b3cf\") " pod="openshift-ingress-canary/ingress-canary-lqq5k" Jun 02 21:40:49.502692 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.502648 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:49.507179 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.507159 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lqq5k" Jun 02 21:40:49.657740 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.657711 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lqq5k"] Jun 02 21:40:49.661496 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:40:49.661467 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee16cd1_dfcd_4a65_b816_a9645607b3cf.slice/crio-dc3a31aa10b3b17e1646b82da2ff98d6d64cee1bfb2de1c76bc1c3198cec07cf WatchSource:0}: Error finding container dc3a31aa10b3b17e1646b82da2ff98d6d64cee1bfb2de1c76bc1c3198cec07cf: Status 404 returned error can't find the container with id dc3a31aa10b3b17e1646b82da2ff98d6d64cee1bfb2de1c76bc1c3198cec07cf Jun 02 21:40:49.671501 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:49.671481 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hbkmf"] Jun 02 21:40:49.674966 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:40:49.674944 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81acd0af_4b5e_463a_937e_1cc4f2a72bff.slice/crio-5b7bb1bae76562aec17571fa4595681ee04be86f584c0213ee3877845fd918a3 WatchSource:0}: Error finding container 5b7bb1bae76562aec17571fa4595681ee04be86f584c0213ee3877845fd918a3: Status 404 returned error can't find the container with id 5b7bb1bae76562aec17571fa4595681ee04be86f584c0213ee3877845fd918a3 Jun 02 21:40:50.177069 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.177039 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-645bf876d7-5pbgq"] Jun 02 21:40:50.178938 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.178918 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.183027 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.183005 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6kkkj\"" Jun 02 21:40:50.183119 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.183038 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 21:40:50.183119 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.183062 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 21:40:50.183382 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.183358 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 21:40:50.183489 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.183383 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 21:40:50.183489 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.183390 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 21:40:50.183489 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.183436 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 21:40:50.183677 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.183657 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 21:40:50.194009 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.193985 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645bf876d7-5pbgq"] Jun 02 21:40:50.335394 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.335282 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrdhs\" (UniqueName: \"kubernetes.io/projected/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-kube-api-access-qrdhs\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.335394 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.335346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-oauth-serving-cert\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.335577 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.335460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-serving-cert\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.335577 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.335506 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-oauth-config\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.335577 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.335535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-config\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.335577 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.335557 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-service-ca\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.437958 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.437895 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-serving-cert\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.437958 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.437946 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-oauth-config\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.438107 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.437970 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-config\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.438107 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.437994 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-service-ca\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.438107 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.438033 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrdhs\" (UniqueName: \"kubernetes.io/projected/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-kube-api-access-qrdhs\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.438107 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.438057 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-oauth-serving-cert\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.439139 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.438832 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-oauth-serving-cert\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.439139 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.438879 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-config\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.439362 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.439226 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-service-ca\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.443126 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.443105 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-serving-cert\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.443301 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.443131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-oauth-config\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.448160 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.448140 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrdhs\" (UniqueName: \"kubernetes.io/projected/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-kube-api-access-qrdhs\") pod \"console-645bf876d7-5pbgq\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.490798 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.490773 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:40:50.492598 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.492564 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hbkmf" event={"ID":"81acd0af-4b5e-463a-937e-1cc4f2a72bff","Type":"ContainerStarted","Data":"5b7bb1bae76562aec17571fa4595681ee04be86f584c0213ee3877845fd918a3"} Jun 02 21:40:50.493668 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.493633 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lqq5k" event={"ID":"bee16cd1-dfcd-4a65-b816-a9645607b3cf","Type":"ContainerStarted","Data":"dc3a31aa10b3b17e1646b82da2ff98d6d64cee1bfb2de1c76bc1c3198cec07cf"} Jun 02 21:40:50.641452 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:50.641416 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645bf876d7-5pbgq"] Jun 02 21:40:50.645264 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:40:50.645227 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a38fb14_2f9c_4fda_a273_aebd17dde3ec.slice/crio-df5437121fe5f727f004883ae10e0686d00e4b29bdd4a8fe90f59e8b08df5452 WatchSource:0}: Error finding container df5437121fe5f727f004883ae10e0686d00e4b29bdd4a8fe90f59e8b08df5452: Status 404 returned error can't find the container with id df5437121fe5f727f004883ae10e0686d00e4b29bdd4a8fe90f59e8b08df5452 Jun 02 21:40:51.496933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:51.496900 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645bf876d7-5pbgq" event={"ID":"0a38fb14-2f9c-4fda-a273-aebd17dde3ec","Type":"ContainerStarted","Data":"df5437121fe5f727f004883ae10e0686d00e4b29bdd4a8fe90f59e8b08df5452"} Jun 02 21:40:51.984732 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:51.984693 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbf9ccb9f-chcpz"] Jun 02 21:40:51.986625 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:51.986601 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.001897 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.001877 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 21:40:52.005301 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.005281 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbf9ccb9f-chcpz"] Jun 02 21:40:52.048354 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.048305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-oauth-config\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.048465 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.048368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-trusted-ca-bundle\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.048465 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.048396 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-console-config\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.048465 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.048429 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cblx\" (UniqueName: \"kubernetes.io/projected/f26efc07-2edf-44e8-a735-2773fac91ae0-kube-api-access-2cblx\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.048465 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.048447 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-serving-cert\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.048636 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.048472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-service-ca\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.048636 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.048531 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-oauth-serving-cert\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.149695 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.149667 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-oauth-serving-cert\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.149814 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.149719 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-oauth-config\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.149814 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.149744 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-trusted-ca-bundle\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.149814 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.149768 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-console-config\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.150267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.150221 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cblx\" (UniqueName: \"kubernetes.io/projected/f26efc07-2edf-44e8-a735-2773fac91ae0-kube-api-access-2cblx\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.150392 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.150281 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-serving-cert\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.150392 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.150317 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-service-ca\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.150520 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.150410 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-console-config\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.150520 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.150419 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-oauth-serving-cert\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.150720 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.150640 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-trusted-ca-bundle\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.151042 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.150949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-service-ca\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.152876 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.152854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-oauth-config\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.153060 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.153042 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-serving-cert\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.161405 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.161388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cblx\" (UniqueName: \"kubernetes.io/projected/f26efc07-2edf-44e8-a735-2773fac91ae0-kube-api-access-2cblx\") pod \"console-5cbf9ccb9f-chcpz\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.296757 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.296511 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:40:52.452260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.452179 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbf9ccb9f-chcpz"] Jun 02 21:40:52.454896 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:40:52.454866 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26efc07_2edf_44e8_a735_2773fac91ae0.slice/crio-a8e0a26a332ac2b709cab672287943b97268867a9889f69f6c1891a292750bcd WatchSource:0}: Error finding container a8e0a26a332ac2b709cab672287943b97268867a9889f69f6c1891a292750bcd: Status 404 returned error can't find the container with id a8e0a26a332ac2b709cab672287943b97268867a9889f69f6c1891a292750bcd Jun 02 21:40:52.500195 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.500157 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hbkmf" event={"ID":"81acd0af-4b5e-463a-937e-1cc4f2a72bff","Type":"ContainerStarted","Data":"fd4205c47f5f72549a3d44a034e821a346363b7718b9cc824318a9724843bbe3"} Jun 02 21:40:52.500557 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.500202 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hbkmf" event={"ID":"81acd0af-4b5e-463a-937e-1cc4f2a72bff","Type":"ContainerStarted","Data":"2b4d32a2262a919c803e78cabc19f55e9f8d6ed95d487373ac7a1d92f55f5a96"} Jun 02 21:40:52.500557 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.500279 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hbkmf" Jun 02 21:40:52.501934 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.501904 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lqq5k" event={"ID":"bee16cd1-dfcd-4a65-b816-a9645607b3cf","Type":"ContainerStarted","Data":"729c804d86721801254a7964788a5933b41887d61f3cb88663153eb32eb9f0c9"} Jun 02 21:40:52.502998 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.502980 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf9ccb9f-chcpz" event={"ID":"f26efc07-2edf-44e8-a735-2773fac91ae0","Type":"ContainerStarted","Data":"a8e0a26a332ac2b709cab672287943b97268867a9889f69f6c1891a292750bcd"} Jun 02 21:40:52.523297 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.523252 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hbkmf" podStartSLOduration=1.688697434 podStartE2EDuration="3.523219732s" podCreationTimestamp="2026-06-02 21:40:49 +0000 UTC" firstStartedPulling="2026-06-02 21:40:49.676747745 +0000 UTC m=+56.118195741" lastFinishedPulling="2026-06-02 21:40:51.511270028 +0000 UTC m=+57.952718039" observedRunningTime="2026-06-02 21:40:52.522921093 +0000 UTC m=+58.964369111" watchObservedRunningTime="2026-06-02 21:40:52.523219732 +0000 UTC m=+58.964667750" Jun 02 21:40:52.543384 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:52.543348 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lqq5k" podStartSLOduration=1.690850813 podStartE2EDuration="3.543318588s" podCreationTimestamp="2026-06-02 21:40:49 +0000 UTC" firstStartedPulling="2026-06-02 21:40:49.663224152 +0000 UTC m=+56.104672148" lastFinishedPulling="2026-06-02 21:40:51.515691924 +0000 UTC m=+57.957139923" observedRunningTime="2026-06-02 21:40:52.542520748 +0000 UTC m=+58.983968766" watchObservedRunningTime="2026-06-02 21:40:52.543318588 +0000 UTC m=+58.984766606" Jun 02 21:40:53.445088 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:53.445060 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qccxd" Jun 02 21:40:54.507767 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:54.507691 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf9ccb9f-chcpz" event={"ID":"f26efc07-2edf-44e8-a735-2773fac91ae0","Type":"ContainerStarted","Data":"073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85"} Jun 02 21:40:54.509052 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:54.509029 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645bf876d7-5pbgq" event={"ID":"0a38fb14-2f9c-4fda-a273-aebd17dde3ec","Type":"ContainerStarted","Data":"76210e4b75e4586d812ee9a51a9778e88d960a03c97355c845d2f30f3c7bf96f"} Jun 02 21:40:54.530566 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:54.530530 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5cbf9ccb9f-chcpz" podStartSLOduration=1.727453858 podStartE2EDuration="3.530518747s" podCreationTimestamp="2026-06-02 21:40:51 +0000 UTC" firstStartedPulling="2026-06-02 21:40:52.457291362 +0000 UTC m=+58.898739358" lastFinishedPulling="2026-06-02 21:40:54.260356251 +0000 UTC m=+60.701804247" observedRunningTime="2026-06-02 21:40:54.529807887 +0000 UTC m=+60.971255928" watchObservedRunningTime="2026-06-02 21:40:54.530518747 +0000 UTC m=+60.971966764" Jun 02 21:40:54.552041 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:54.551981 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-645bf876d7-5pbgq" podStartSLOduration=0.939988366 podStartE2EDuration="4.551968941s" podCreationTimestamp="2026-06-02 21:40:50 +0000 UTC" firstStartedPulling="2026-06-02 21:40:50.647742107 +0000 UTC m=+57.089190108" lastFinishedPulling="2026-06-02 21:40:54.259722683 +0000 UTC m=+60.701170683" observedRunningTime="2026-06-02 21:40:54.551790095 +0000 UTC m=+60.993238114" watchObservedRunningTime="2026-06-02 21:40:54.551968941 +0000 UTC m=+60.993416960" Jun 02 21:40:55.061859 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.061789 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6"] Jun 02 21:40:55.069849 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.069814 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" Jun 02 21:40:55.072590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.072563 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 21:40:55.072753 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.072598 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mpbm7\"" Jun 02 21:40:55.076836 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.076803 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6"] Jun 02 21:40:55.173189 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.173154 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d99c892a-a57b-4e66-bf8c-6cb5e48a0e63-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-q6qb6\" (UID: \"d99c892a-a57b-4e66-bf8c-6cb5e48a0e63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" Jun 02 21:40:55.274170 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.274128 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d99c892a-a57b-4e66-bf8c-6cb5e48a0e63-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-q6qb6\" (UID: \"d99c892a-a57b-4e66-bf8c-6cb5e48a0e63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" Jun 02 21:40:55.274319 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:55.274283 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 21:40:55.274410 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:55.274394 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d99c892a-a57b-4e66-bf8c-6cb5e48a0e63-tls-certificates podName:d99c892a-a57b-4e66-bf8c-6cb5e48a0e63 nodeName:}" failed. No retries permitted until 2026-06-02 21:40:55.77437523 +0000 UTC m=+62.215823241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d99c892a-a57b-4e66-bf8c-6cb5e48a0e63-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-q6qb6" (UID: "d99c892a-a57b-4e66-bf8c-6cb5e48a0e63") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 21:40:55.777708 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.777681 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d99c892a-a57b-4e66-bf8c-6cb5e48a0e63-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-q6qb6\" (UID: \"d99c892a-a57b-4e66-bf8c-6cb5e48a0e63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" Jun 02 21:40:55.780022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.780003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d99c892a-a57b-4e66-bf8c-6cb5e48a0e63-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-q6qb6\" (UID: \"d99c892a-a57b-4e66-bf8c-6cb5e48a0e63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" Jun 02 21:40:55.979338 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:55.979296 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" Jun 02 21:40:56.100993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:56.100963 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6"] Jun 02 21:40:56.103807 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:40:56.103781 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99c892a_a57b_4e66_bf8c_6cb5e48a0e63.slice/crio-b9967b323d572ca4c1a7b43af72585cf6fabf5dbac0576821bf7ee48d7f78a36 WatchSource:0}: Error finding container b9967b323d572ca4c1a7b43af72585cf6fabf5dbac0576821bf7ee48d7f78a36: Status 404 returned error can't find the container with id b9967b323d572ca4c1a7b43af72585cf6fabf5dbac0576821bf7ee48d7f78a36 Jun 02 21:40:56.514213 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:56.514184 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" event={"ID":"d99c892a-a57b-4e66-bf8c-6cb5e48a0e63","Type":"ContainerStarted","Data":"b9967b323d572ca4c1a7b43af72585cf6fabf5dbac0576821bf7ee48d7f78a36"} Jun 02 21:40:57.518334 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:57.518300 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" event={"ID":"d99c892a-a57b-4e66-bf8c-6cb5e48a0e63","Type":"ContainerStarted","Data":"86b5ad48032df8b3014c10e6a3a99d1937fac4bd157125418d6e880ca1953a0f"} Jun 02 21:40:57.518661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:57.518525 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" Jun 02 21:40:57.522686 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:57.522667 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" Jun 02 21:40:57.541234 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:57.541197 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-q6qb6" podStartSLOduration=1.587849442 podStartE2EDuration="2.541185657s" podCreationTimestamp="2026-06-02 21:40:55 +0000 UTC" firstStartedPulling="2026-06-02 21:40:56.105757027 +0000 UTC m=+62.547205027" lastFinishedPulling="2026-06-02 21:40:57.059093233 +0000 UTC m=+63.500541242" observedRunningTime="2026-06-02 21:40:57.540901545 +0000 UTC m=+63.982349563" watchObservedRunningTime="2026-06-02 21:40:57.541185657 +0000 UTC m=+63.982633717" Jun 02 21:40:57.847027 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:57.847001 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cbf9ccb9f-chcpz_f26efc07-2edf-44e8-a735-2773fac91ae0/console/0.log" Jun 02 21:40:58.026937 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.026914 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-645bf876d7-5pbgq_0a38fb14-2f9c-4fda-a273-aebd17dde3ec/console/0.log" Jun 02 21:40:58.150214 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.150153 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26"] Jun 02 21:40:58.153197 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.153179 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.156116 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.156100 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 21:40:58.157417 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.157391 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 21:40:58.157484 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.157398 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 21:40:58.157530 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.157482 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 21:40:58.157768 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.157752 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 21:40:58.157816 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.157784 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wc7z2\"" Jun 02 21:40:58.162378 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.162360 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26"] Jun 02 21:40:58.190834 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.190811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7e8215c-375d-4820-9961-595fbea3599e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.190920 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.190862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7e8215c-375d-4820-9961-595fbea3599e-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.190920 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.190909 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7e8215c-375d-4820-9961-595fbea3599e-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.190987 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.190954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr5g2\" (UniqueName: \"kubernetes.io/projected/a7e8215c-375d-4820-9961-595fbea3599e-kube-api-access-jr5g2\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.291566 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.291541 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jr5g2\" (UniqueName: \"kubernetes.io/projected/a7e8215c-375d-4820-9961-595fbea3599e-kube-api-access-jr5g2\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.291642 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.291575 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7e8215c-375d-4820-9961-595fbea3599e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.291642 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.291620 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7e8215c-375d-4820-9961-595fbea3599e-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.291710 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.291662 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7e8215c-375d-4820-9961-595fbea3599e-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.291763 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:58.291748 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 02 21:40:58.291828 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:40:58.291817 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e8215c-375d-4820-9961-595fbea3599e-prometheus-operator-tls podName:a7e8215c-375d-4820-9961-595fbea3599e nodeName:}" failed. No retries permitted until 2026-06-02 21:40:58.791800622 +0000 UTC m=+65.233248620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a7e8215c-375d-4820-9961-595fbea3599e-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-q4r26" (UID: "a7e8215c-375d-4820-9961-595fbea3599e") : secret "prometheus-operator-tls" not found Jun 02 21:40:58.292165 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.292136 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7e8215c-375d-4820-9961-595fbea3599e-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.293922 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.293902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7e8215c-375d-4820-9961-595fbea3599e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.300767 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.300749 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr5g2\" (UniqueName: \"kubernetes.io/projected/a7e8215c-375d-4820-9961-595fbea3599e-kube-api-access-jr5g2\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.426726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.426681 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hbkmf_81acd0af-4b5e-463a-937e-1cc4f2a72bff/dns/0.log" Jun 02 21:40:58.626607 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.626585 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hbkmf_81acd0af-4b5e-463a-937e-1cc4f2a72bff/kube-rbac-proxy/0.log" Jun 02 21:40:58.794317 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.794276 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:58.794317 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.794313 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7e8215c-375d-4820-9961-595fbea3599e-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.796575 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.796555 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7e8215c-375d-4820-9961-595fbea3599e-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-q4r26\" (UID: \"a7e8215c-375d-4820-9961-595fbea3599e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:58.797209 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.797195 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 21:40:58.807223 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.807190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96f66b77-910c-4cdd-9633-18f1ff5c3cfd-metrics-certs\") pod \"network-metrics-daemon-s78vq\" (UID: \"96f66b77-910c-4cdd-9633-18f1ff5c3cfd\") " pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:58.894562 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.894535 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:58.897580 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.897567 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 21:40:58.907608 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.907590 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 21:40:58.917898 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.917875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvk52\" (UniqueName: \"kubernetes.io/projected/7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98-kube-api-access-vvk52\") pod \"network-check-target-q2f2h\" (UID: \"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98\") " pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:58.936835 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.936814 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qhklz\"" Jun 02 21:40:58.940367 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.940352 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8znwf\"" Jun 02 21:40:58.944626 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.944613 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:40:58.948126 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:58.948112 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s78vq" Jun 02 21:40:59.061622 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:59.061598 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" Jun 02 21:40:59.077174 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:59.077150 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q2f2h"] Jun 02 21:40:59.079933 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:40:59.079901 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd5e62b_42f4_46b1_8bd1_35c9b94c3c98.slice/crio-7a5c0db88dd36620bd42602a9bb4bc4e5d54b8f8947e0e0228c83d0acde4efe7 WatchSource:0}: Error finding container 7a5c0db88dd36620bd42602a9bb4bc4e5d54b8f8947e0e0228c83d0acde4efe7: Status 404 returned error can't find the container with id 7a5c0db88dd36620bd42602a9bb4bc4e5d54b8f8947e0e0228c83d0acde4efe7 Jun 02 21:40:59.094247 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:59.094216 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s78vq"] Jun 02 21:40:59.098405 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:40:59.098380 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f66b77_910c_4cdd_9633_18f1ff5c3cfd.slice/crio-b0f3fd5734c562f43a57018ea11a61e5b6e52e7623016284c089cab5fcda199d WatchSource:0}: Error finding container b0f3fd5734c562f43a57018ea11a61e5b6e52e7623016284c089cab5fcda199d: Status 404 returned error can't find the container with id b0f3fd5734c562f43a57018ea11a61e5b6e52e7623016284c089cab5fcda199d Jun 02 21:40:59.186517 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:59.186490 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26"] Jun 02 21:40:59.189456 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:40:59.189427 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e8215c_375d_4820_9961_595fbea3599e.slice/crio-8228da215de90694f16912cd420e2a0aa3e40ba83ab542effbaf127292e6e32d WatchSource:0}: Error finding container 8228da215de90694f16912cd420e2a0aa3e40ba83ab542effbaf127292e6e32d: Status 404 returned error can't find the container with id 8228da215de90694f16912cd420e2a0aa3e40ba83ab542effbaf127292e6e32d Jun 02 21:40:59.525453 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:59.525316 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s78vq" event={"ID":"96f66b77-910c-4cdd-9633-18f1ff5c3cfd","Type":"ContainerStarted","Data":"b0f3fd5734c562f43a57018ea11a61e5b6e52e7623016284c089cab5fcda199d"} Jun 02 21:40:59.529428 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:59.529396 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q2f2h" event={"ID":"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98","Type":"ContainerStarted","Data":"7a5c0db88dd36620bd42602a9bb4bc4e5d54b8f8947e0e0228c83d0acde4efe7"} Jun 02 21:40:59.530836 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:40:59.530807 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" event={"ID":"a7e8215c-375d-4820-9961-595fbea3599e","Type":"ContainerStarted","Data":"8228da215de90694f16912cd420e2a0aa3e40ba83ab542effbaf127292e6e32d"} Jun 02 21:41:00.027617 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:00.027469 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6w7x_2347edd3-4cda-4b9f-bc0a-bd85c68d58ba/dns-node-resolver/0.log" Jun 02 21:41:00.492425 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:00.491851 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:41:00.492425 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:00.492388 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:41:00.498592 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:00.498570 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:41:00.539872 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:00.539842 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:41:00.626887 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:00.626869 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7vwsn_06cf6962-db9f-4f50-95c4-af6decb2627e/node-ca/0.log" Jun 02 21:41:01.539174 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:01.539128 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" event={"ID":"a7e8215c-375d-4820-9961-595fbea3599e","Type":"ContainerStarted","Data":"0cf65e84bc3aefd0d853aa5d7fe4c7e5ed23fc9b31f50f40f0da17c5887e242d"} Jun 02 21:41:01.539174 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:01.539175 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" event={"ID":"a7e8215c-375d-4820-9961-595fbea3599e","Type":"ContainerStarted","Data":"46d075b87ce817c00579d902ecb748a2d2f19735959e89b2ad4f060aa9e82519"} Jun 02 21:41:01.540936 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:01.540910 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s78vq" event={"ID":"96f66b77-910c-4cdd-9633-18f1ff5c3cfd","Type":"ContainerStarted","Data":"2b47ec4cbf0866d45d081fd54423e828bf69e67a8931395e96bdbe5e78f8145b"} Jun 02 21:41:01.541035 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:01.540942 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s78vq" event={"ID":"96f66b77-910c-4cdd-9633-18f1ff5c3cfd","Type":"ContainerStarted","Data":"62c455ae319f169c159a1525c68e271465f870108a7744a426bf342e21647929"} Jun 02 21:41:01.563941 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:01.563894 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-q4r26" podStartSLOduration=2.166216599 podStartE2EDuration="3.56387832s" podCreationTimestamp="2026-06-02 21:40:58 +0000 UTC" firstStartedPulling="2026-06-02 21:40:59.191381554 +0000 UTC m=+65.632829551" lastFinishedPulling="2026-06-02 21:41:00.589043276 +0000 UTC m=+67.030491272" observedRunningTime="2026-06-02 21:41:01.55851679 +0000 UTC m=+67.999964820" watchObservedRunningTime="2026-06-02 21:41:01.56387832 +0000 UTC m=+68.005326339" Jun 02 21:41:01.581050 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:01.581008 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s78vq" podStartSLOduration=66.139015694 podStartE2EDuration="1m7.580998492s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:40:59.10082326 +0000 UTC m=+65.542271271" lastFinishedPulling="2026-06-02 21:41:00.542806058 +0000 UTC m=+66.984254069" observedRunningTime="2026-06-02 21:41:01.580477135 +0000 UTC m=+68.021925192" watchObservedRunningTime="2026-06-02 21:41:01.580998492 +0000 UTC m=+68.022446511" Jun 02 21:41:01.828945 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:01.828907 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lqq5k_bee16cd1-dfcd-4a65-b816-a9645607b3cf/serve-healthcheck-canary/0.log" Jun 02 21:41:02.297413 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:02.297385 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:41:02.297520 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:02.297462 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:41:02.301723 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:02.301706 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:41:02.506355 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:02.506290 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hbkmf" Jun 02 21:41:02.544379 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:02.544314 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q2f2h" event={"ID":"7cd5e62b-42f4-46b1-8bd1-35c9b94c3c98","Type":"ContainerStarted","Data":"8108b8a45cbb5de613904097e53b5614f570ad47b19feeff2bddf975532ba215"} Jun 02 21:41:02.544740 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:02.544454 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:41:02.549653 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:02.549636 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:41:02.562529 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:02.562480 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q2f2h" podStartSLOduration=65.556848992 podStartE2EDuration="1m8.562465713s" podCreationTimestamp="2026-06-02 21:39:54 +0000 UTC" firstStartedPulling="2026-06-02 21:40:59.082442105 +0000 UTC m=+65.523890102" lastFinishedPulling="2026-06-02 21:41:02.088058807 +0000 UTC m=+68.529506823" observedRunningTime="2026-06-02 21:41:02.561706485 +0000 UTC m=+69.003154503" watchObservedRunningTime="2026-06-02 21:41:02.562465713 +0000 UTC m=+69.003913730" Jun 02 21:41:02.614859 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:02.614836 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645bf876d7-5pbgq"] Jun 02 21:41:03.493441 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.493410 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-cmznr"] Jun 02 21:41:03.496437 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.496420 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.499469 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.499445 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 21:41:03.499764 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.499744 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 21:41:03.499874 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.499860 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wnfbk\"" Jun 02 21:41:03.506413 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.506391 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-cmznr"] Jun 02 21:41:03.525077 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.525056 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb"] Jun 02 21:41:03.528048 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.528035 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.528135 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.528116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.528205 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.528154 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.528205 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.528184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb9hl\" (UniqueName: \"kubernetes.io/projected/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-kube-api-access-zb9hl\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.528341 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.528216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.531975 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.531958 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 21:41:03.532078 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.531962 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 21:41:03.532078 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.532002 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-kwpj4\"" Jun 02 21:41:03.532838 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.532819 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 21:41:03.549800 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.549781 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb"] Jun 02 21:41:03.556622 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.556601 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fzrnn"] Jun 02 21:41:03.559594 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.559577 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.563068 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.563052 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bfjvd\"" Jun 02 21:41:03.563740 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.563716 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 21:41:03.563740 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.563737 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 21:41:03.565031 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.564989 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 21:41:03.628998 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.628976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/09b045f2-1ce2-458d-a912-b501ea3869cd-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.629096 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629009 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.629096 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629046 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.629208 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629179 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.629265 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-tls\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.629313 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629297 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-sys\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.629391 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-metrics-client-ca\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.629391 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629349 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zb9hl\" (UniqueName: \"kubernetes.io/projected/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-kube-api-access-zb9hl\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.629391 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbn7x\" (UniqueName: \"kubernetes.io/projected/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-kube-api-access-hbn7x\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.629545 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629396 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b045f2-1ce2-458d-a912-b501ea3869cd-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.629545 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629425 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-textfile\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.629545 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629451 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.629545 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-root\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.629545 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-wtmp\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.629777 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629570 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.629777 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629748 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.629878 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsdmc\" (UniqueName: \"kubernetes.io/projected/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-api-access-fsdmc\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.629878 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.629878 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629837 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.629878 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.629872 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.632118 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.632099 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.632234 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.632211 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.640462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.640441 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb9hl\" (UniqueName: \"kubernetes.io/projected/4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e-kube-api-access-zb9hl\") pod \"openshift-state-metrics-85658796db-cmznr\" (UID: \"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.730538 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730522 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/09b045f2-1ce2-458d-a912-b501ea3869cd-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.730620 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730547 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.730620 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730570 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.730620 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730589 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-tls\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.730620 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730606 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-sys\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.730808 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730630 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-metrics-client-ca\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.730808 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730658 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbn7x\" (UniqueName: \"kubernetes.io/projected/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-kube-api-access-hbn7x\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.730808 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730682 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b045f2-1ce2-458d-a912-b501ea3869cd-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.730808 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730692 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-sys\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.730968 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:41:03.730697 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 21:41:03.730968 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:41:03.730945 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-tls podName:a1caf5d5-8a8f-4132-91ce-c913b8a5f834 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:04.23092747 +0000 UTC m=+70.672375480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-tls") pod "node-exporter-fzrnn" (UID: "a1caf5d5-8a8f-4132-91ce-c913b8a5f834") : secret "node-exporter-tls" not found Jun 02 21:41:03.731038 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/09b045f2-1ce2-458d-a912-b501ea3869cd-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.731038 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730987 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-textfile\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.731038 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.730699 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-textfile\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.731156 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731052 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.731156 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731080 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-root\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.731156 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731112 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-wtmp\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.731156 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731140 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.731404 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731181 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdmc\" (UniqueName: \"kubernetes.io/projected/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-api-access-fsdmc\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.731404 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731185 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-root\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.731404 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731217 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.731404 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731275 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-wtmp\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.731404 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731293 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-metrics-client-ca\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.731620 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731452 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.731620 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b045f2-1ce2-458d-a912-b501ea3869cd-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.731697 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.731637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.733219 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.733198 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.733458 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.733442 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.733741 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.733718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.740205 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.740177 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbn7x\" (UniqueName: \"kubernetes.io/projected/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-kube-api-access-hbn7x\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:03.741295 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.741275 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsdmc\" (UniqueName: \"kubernetes.io/projected/09b045f2-1ce2-458d-a912-b501ea3869cd-kube-api-access-fsdmc\") pod \"kube-state-metrics-8469c486bb-7jdfb\" (UID: \"09b045f2-1ce2-458d-a912-b501ea3869cd\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.805111 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.805061 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" Jun 02 21:41:03.835999 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.835973 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" Jun 02 21:41:03.934670 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.934638 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-cmznr"] Jun 02 21:41:03.939984 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:41:03.939952 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0f3fa1_1a6c_4d27_a6c1_aac86a702c7e.slice/crio-bbc5c601a25f813fc4df2792204a6ed17d00d79a15a6313a8bc70338e3606b2c WatchSource:0}: Error finding container bbc5c601a25f813fc4df2792204a6ed17d00d79a15a6313a8bc70338e3606b2c: Status 404 returned error can't find the container with id bbc5c601a25f813fc4df2792204a6ed17d00d79a15a6313a8bc70338e3606b2c Jun 02 21:41:03.976795 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:03.976771 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb"] Jun 02 21:41:03.978818 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:41:03.978795 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b045f2_1ce2_458d_a912_b501ea3869cd.slice/crio-a87e507193398fd89273747394c37b0c388ce5ffdec545db3c07cd3159290d3a WatchSource:0}: Error finding container a87e507193398fd89273747394c37b0c388ce5ffdec545db3c07cd3159290d3a: Status 404 returned error can't find the container with id a87e507193398fd89273747394c37b0c388ce5ffdec545db3c07cd3159290d3a Jun 02 21:41:04.235183 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.235156 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-tls\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:04.237505 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.237486 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1caf5d5-8a8f-4132-91ce-c913b8a5f834-node-exporter-tls\") pod \"node-exporter-fzrnn\" (UID: \"a1caf5d5-8a8f-4132-91ce-c913b8a5f834\") " pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:04.468154 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.468124 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzrnn" Jun 02 21:41:04.477077 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:41:04.477050 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1caf5d5_8a8f_4132_91ce_c913b8a5f834.slice/crio-58c14c73b318742bb3bb545f41c9973e2e44d818975257c08ff5bd5dafbf6273 WatchSource:0}: Error finding container 58c14c73b318742bb3bb545f41c9973e2e44d818975257c08ff5bd5dafbf6273: Status 404 returned error can't find the container with id 58c14c73b318742bb3bb545f41c9973e2e44d818975257c08ff5bd5dafbf6273 Jun 02 21:41:04.552994 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.552953 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" event={"ID":"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e","Type":"ContainerStarted","Data":"e2a033be97a8afecde4f5b51c6ed28c1df0142c2289134b886f18cd711dba91d"} Jun 02 21:41:04.553409 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.553001 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" event={"ID":"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e","Type":"ContainerStarted","Data":"6059794af33a898bca2c720281fb27d514f0fb742e580481d3d0c6600cf4e4cf"} Jun 02 21:41:04.553409 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.553017 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" event={"ID":"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e","Type":"ContainerStarted","Data":"bbc5c601a25f813fc4df2792204a6ed17d00d79a15a6313a8bc70338e3606b2c"} Jun 02 21:41:04.554139 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.554112 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzrnn" event={"ID":"a1caf5d5-8a8f-4132-91ce-c913b8a5f834","Type":"ContainerStarted","Data":"58c14c73b318742bb3bb545f41c9973e2e44d818975257c08ff5bd5dafbf6273"} Jun 02 21:41:04.555439 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.555414 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" event={"ID":"09b045f2-1ce2-458d-a912-b501ea3869cd","Type":"ContainerStarted","Data":"a87e507193398fd89273747394c37b0c388ce5ffdec545db3c07cd3159290d3a"} Jun 02 21:41:04.608026 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.608000 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:41:04.611743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.611716 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.615121 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.615102 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 21:41:04.615870 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.615452 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 21:41:04.615870 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.615495 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 21:41:04.615870 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.615537 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 21:41:04.615870 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.615441 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 21:41:04.615870 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.615526 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 21:41:04.616176 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.615982 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 21:41:04.616176 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.616058 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-spbxf\"" Jun 02 21:41:04.616927 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.616907 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 21:41:04.617116 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.617079 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 21:41:04.629912 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.629892 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:41:04.637674 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.637654 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.637786 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.637692 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.637786 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.637728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f5a889-701f-4abe-856b-b7fa85e2f0bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.637786 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.637757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.637942 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.637808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.637942 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.637842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f5a889-701f-4abe-856b-b7fa85e2f0bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.637942 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.637896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10f5a889-701f-4abe-856b-b7fa85e2f0bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.637942 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.637926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.638141 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.637986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10f5a889-701f-4abe-856b-b7fa85e2f0bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.638141 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.638028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.638141 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.638053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkwq5\" (UniqueName: \"kubernetes.io/projected/10f5a889-701f-4abe-856b-b7fa85e2f0bc-kube-api-access-vkwq5\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.638141 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.638124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10f5a889-701f-4abe-856b-b7fa85e2f0bc-config-out\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.638357 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.638148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-web-config\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.738944 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.738873 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10f5a889-701f-4abe-856b-b7fa85e2f0bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.738944 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.738907 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.738944 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.738928 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10f5a889-701f-4abe-856b-b7fa85e2f0bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739135 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.738953 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739135 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.738978 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwq5\" (UniqueName: \"kubernetes.io/projected/10f5a889-701f-4abe-856b-b7fa85e2f0bc-kube-api-access-vkwq5\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739135 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.739009 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10f5a889-701f-4abe-856b-b7fa85e2f0bc-config-out\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739135 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.739030 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-web-config\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739430 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.739191 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739430 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.739271 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739430 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.739341 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f5a889-701f-4abe-856b-b7fa85e2f0bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739430 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.739360 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10f5a889-701f-4abe-856b-b7fa85e2f0bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739430 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.739379 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739430 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.739418 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739712 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.739457 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f5a889-701f-4abe-856b-b7fa85e2f0bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.739712 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:41:04.739618 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10f5a889-701f-4abe-856b-b7fa85e2f0bc-alertmanager-trusted-ca-bundle podName:10f5a889-701f-4abe-856b-b7fa85e2f0bc nodeName:}" failed. No retries permitted until 2026-06-02 21:41:05.239595742 +0000 UTC m=+71.681043760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/10f5a889-701f-4abe-856b-b7fa85e2f0bc-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "10f5a889-701f-4abe-856b-b7fa85e2f0bc") : configmap references non-existent config key: ca-bundle.crt Jun 02 21:41:04.740561 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.740532 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f5a889-701f-4abe-856b-b7fa85e2f0bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.742124 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.742091 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10f5a889-701f-4abe-856b-b7fa85e2f0bc-config-out\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.743108 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.742564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-web-config\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.743108 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.742577 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.743108 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.743067 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.743953 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.743928 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10f5a889-701f-4abe-856b-b7fa85e2f0bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.744076 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.744055 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.744140 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.744065 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.744547 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.744528 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.744725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.744709 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10f5a889-701f-4abe-856b-b7fa85e2f0bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:04.748108 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:04.748078 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkwq5\" (UniqueName: \"kubernetes.io/projected/10f5a889-701f-4abe-856b-b7fa85e2f0bc-kube-api-access-vkwq5\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:05.243916 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.243870 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f5a889-701f-4abe-856b-b7fa85e2f0bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:05.244829 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.244775 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f5a889-701f-4abe-856b-b7fa85e2f0bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10f5a889-701f-4abe-856b-b7fa85e2f0bc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:05.498040 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.497961 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c68cbf95f-c67n8"] Jun 02 21:41:05.502098 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.502076 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.506124 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.506100 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 21:41:05.506248 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.506231 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 21:41:05.506302 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.506231 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 21:41:05.506765 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.506744 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6rx8h\"" Jun 02 21:41:05.507220 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.507021 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 21:41:05.508603 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.508582 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b7uespgd98jru\"" Jun 02 21:41:05.509751 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.509713 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 21:41:05.523927 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.523902 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:41:05.561590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.560735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.561590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.560785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.561590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.560840 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-tls\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.561590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.560868 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1afa7830-f59a-49b0-a40d-ce959884ebe3-metrics-client-ca\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.561590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.560899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.561590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.560930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-grpc-tls\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.561590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.560973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.561590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.561021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfz6r\" (UniqueName: \"kubernetes.io/projected/1afa7830-f59a-49b0-a40d-ce959884ebe3-kube-api-access-gfz6r\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.573360 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.563185 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c68cbf95f-c67n8"] Jun 02 21:41:05.578725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.578693 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" event={"ID":"09b045f2-1ce2-458d-a912-b501ea3869cd","Type":"ContainerStarted","Data":"a011cefb5e54a61ea49aa1ae99acc98c9d5163c3a739b2fc2b735030827cfa83"} Jun 02 21:41:05.578847 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.578731 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" event={"ID":"09b045f2-1ce2-458d-a912-b501ea3869cd","Type":"ContainerStarted","Data":"0a55c307b62f92f58414569f17d94f5aa6ea7cc40f24c778db67693ee1ad2ee2"} Jun 02 21:41:05.578847 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.578746 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" event={"ID":"09b045f2-1ce2-458d-a912-b501ea3869cd","Type":"ContainerStarted","Data":"fb3a922d82be9b681661fb628b28d373a236a9bc510edfcb6b7909bcd810913b"} Jun 02 21:41:05.610985 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.610940 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-7jdfb" podStartSLOduration=1.520031895 podStartE2EDuration="2.610923947s" podCreationTimestamp="2026-06-02 21:41:03 +0000 UTC" firstStartedPulling="2026-06-02 21:41:03.981070173 +0000 UTC m=+70.422518170" lastFinishedPulling="2026-06-02 21:41:05.071962224 +0000 UTC m=+71.513410222" observedRunningTime="2026-06-02 21:41:05.609665052 +0000 UTC m=+72.051113083" watchObservedRunningTime="2026-06-02 21:41:05.610923947 +0000 UTC m=+72.052371969" Jun 02 21:41:05.661935 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.661909 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-tls\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.662044 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.661942 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1afa7830-f59a-49b0-a40d-ce959884ebe3-metrics-client-ca\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.662044 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.661985 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.662044 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.662022 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-grpc-tls\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.662200 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.662081 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.662200 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.662132 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfz6r\" (UniqueName: \"kubernetes.io/projected/1afa7830-f59a-49b0-a40d-ce959884ebe3-kube-api-access-gfz6r\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.662200 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.662179 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.662308 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.662210 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.662751 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.662723 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1afa7830-f59a-49b0-a40d-ce959884ebe3-metrics-client-ca\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.664985 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.664941 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-tls\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.665862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.665822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-grpc-tls\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.666458 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.666437 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.666541 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.666493 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.666624 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.666575 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.666881 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.666861 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1afa7830-f59a-49b0-a40d-ce959884ebe3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.672987 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.672946 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfz6r\" (UniqueName: \"kubernetes.io/projected/1afa7830-f59a-49b0-a40d-ce959884ebe3-kube-api-access-gfz6r\") pod \"thanos-querier-c68cbf95f-c67n8\" (UID: \"1afa7830-f59a-49b0-a40d-ce959884ebe3\") " pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.783992 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.783960 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:41:05.785472 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:41:05.785442 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f5a889_701f_4abe_856b_b7fa85e2f0bc.slice/crio-f46aa68a0fc7a08747044c075051748133ce4af4d7193a19cccd4b924aa6506a WatchSource:0}: Error finding container f46aa68a0fc7a08747044c075051748133ce4af4d7193a19cccd4b924aa6506a: Status 404 returned error can't find the container with id f46aa68a0fc7a08747044c075051748133ce4af4d7193a19cccd4b924aa6506a Jun 02 21:41:05.813825 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.813801 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:05.945022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:05.944999 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c68cbf95f-c67n8"] Jun 02 21:41:05.946510 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:41:05.946481 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afa7830_f59a_49b0_a40d_ce959884ebe3.slice/crio-57b7e619b67c207a77a636d3ad791241738de141aae652654d414cb57ab4ae80 WatchSource:0}: Error finding container 57b7e619b67c207a77a636d3ad791241738de141aae652654d414cb57ab4ae80: Status 404 returned error can't find the container with id 57b7e619b67c207a77a636d3ad791241738de141aae652654d414cb57ab4ae80 Jun 02 21:41:06.587101 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:06.587006 2567 generic.go:358] "Generic (PLEG): container finished" podID="a1caf5d5-8a8f-4132-91ce-c913b8a5f834" containerID="c9d05c371e15aa933f1c0a225c62ee9c3ecd021e98bf49894447310887dd0dd5" exitCode=0 Jun 02 21:41:06.587101 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:06.587080 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzrnn" event={"ID":"a1caf5d5-8a8f-4132-91ce-c913b8a5f834","Type":"ContainerDied","Data":"c9d05c371e15aa933f1c0a225c62ee9c3ecd021e98bf49894447310887dd0dd5"} Jun 02 21:41:06.588959 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:06.588932 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" event={"ID":"1afa7830-f59a-49b0-a40d-ce959884ebe3","Type":"ContainerStarted","Data":"57b7e619b67c207a77a636d3ad791241738de141aae652654d414cb57ab4ae80"} Jun 02 21:41:06.590532 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:06.590507 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10f5a889-701f-4abe-856b-b7fa85e2f0bc","Type":"ContainerStarted","Data":"f46aa68a0fc7a08747044c075051748133ce4af4d7193a19cccd4b924aa6506a"} Jun 02 21:41:08.049442 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.049403 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55f7bb5849-fnpsb"] Jun 02 21:41:08.074903 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.074863 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55f7bb5849-fnpsb"] Jun 02 21:41:08.075127 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.075013 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.078341 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.078304 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pw5sd\"" Jun 02 21:41:08.079867 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.079819 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 21:41:08.079973 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.079901 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 21:41:08.079973 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.079902 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 21:41:08.080205 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.080182 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 21:41:08.080280 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.080234 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-13tjhn2hik1f2\"" Jun 02 21:41:08.183629 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.183607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blnsx\" (UniqueName: \"kubernetes.io/projected/4a464039-7ffe-42f9-b4af-553a5b5d536a-kube-api-access-blnsx\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.183756 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.183643 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4a464039-7ffe-42f9-b4af-553a5b5d536a-audit-log\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.183756 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.183668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4a464039-7ffe-42f9-b4af-553a5b5d536a-secret-metrics-server-client-certs\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.183756 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.183711 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4a464039-7ffe-42f9-b4af-553a5b5d536a-secret-metrics-server-tls\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.183904 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.183757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a464039-7ffe-42f9-b4af-553a5b5d536a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.183904 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.183782 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4a464039-7ffe-42f9-b4af-553a5b5d536a-metrics-server-audit-profiles\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.183904 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.183827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a464039-7ffe-42f9-b4af-553a5b5d536a-client-ca-bundle\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.284309 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.284284 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4a464039-7ffe-42f9-b4af-553a5b5d536a-audit-log\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.284414 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.284355 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4a464039-7ffe-42f9-b4af-553a5b5d536a-secret-metrics-server-client-certs\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.284456 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.284419 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4a464039-7ffe-42f9-b4af-553a5b5d536a-secret-metrics-server-tls\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.284498 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.284454 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a464039-7ffe-42f9-b4af-553a5b5d536a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.284498 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.284489 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4a464039-7ffe-42f9-b4af-553a5b5d536a-metrics-server-audit-profiles\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.284608 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.284555 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a464039-7ffe-42f9-b4af-553a5b5d536a-client-ca-bundle\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.284608 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.284593 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blnsx\" (UniqueName: \"kubernetes.io/projected/4a464039-7ffe-42f9-b4af-553a5b5d536a-kube-api-access-blnsx\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.285308 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.285254 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a464039-7ffe-42f9-b4af-553a5b5d536a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.285444 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.285364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4a464039-7ffe-42f9-b4af-553a5b5d536a-audit-log\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.286022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.285957 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4a464039-7ffe-42f9-b4af-553a5b5d536a-metrics-server-audit-profiles\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.287754 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.287708 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a464039-7ffe-42f9-b4af-553a5b5d536a-client-ca-bundle\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.287941 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.287894 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4a464039-7ffe-42f9-b4af-553a5b5d536a-secret-metrics-server-client-certs\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.287941 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.287894 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4a464039-7ffe-42f9-b4af-553a5b5d536a-secret-metrics-server-tls\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.294225 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.294190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blnsx\" (UniqueName: \"kubernetes.io/projected/4a464039-7ffe-42f9-b4af-553a5b5d536a-kube-api-access-blnsx\") pod \"metrics-server-55f7bb5849-fnpsb\" (UID: \"4a464039-7ffe-42f9-b4af-553a5b5d536a\") " pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.338999 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.338967 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd"] Jun 02 21:41:08.365228 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.365200 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd"] Jun 02 21:41:08.365388 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.365373 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" Jun 02 21:41:08.369501 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.369294 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-t2v2m\"" Jun 02 21:41:08.369721 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.369701 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 21:41:08.385430 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.385404 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:08.486493 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.486463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e4f7ab9-4710-4379-a2b3-1a055c052839-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-4prrd\" (UID: \"0e4f7ab9-4710-4379-a2b3-1a055c052839\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" Jun 02 21:41:08.587483 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.587444 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e4f7ab9-4710-4379-a2b3-1a055c052839-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-4prrd\" (UID: \"0e4f7ab9-4710-4379-a2b3-1a055c052839\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" Jun 02 21:41:08.587634 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:41:08.587577 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 21:41:08.587679 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:41:08.587646 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4f7ab9-4710-4379-a2b3-1a055c052839-monitoring-plugin-cert podName:0e4f7ab9-4710-4379-a2b3-1a055c052839 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:09.087626281 +0000 UTC m=+75.529074278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0e4f7ab9-4710-4379-a2b3-1a055c052839-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-4prrd" (UID: "0e4f7ab9-4710-4379-a2b3-1a055c052839") : secret "monitoring-plugin-cert" not found Jun 02 21:41:08.597414 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.597366 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" event={"ID":"4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e","Type":"ContainerStarted","Data":"ad0672265ee11dfc8745405a9fd514f3d43a714b0d6e5f81835ae3a5c180ad9c"} Jun 02 21:41:08.599435 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.599413 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzrnn" event={"ID":"a1caf5d5-8a8f-4132-91ce-c913b8a5f834","Type":"ContainerStarted","Data":"6f11fbebd0555d1fed209fb68cf7c588b9ea6bc177e73053628e5d19ce86cb46"} Jun 02 21:41:08.599546 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.599443 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzrnn" event={"ID":"a1caf5d5-8a8f-4132-91ce-c913b8a5f834","Type":"ContainerStarted","Data":"ea3fd9144ec127084f5961ebeda4d1a2c4247ec239b03748cccf297ed2c68b52"} Jun 02 21:41:08.600723 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.600702 2567 generic.go:358] "Generic (PLEG): container finished" podID="10f5a889-701f-4abe-856b-b7fa85e2f0bc" containerID="01910868023c3a1d542e7a48fade97a3a5e4172e56fe331940312f31c8e4fac8" exitCode=0 Jun 02 21:41:08.600803 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.600750 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10f5a889-701f-4abe-856b-b7fa85e2f0bc","Type":"ContainerDied","Data":"01910868023c3a1d542e7a48fade97a3a5e4172e56fe331940312f31c8e4fac8"} Jun 02 21:41:08.618620 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.618578 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-cmznr" podStartSLOduration=1.516458898 podStartE2EDuration="5.618566592s" podCreationTimestamp="2026-06-02 21:41:03 +0000 UTC" firstStartedPulling="2026-06-02 21:41:04.065228186 +0000 UTC m=+70.506676183" lastFinishedPulling="2026-06-02 21:41:08.167335869 +0000 UTC m=+74.608783877" observedRunningTime="2026-06-02 21:41:08.61748301 +0000 UTC m=+75.058931031" watchObservedRunningTime="2026-06-02 21:41:08.618566592 +0000 UTC m=+75.060014611" Jun 02 21:41:08.638114 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.638071 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fzrnn" podStartSLOduration=4.428045858 podStartE2EDuration="5.638058895s" podCreationTimestamp="2026-06-02 21:41:03 +0000 UTC" firstStartedPulling="2026-06-02 21:41:04.478931739 +0000 UTC m=+70.920379752" lastFinishedPulling="2026-06-02 21:41:05.688944779 +0000 UTC m=+72.130392789" observedRunningTime="2026-06-02 21:41:08.636873053 +0000 UTC m=+75.078321073" watchObservedRunningTime="2026-06-02 21:41:08.638058895 +0000 UTC m=+75.079506937" Jun 02 21:41:08.745923 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:08.745895 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55f7bb5849-fnpsb"] Jun 02 21:41:08.746818 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:41:08.746790 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a464039_7ffe_42f9_b4af_553a5b5d536a.slice/crio-0d9cb789c8de5189982122763f2e531a6fe38f5b2c8c0f025563beeb2d570cfa WatchSource:0}: Error finding container 0d9cb789c8de5189982122763f2e531a6fe38f5b2c8c0f025563beeb2d570cfa: Status 404 returned error can't find the container with id 0d9cb789c8de5189982122763f2e531a6fe38f5b2c8c0f025563beeb2d570cfa Jun 02 21:41:09.093751 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.093709 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e4f7ab9-4710-4379-a2b3-1a055c052839-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-4prrd\" (UID: \"0e4f7ab9-4710-4379-a2b3-1a055c052839\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" Jun 02 21:41:09.096802 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.096738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e4f7ab9-4710-4379-a2b3-1a055c052839-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-4prrd\" (UID: \"0e4f7ab9-4710-4379-a2b3-1a055c052839\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" Jun 02 21:41:09.339271 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.339231 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" Jun 02 21:41:09.502121 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.501749 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd"] Jun 02 21:41:09.595626 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.595593 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b68f6f668-c57gb"] Jun 02 21:41:09.599144 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.599118 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.614173 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.613917 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" event={"ID":"1afa7830-f59a-49b0-a40d-ce959884ebe3","Type":"ContainerStarted","Data":"e3e7c947ac2368a6e2d7eafa9d527e9847c738c046de4cece7d17add6ab95398"} Jun 02 21:41:09.614173 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.613962 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" event={"ID":"1afa7830-f59a-49b0-a40d-ce959884ebe3","Type":"ContainerStarted","Data":"539aecebd6c72dc76edfc3930f7d06e6993a820b10c9c1452867b927bb175e9c"} Jun 02 21:41:09.614173 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.613979 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" event={"ID":"1afa7830-f59a-49b0-a40d-ce959884ebe3","Type":"ContainerStarted","Data":"0a7ef33073b320e78a9c6f48661b439c65dd47cf11be3ddcb3910feb61b9f221"} Jun 02 21:41:09.615963 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.615901 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" event={"ID":"4a464039-7ffe-42f9-b4af-553a5b5d536a","Type":"ContainerStarted","Data":"0d9cb789c8de5189982122763f2e531a6fe38f5b2c8c0f025563beeb2d570cfa"} Jun 02 21:41:09.628751 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.628715 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b68f6f668-c57gb"] Jun 02 21:41:09.687505 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:41:09.687450 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4f7ab9_4710_4379_a2b3_1a055c052839.slice/crio-2d51986d4046d8d1b74bdf6aed4f06c2e2852767282b003e78d0da50665930a6 WatchSource:0}: Error finding container 2d51986d4046d8d1b74bdf6aed4f06c2e2852767282b003e78d0da50665930a6: Status 404 returned error can't find the container with id 2d51986d4046d8d1b74bdf6aed4f06c2e2852767282b003e78d0da50665930a6 Jun 02 21:41:09.699316 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.699286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-config\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.699767 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.699743 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-oauth-serving-cert\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.700089 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.700066 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-oauth-config\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.700189 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.700122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-service-ca\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.700307 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.700280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-trusted-ca-bundle\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.700386 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.700317 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld565\" (UniqueName: \"kubernetes.io/projected/6fa897ba-93d2-4d6c-b408-6b0468c9568a-kube-api-access-ld565\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.700386 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.700372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-serving-cert\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.802611 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.801714 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-service-ca\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.802611 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.801768 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-trusted-ca-bundle\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.802611 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.801790 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ld565\" (UniqueName: \"kubernetes.io/projected/6fa897ba-93d2-4d6c-b408-6b0468c9568a-kube-api-access-ld565\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.802611 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.801810 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-serving-cert\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.802611 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.801838 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-config\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.802611 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.801858 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-oauth-serving-cert\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.802611 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.801882 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-oauth-config\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.803681 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.802876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-service-ca\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.803681 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.803459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-config\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.804882 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.804263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-trusted-ca-bundle\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.805029 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.804989 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-oauth-serving-cert\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.805166 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.805149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-oauth-config\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.806959 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.806932 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-serving-cert\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.814156 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.814136 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld565\" (UniqueName: \"kubernetes.io/projected/6fa897ba-93d2-4d6c-b408-6b0468c9568a-kube-api-access-ld565\") pod \"console-7b68f6f668-c57gb\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:09.913746 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:09.913666 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:10.630350 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:10.630107 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" event={"ID":"0e4f7ab9-4710-4379-a2b3-1a055c052839","Type":"ContainerStarted","Data":"2d51986d4046d8d1b74bdf6aed4f06c2e2852767282b003e78d0da50665930a6"} Jun 02 21:41:10.766800 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:10.766676 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b68f6f668-c57gb"] Jun 02 21:41:10.772860 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:41:10.772535 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa897ba_93d2_4d6c_b408_6b0468c9568a.slice/crio-ce8c8ea5536c31a5d202f9a5cba9cc39e23211b7c81ebcb2c07bdc2b1ef81132 WatchSource:0}: Error finding container ce8c8ea5536c31a5d202f9a5cba9cc39e23211b7c81ebcb2c07bdc2b1ef81132: Status 404 returned error can't find the container with id ce8c8ea5536c31a5d202f9a5cba9cc39e23211b7c81ebcb2c07bdc2b1ef81132 Jun 02 21:41:10.988751 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:10.988706 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j8k66"] Jun 02 21:41:10.996955 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:10.996924 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.000247 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.000203 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 21:41:11.000419 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.000307 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 21:41:11.000906 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.000499 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 21:41:11.000906 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.000583 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l2892\"" Jun 02 21:41:11.000906 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.000701 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 21:41:11.001070 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.000907 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j8k66"] Jun 02 21:41:11.114466 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.114436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11515cae-0b00-4afa-84de-d823e2eb6e60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.114582 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.114488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11515cae-0b00-4afa-84de-d823e2eb6e60-data-volume\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.114636 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.114616 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gwsj\" (UniqueName: \"kubernetes.io/projected/11515cae-0b00-4afa-84de-d823e2eb6e60-kube-api-access-5gwsj\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.114725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.114703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11515cae-0b00-4afa-84de-d823e2eb6e60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.114777 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.114750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11515cae-0b00-4afa-84de-d823e2eb6e60-crio-socket\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.215481 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.215446 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gwsj\" (UniqueName: \"kubernetes.io/projected/11515cae-0b00-4afa-84de-d823e2eb6e60-kube-api-access-5gwsj\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.215661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.215522 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11515cae-0b00-4afa-84de-d823e2eb6e60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.215661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.215557 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11515cae-0b00-4afa-84de-d823e2eb6e60-crio-socket\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.215661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.215601 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11515cae-0b00-4afa-84de-d823e2eb6e60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.215661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.215636 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11515cae-0b00-4afa-84de-d823e2eb6e60-data-volume\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.215870 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.215681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11515cae-0b00-4afa-84de-d823e2eb6e60-crio-socket\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.216087 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.216055 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11515cae-0b00-4afa-84de-d823e2eb6e60-data-volume\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.216197 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.216124 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11515cae-0b00-4afa-84de-d823e2eb6e60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.218090 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.218070 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11515cae-0b00-4afa-84de-d823e2eb6e60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.226139 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.226119 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gwsj\" (UniqueName: \"kubernetes.io/projected/11515cae-0b00-4afa-84de-d823e2eb6e60-kube-api-access-5gwsj\") pod \"insights-runtime-extractor-j8k66\" (UID: \"11515cae-0b00-4afa-84de-d823e2eb6e60\") " pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.316624 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.316588 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j8k66" Jun 02 21:41:11.496768 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.496734 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j8k66"] Jun 02 21:41:11.637402 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.637238 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" event={"ID":"1afa7830-f59a-49b0-a40d-ce959884ebe3","Type":"ContainerStarted","Data":"ac79503d34325254fed9b86ff1ed1d64a5a2e3d91fe8b24abd85cdf8b4830d82"} Jun 02 21:41:11.637402 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.637284 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" event={"ID":"1afa7830-f59a-49b0-a40d-ce959884ebe3","Type":"ContainerStarted","Data":"9285a3786727b64708468800a034f2dd658ca7bed6b498adceff816b836933cc"} Jun 02 21:41:11.637402 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.637298 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" event={"ID":"1afa7830-f59a-49b0-a40d-ce959884ebe3","Type":"ContainerStarted","Data":"ce38f40e77b6aff8defa8de29527928f4a0f98dcab82d3708d0638bf37804ff1"} Jun 02 21:41:11.637924 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.637501 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:11.639555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.639348 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" event={"ID":"4a464039-7ffe-42f9-b4af-553a5b5d536a","Type":"ContainerStarted","Data":"5a12250b1182aed896e7b9dbe5b4d7d5e97e3976d11267c9b41e98b2dafcbf72"} Jun 02 21:41:11.644590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.644515 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b68f6f668-c57gb" event={"ID":"6fa897ba-93d2-4d6c-b408-6b0468c9568a","Type":"ContainerStarted","Data":"94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6"} Jun 02 21:41:11.644590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.644549 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b68f6f668-c57gb" event={"ID":"6fa897ba-93d2-4d6c-b408-6b0468c9568a","Type":"ContainerStarted","Data":"ce8c8ea5536c31a5d202f9a5cba9cc39e23211b7c81ebcb2c07bdc2b1ef81132"} Jun 02 21:41:11.648235 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.648134 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10f5a889-701f-4abe-856b-b7fa85e2f0bc","Type":"ContainerStarted","Data":"548d81908b4b4c9e9f12f15bfed158d7625d5e40d380124963b86a464f5f6d17"} Jun 02 21:41:11.648235 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.648162 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10f5a889-701f-4abe-856b-b7fa85e2f0bc","Type":"ContainerStarted","Data":"533d971fa93d903b5b1a9ed7aaa708b81f938b1e02aa0c1666294a9cd3b779a3"} Jun 02 21:41:11.648235 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.648176 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10f5a889-701f-4abe-856b-b7fa85e2f0bc","Type":"ContainerStarted","Data":"43248a07ed127b40d00c186d0d77e84b9a621795e278da831e72521fc6325bd3"} Jun 02 21:41:11.648235 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.648190 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10f5a889-701f-4abe-856b-b7fa85e2f0bc","Type":"ContainerStarted","Data":"41d1efd6384e6ceafdf474c4da17b2f3175081b0c7b12bc1a8470664922da382"} Jun 02 21:41:11.648235 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.648201 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10f5a889-701f-4abe-856b-b7fa85e2f0bc","Type":"ContainerStarted","Data":"f7f0262676b34441ed0925095841a32b61fe969bc9c6e24efce48ee5140f9afe"} Jun 02 21:41:11.648235 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.648216 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10f5a889-701f-4abe-856b-b7fa85e2f0bc","Type":"ContainerStarted","Data":"e4356452e2f5ab6ee3eb0135eeb241510cd48805f5f322af68fbbaaa573a8ad3"} Jun 02 21:41:11.671762 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.670573 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" podStartSLOduration=2.040472412 podStartE2EDuration="6.670555808s" podCreationTimestamp="2026-06-02 21:41:05 +0000 UTC" firstStartedPulling="2026-06-02 21:41:05.948424864 +0000 UTC m=+72.389872861" lastFinishedPulling="2026-06-02 21:41:10.57850826 +0000 UTC m=+77.019956257" observedRunningTime="2026-06-02 21:41:11.667544106 +0000 UTC m=+78.108992162" watchObservedRunningTime="2026-06-02 21:41:11.670555808 +0000 UTC m=+78.112003828" Jun 02 21:41:11.736027 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.735966 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.945093089 podStartE2EDuration="7.735946194s" podCreationTimestamp="2026-06-02 21:41:04 +0000 UTC" firstStartedPulling="2026-06-02 21:41:05.787618597 +0000 UTC m=+72.229066598" lastFinishedPulling="2026-06-02 21:41:10.5784717 +0000 UTC m=+77.019919703" observedRunningTime="2026-06-02 21:41:11.735266895 +0000 UTC m=+78.176714916" watchObservedRunningTime="2026-06-02 21:41:11.735946194 +0000 UTC m=+78.177394216" Jun 02 21:41:11.819364 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.819293 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" podStartSLOduration=1.989681392 podStartE2EDuration="3.819275251s" podCreationTimestamp="2026-06-02 21:41:08 +0000 UTC" firstStartedPulling="2026-06-02 21:41:08.748876164 +0000 UTC m=+75.190324161" lastFinishedPulling="2026-06-02 21:41:10.578470009 +0000 UTC m=+77.019918020" observedRunningTime="2026-06-02 21:41:11.818097914 +0000 UTC m=+78.259545935" watchObservedRunningTime="2026-06-02 21:41:11.819275251 +0000 UTC m=+78.260723270" Jun 02 21:41:11.820442 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:11.820395 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7b68f6f668-c57gb" podStartSLOduration=2.8203851479999997 podStartE2EDuration="2.820385148s" podCreationTimestamp="2026-06-02 21:41:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:41:11.782658417 +0000 UTC m=+78.224106442" watchObservedRunningTime="2026-06-02 21:41:11.820385148 +0000 UTC m=+78.261833167" Jun 02 21:41:11.838117 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:41:11.838084 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11515cae_0b00_4afa_84de_d823e2eb6e60.slice/crio-f1ca0d8076160988c3302f64d4e0e8f7eb1281e089d33596bc1aae1a8b4538bb WatchSource:0}: Error finding container f1ca0d8076160988c3302f64d4e0e8f7eb1281e089d33596bc1aae1a8b4538bb: Status 404 returned error can't find the container with id f1ca0d8076160988c3302f64d4e0e8f7eb1281e089d33596bc1aae1a8b4538bb Jun 02 21:41:12.652313 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:12.652283 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j8k66" event={"ID":"11515cae-0b00-4afa-84de-d823e2eb6e60","Type":"ContainerStarted","Data":"2600e9e640f9a00135c357ee108023d606a0b8bfc220cad640b3c78bae82ba83"} Jun 02 21:41:12.652680 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:12.652338 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j8k66" event={"ID":"11515cae-0b00-4afa-84de-d823e2eb6e60","Type":"ContainerStarted","Data":"f1ca0d8076160988c3302f64d4e0e8f7eb1281e089d33596bc1aae1a8b4538bb"} Jun 02 21:41:12.653654 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:12.653619 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" event={"ID":"0e4f7ab9-4710-4379-a2b3-1a055c052839","Type":"ContainerStarted","Data":"bb3d7c17983fa1932d8cd3747377343c7b2cd679e5403618051884f9cdeb5caa"} Jun 02 21:41:12.654584 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:12.654564 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" Jun 02 21:41:12.659413 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:12.659391 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" Jun 02 21:41:12.674078 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:12.674039 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4prrd" podStartSLOduration=2.477561546 podStartE2EDuration="4.674026979s" podCreationTimestamp="2026-06-02 21:41:08 +0000 UTC" firstStartedPulling="2026-06-02 21:41:09.693020027 +0000 UTC m=+76.134468024" lastFinishedPulling="2026-06-02 21:41:11.889485443 +0000 UTC m=+78.330933457" observedRunningTime="2026-06-02 21:41:12.672366287 +0000 UTC m=+79.113814306" watchObservedRunningTime="2026-06-02 21:41:12.674026979 +0000 UTC m=+79.115474997" Jun 02 21:41:13.658652 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:13.658615 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j8k66" event={"ID":"11515cae-0b00-4afa-84de-d823e2eb6e60","Type":"ContainerStarted","Data":"22de057b3563e204de52503c75f5769727a2cf11e2166a47655c35ad771e6195"} Jun 02 21:41:14.665061 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:14.665027 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j8k66" event={"ID":"11515cae-0b00-4afa-84de-d823e2eb6e60","Type":"ContainerStarted","Data":"eb205641b73965dd14fd53b5dcb450740eeb6fe8b9cf0ddc9e203c2247f2f137"} Jun 02 21:41:14.689137 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:14.689082 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j8k66" podStartSLOduration=2.326565516 podStartE2EDuration="4.689068116s" podCreationTimestamp="2026-06-02 21:41:10 +0000 UTC" firstStartedPulling="2026-06-02 21:41:11.891619698 +0000 UTC m=+78.333067695" lastFinishedPulling="2026-06-02 21:41:14.254122281 +0000 UTC m=+80.695570295" observedRunningTime="2026-06-02 21:41:14.687634093 +0000 UTC m=+81.129082113" watchObservedRunningTime="2026-06-02 21:41:14.689068116 +0000 UTC m=+81.130516135" Jun 02 21:41:17.660558 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:17.660521 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c68cbf95f-c67n8" Jun 02 21:41:19.914891 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:19.914831 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:19.914891 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:19.914902 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:19.919837 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:19.919809 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:20.690555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:20.690525 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:41:20.745286 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:20.745257 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbf9ccb9f-chcpz"] Jun 02 21:41:28.385541 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.385501 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:28.385541 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.385553 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:28.568237 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.568169 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-645bf876d7-5pbgq" podUID="0a38fb14-2f9c-4fda-a273-aebd17dde3ec" containerName="console" containerID="cri-o://76210e4b75e4586d812ee9a51a9778e88d960a03c97355c845d2f30f3c7bf96f" gracePeriod=15 Jun 02 21:41:28.712132 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.712100 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-645bf876d7-5pbgq_0a38fb14-2f9c-4fda-a273-aebd17dde3ec/console/0.log" Jun 02 21:41:28.712286 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.712142 2567 generic.go:358] "Generic (PLEG): container finished" podID="0a38fb14-2f9c-4fda-a273-aebd17dde3ec" containerID="76210e4b75e4586d812ee9a51a9778e88d960a03c97355c845d2f30f3c7bf96f" exitCode=2 Jun 02 21:41:28.712286 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.712205 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645bf876d7-5pbgq" event={"ID":"0a38fb14-2f9c-4fda-a273-aebd17dde3ec","Type":"ContainerDied","Data":"76210e4b75e4586d812ee9a51a9778e88d960a03c97355c845d2f30f3c7bf96f"} Jun 02 21:41:28.814960 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.814940 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-645bf876d7-5pbgq_0a38fb14-2f9c-4fda-a273-aebd17dde3ec/console/0.log" Jun 02 21:41:28.815076 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.815009 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:41:28.974065 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.973973 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-config\") pod \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " Jun 02 21:41:28.974065 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.974050 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-oauth-config\") pod \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " Jun 02 21:41:28.974280 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.974071 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-oauth-serving-cert\") pod \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " Jun 02 21:41:28.974280 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.974090 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-service-ca\") pod \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " Jun 02 21:41:28.974280 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.974133 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrdhs\" (UniqueName: \"kubernetes.io/projected/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-kube-api-access-qrdhs\") pod \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " Jun 02 21:41:28.974280 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.974160 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-serving-cert\") pod \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\" (UID: \"0a38fb14-2f9c-4fda-a273-aebd17dde3ec\") " Jun 02 21:41:28.974559 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.974488 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-config" (OuterVolumeSpecName: "console-config") pod "0a38fb14-2f9c-4fda-a273-aebd17dde3ec" (UID: "0a38fb14-2f9c-4fda-a273-aebd17dde3ec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:41:28.974638 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.974516 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0a38fb14-2f9c-4fda-a273-aebd17dde3ec" (UID: "0a38fb14-2f9c-4fda-a273-aebd17dde3ec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:41:28.974694 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.974649 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-service-ca" (OuterVolumeSpecName: "service-ca") pod "0a38fb14-2f9c-4fda-a273-aebd17dde3ec" (UID: "0a38fb14-2f9c-4fda-a273-aebd17dde3ec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:41:28.976562 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.976534 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-kube-api-access-qrdhs" (OuterVolumeSpecName: "kube-api-access-qrdhs") pod "0a38fb14-2f9c-4fda-a273-aebd17dde3ec" (UID: "0a38fb14-2f9c-4fda-a273-aebd17dde3ec"). InnerVolumeSpecName "kube-api-access-qrdhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:41:28.976673 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.976651 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0a38fb14-2f9c-4fda-a273-aebd17dde3ec" (UID: "0a38fb14-2f9c-4fda-a273-aebd17dde3ec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:41:28.976673 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:28.976657 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0a38fb14-2f9c-4fda-a273-aebd17dde3ec" (UID: "0a38fb14-2f9c-4fda-a273-aebd17dde3ec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:41:29.075268 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.075228 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrdhs\" (UniqueName: \"kubernetes.io/projected/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-kube-api-access-qrdhs\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:29.075268 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.075266 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:29.075474 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.075279 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:29.075474 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.075291 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-console-oauth-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:29.075474 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.075300 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-oauth-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:29.075474 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.075309 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a38fb14-2f9c-4fda-a273-aebd17dde3ec-service-ca\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:29.716677 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.716650 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-645bf876d7-5pbgq_0a38fb14-2f9c-4fda-a273-aebd17dde3ec/console/0.log" Jun 02 21:41:29.717071 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.716761 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645bf876d7-5pbgq" Jun 02 21:41:29.717071 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.716762 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645bf876d7-5pbgq" event={"ID":"0a38fb14-2f9c-4fda-a273-aebd17dde3ec","Type":"ContainerDied","Data":"df5437121fe5f727f004883ae10e0686d00e4b29bdd4a8fe90f59e8b08df5452"} Jun 02 21:41:29.717071 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.716801 2567 scope.go:117] "RemoveContainer" containerID="76210e4b75e4586d812ee9a51a9778e88d960a03c97355c845d2f30f3c7bf96f" Jun 02 21:41:29.738085 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.738056 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645bf876d7-5pbgq"] Jun 02 21:41:29.743508 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:29.743484 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-645bf876d7-5pbgq"] Jun 02 21:41:30.127812 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:30.127774 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a38fb14-2f9c-4fda-a273-aebd17dde3ec" path="/var/lib/kubelet/pods/0a38fb14-2f9c-4fda-a273-aebd17dde3ec/volumes" Jun 02 21:41:33.549190 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:33.549163 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q2f2h" Jun 02 21:41:45.765944 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:45.765895 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5cbf9ccb9f-chcpz" podUID="f26efc07-2edf-44e8-a735-2773fac91ae0" containerName="console" containerID="cri-o://073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85" gracePeriod=15 Jun 02 21:41:46.020554 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.020500 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cbf9ccb9f-chcpz_f26efc07-2edf-44e8-a735-2773fac91ae0/console/0.log" Jun 02 21:41:46.020665 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.020575 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:41:46.105249 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105215 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-oauth-config\") pod \"f26efc07-2edf-44e8-a735-2773fac91ae0\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " Jun 02 21:41:46.105249 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105256 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-console-config\") pod \"f26efc07-2edf-44e8-a735-2773fac91ae0\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " Jun 02 21:41:46.105523 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105310 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cblx\" (UniqueName: \"kubernetes.io/projected/f26efc07-2edf-44e8-a735-2773fac91ae0-kube-api-access-2cblx\") pod \"f26efc07-2edf-44e8-a735-2773fac91ae0\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " Jun 02 21:41:46.105523 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105356 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-oauth-serving-cert\") pod \"f26efc07-2edf-44e8-a735-2773fac91ae0\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " Jun 02 21:41:46.105523 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105380 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-trusted-ca-bundle\") pod \"f26efc07-2edf-44e8-a735-2773fac91ae0\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " Jun 02 21:41:46.105523 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105414 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-service-ca\") pod \"f26efc07-2edf-44e8-a735-2773fac91ae0\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " Jun 02 21:41:46.105523 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105433 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-serving-cert\") pod \"f26efc07-2edf-44e8-a735-2773fac91ae0\" (UID: \"f26efc07-2edf-44e8-a735-2773fac91ae0\") " Jun 02 21:41:46.105773 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105743 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-console-config" (OuterVolumeSpecName: "console-config") pod "f26efc07-2edf-44e8-a735-2773fac91ae0" (UID: "f26efc07-2edf-44e8-a735-2773fac91ae0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:41:46.105828 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105770 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f26efc07-2edf-44e8-a735-2773fac91ae0" (UID: "f26efc07-2edf-44e8-a735-2773fac91ae0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:41:46.105882 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105826 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-service-ca" (OuterVolumeSpecName: "service-ca") pod "f26efc07-2edf-44e8-a735-2773fac91ae0" (UID: "f26efc07-2edf-44e8-a735-2773fac91ae0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:41:46.105882 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.105823 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f26efc07-2edf-44e8-a735-2773fac91ae0" (UID: "f26efc07-2edf-44e8-a735-2773fac91ae0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:41:46.107661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.107630 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f26efc07-2edf-44e8-a735-2773fac91ae0-kube-api-access-2cblx" (OuterVolumeSpecName: "kube-api-access-2cblx") pod "f26efc07-2edf-44e8-a735-2773fac91ae0" (UID: "f26efc07-2edf-44e8-a735-2773fac91ae0"). InnerVolumeSpecName "kube-api-access-2cblx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:41:46.107766 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.107672 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f26efc07-2edf-44e8-a735-2773fac91ae0" (UID: "f26efc07-2edf-44e8-a735-2773fac91ae0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:41:46.107766 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.107699 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f26efc07-2edf-44e8-a735-2773fac91ae0" (UID: "f26efc07-2edf-44e8-a735-2773fac91ae0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:41:46.205923 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.205894 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cblx\" (UniqueName: \"kubernetes.io/projected/f26efc07-2edf-44e8-a735-2773fac91ae0-kube-api-access-2cblx\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:46.205923 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.205919 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-oauth-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:46.206071 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.205935 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-trusted-ca-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:46.206071 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.205948 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-service-ca\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:46.206071 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.205960 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:46.206071 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.205972 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26efc07-2edf-44e8-a735-2773fac91ae0-console-oauth-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:46.206071 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.205986 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26efc07-2edf-44e8-a735-2773fac91ae0-console-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:41:46.768495 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.768461 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cbf9ccb9f-chcpz_f26efc07-2edf-44e8-a735-2773fac91ae0/console/0.log" Jun 02 21:41:46.768986 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.768507 2567 generic.go:358] "Generic (PLEG): container finished" podID="f26efc07-2edf-44e8-a735-2773fac91ae0" containerID="073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85" exitCode=2 Jun 02 21:41:46.768986 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.768568 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf9ccb9f-chcpz" event={"ID":"f26efc07-2edf-44e8-a735-2773fac91ae0","Type":"ContainerDied","Data":"073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85"} Jun 02 21:41:46.768986 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.768576 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf9ccb9f-chcpz" Jun 02 21:41:46.768986 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.768605 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf9ccb9f-chcpz" event={"ID":"f26efc07-2edf-44e8-a735-2773fac91ae0","Type":"ContainerDied","Data":"a8e0a26a332ac2b709cab672287943b97268867a9889f69f6c1891a292750bcd"} Jun 02 21:41:46.768986 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.768628 2567 scope.go:117] "RemoveContainer" containerID="073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85" Jun 02 21:41:46.779014 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.778997 2567 scope.go:117] "RemoveContainer" containerID="073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85" Jun 02 21:41:46.779294 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:41:46.779275 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85\": container with ID starting with 073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85 not found: ID does not exist" containerID="073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85" Jun 02 21:41:46.779359 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.779302 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85"} err="failed to get container status \"073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85\": rpc error: code = NotFound desc = could not find container \"073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85\": container with ID starting with 073a813ce360c541d1718ddc27d0c5f5c0b908340ff28f141d71e1b2dc2eea85 not found: ID does not exist" Jun 02 21:41:46.787269 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.787248 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbf9ccb9f-chcpz"] Jun 02 21:41:46.791534 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:46.791514 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cbf9ccb9f-chcpz"] Jun 02 21:41:48.127714 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:48.127679 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f26efc07-2edf-44e8-a735-2773fac91ae0" path="/var/lib/kubelet/pods/f26efc07-2edf-44e8-a735-2773fac91ae0/volumes" Jun 02 21:41:48.390547 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:48.390473 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:41:48.394245 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:41:48.394226 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55f7bb5849-fnpsb" Jun 02 21:42:28.011993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.011956 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c"] Jun 02 21:42:28.012494 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.012250 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f26efc07-2edf-44e8-a735-2773fac91ae0" containerName="console" Jun 02 21:42:28.012494 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.012261 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f26efc07-2edf-44e8-a735-2773fac91ae0" containerName="console" Jun 02 21:42:28.012494 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.012274 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a38fb14-2f9c-4fda-a273-aebd17dde3ec" containerName="console" Jun 02 21:42:28.012494 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.012280 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a38fb14-2f9c-4fda-a273-aebd17dde3ec" containerName="console" Jun 02 21:42:28.012494 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.012348 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="f26efc07-2edf-44e8-a735-2773fac91ae0" containerName="console" Jun 02 21:42:28.012494 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.012362 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a38fb14-2f9c-4fda-a273-aebd17dde3ec" containerName="console" Jun 02 21:42:28.015538 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.015515 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.019427 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.019407 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 21:42:28.019770 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.019747 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 21:42:28.019770 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.019755 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 21:42:28.019949 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.019755 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 21:42:28.019949 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.019787 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 21:42:28.020129 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.020113 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cxkgr\"" Jun 02 21:42:28.026136 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.025318 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 21:42:28.026924 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.026902 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c"] Jun 02 21:42:28.114544 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.114518 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-telemeter-client-tls\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.114659 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.114557 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fhxp\" (UniqueName: \"kubernetes.io/projected/224c3f50-5ee9-4c6f-908a-c4004df0028b-kube-api-access-8fhxp\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.114659 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.114580 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.114659 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.114627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-secret-telemeter-client\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.114659 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.114645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224c3f50-5ee9-4c6f-908a-c4004df0028b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.114791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.114661 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-federate-client-tls\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.114791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.114712 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/224c3f50-5ee9-4c6f-908a-c4004df0028b-metrics-client-ca\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.114791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.114734 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224c3f50-5ee9-4c6f-908a-c4004df0028b-serving-certs-ca-bundle\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.215225 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.215190 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224c3f50-5ee9-4c6f-908a-c4004df0028b-serving-certs-ca-bundle\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.215377 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.215247 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-telemeter-client-tls\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.215377 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.215293 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fhxp\" (UniqueName: \"kubernetes.io/projected/224c3f50-5ee9-4c6f-908a-c4004df0028b-kube-api-access-8fhxp\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.215377 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.215319 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.215553 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.215385 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-secret-telemeter-client\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.215553 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.215410 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224c3f50-5ee9-4c6f-908a-c4004df0028b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.215553 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.215435 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-federate-client-tls\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.215553 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.215472 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/224c3f50-5ee9-4c6f-908a-c4004df0028b-metrics-client-ca\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.216044 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.216020 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224c3f50-5ee9-4c6f-908a-c4004df0028b-serving-certs-ca-bundle\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.216148 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.216077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/224c3f50-5ee9-4c6f-908a-c4004df0028b-metrics-client-ca\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.216490 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.216466 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224c3f50-5ee9-4c6f-908a-c4004df0028b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.218020 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.217988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-secret-telemeter-client\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.218107 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.218030 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-telemeter-client-tls\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.218462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.218443 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-federate-client-tls\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.218538 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.218459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/224c3f50-5ee9-4c6f-908a-c4004df0028b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.223857 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.223834 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fhxp\" (UniqueName: \"kubernetes.io/projected/224c3f50-5ee9-4c6f-908a-c4004df0028b-kube-api-access-8fhxp\") pod \"telemeter-client-766cdd5bcb-2zr5c\" (UID: \"224c3f50-5ee9-4c6f-908a-c4004df0028b\") " pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.329016 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.328994 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" Jun 02 21:42:28.468034 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.468004 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c"] Jun 02 21:42:28.468503 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:42:28.468481 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224c3f50_5ee9_4c6f_908a_c4004df0028b.slice/crio-02b804f06a3c1793929adbe1aa6e1e4729e1307d4d556af49715a8867502d0ee WatchSource:0}: Error finding container 02b804f06a3c1793929adbe1aa6e1e4729e1307d4d556af49715a8867502d0ee: Status 404 returned error can't find the container with id 02b804f06a3c1793929adbe1aa6e1e4729e1307d4d556af49715a8867502d0ee Jun 02 21:42:28.893896 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:28.893854 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" event={"ID":"224c3f50-5ee9-4c6f-908a-c4004df0028b","Type":"ContainerStarted","Data":"02b804f06a3c1793929adbe1aa6e1e4729e1307d4d556af49715a8867502d0ee"} Jun 02 21:42:30.902263 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:30.902223 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" event={"ID":"224c3f50-5ee9-4c6f-908a-c4004df0028b","Type":"ContainerStarted","Data":"d8808e2f2d370ef60c4ccff56e57e9f883e1267e94c6e435bf8d26205419ad22"} Jun 02 21:42:30.902263 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:30.902265 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" event={"ID":"224c3f50-5ee9-4c6f-908a-c4004df0028b","Type":"ContainerStarted","Data":"e0f287b1d21da3777d7365eb16bd988e374c5f0eae30384775bef1a7bbe50e50"} Jun 02 21:42:30.902843 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:30.902276 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" event={"ID":"224c3f50-5ee9-4c6f-908a-c4004df0028b","Type":"ContainerStarted","Data":"e47c5d5aa8a1fca6186df14d99baed6f10dbe000e59cfcb4ae5e13581a5abaaf"} Jun 02 21:42:30.926614 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:30.926554 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-766cdd5bcb-2zr5c" podStartSLOduration=2.148035533 podStartE2EDuration="3.926535999s" podCreationTimestamp="2026-06-02 21:42:27 +0000 UTC" firstStartedPulling="2026-06-02 21:42:28.470268983 +0000 UTC m=+154.911716980" lastFinishedPulling="2026-06-02 21:42:30.248769436 +0000 UTC m=+156.690217446" observedRunningTime="2026-06-02 21:42:30.924967725 +0000 UTC m=+157.366415744" watchObservedRunningTime="2026-06-02 21:42:30.926535999 +0000 UTC m=+157.367984023" Jun 02 21:42:31.622604 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.622564 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cb4d7447-twszf"] Jun 02 21:42:31.626127 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.626107 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.642201 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.642174 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb4d7447-twszf"] Jun 02 21:42:31.742147 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.742117 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-serving-cert\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.742254 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.742153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-oauth-config\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.742254 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.742181 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-config\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.742353 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.742244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-trusted-ca-bundle\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.742353 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.742295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsxcq\" (UniqueName: \"kubernetes.io/projected/b39bd152-9d26-4d2a-be0f-c420dd0208d0-kube-api-access-lsxcq\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.742353 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.742320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-service-ca\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.742443 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.742365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-oauth-serving-cert\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.843482 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.843456 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-config\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.843592 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.843486 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-trusted-ca-bundle\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.843592 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.843511 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsxcq\" (UniqueName: \"kubernetes.io/projected/b39bd152-9d26-4d2a-be0f-c420dd0208d0-kube-api-access-lsxcq\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.843592 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.843552 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-service-ca\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.843759 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.843642 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-oauth-serving-cert\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.843759 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.843711 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-serving-cert\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.843759 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.843741 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-oauth-config\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.844214 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.844182 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-config\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.844447 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.844422 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-oauth-serving-cert\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.844447 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.844434 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-trusted-ca-bundle\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.844583 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.844457 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-service-ca\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.846042 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.846019 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-oauth-config\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.846311 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.846289 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-serving-cert\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.855234 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.855215 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsxcq\" (UniqueName: \"kubernetes.io/projected/b39bd152-9d26-4d2a-be0f-c420dd0208d0-kube-api-access-lsxcq\") pod \"console-6cb4d7447-twszf\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:31.936039 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:31.935988 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:32.062761 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:32.062731 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb4d7447-twszf"] Jun 02 21:42:32.065706 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:42:32.065678 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39bd152_9d26_4d2a_be0f_c420dd0208d0.slice/crio-5fb0996317bc6be20b77959d89d4229fc59db97e380faaaf3d57093192c667ca WatchSource:0}: Error finding container 5fb0996317bc6be20b77959d89d4229fc59db97e380faaaf3d57093192c667ca: Status 404 returned error can't find the container with id 5fb0996317bc6be20b77959d89d4229fc59db97e380faaaf3d57093192c667ca Jun 02 21:42:32.910238 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:32.910196 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb4d7447-twszf" event={"ID":"b39bd152-9d26-4d2a-be0f-c420dd0208d0","Type":"ContainerStarted","Data":"b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358"} Jun 02 21:42:32.910238 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:32.910238 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb4d7447-twszf" event={"ID":"b39bd152-9d26-4d2a-be0f-c420dd0208d0","Type":"ContainerStarted","Data":"5fb0996317bc6be20b77959d89d4229fc59db97e380faaaf3d57093192c667ca"} Jun 02 21:42:32.930118 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:32.930072 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6cb4d7447-twszf" podStartSLOduration=1.930060074 podStartE2EDuration="1.930060074s" podCreationTimestamp="2026-06-02 21:42:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:42:32.92828248 +0000 UTC m=+159.369730501" watchObservedRunningTime="2026-06-02 21:42:32.930060074 +0000 UTC m=+159.371508092" Jun 02 21:42:38.677653 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.677616 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb4d7447-twszf"] Jun 02 21:42:38.709343 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.709295 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-587f6fb5d5-5k2s7"] Jun 02 21:42:38.712862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.712842 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.724781 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.724758 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-587f6fb5d5-5k2s7"] Jun 02 21:42:38.800639 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.800609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-serving-cert\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.800753 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.800654 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-trusted-ca-bundle\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.800753 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.800676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-config\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.800753 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.800693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-service-ca\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.800753 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.800726 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-oauth-config\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.800753 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.800743 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-oauth-serving-cert\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.800934 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.800777 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndzc8\" (UniqueName: \"kubernetes.io/projected/6083f760-7c9b-4e96-8e69-9272cdc25aa0-kube-api-access-ndzc8\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.901979 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.901945 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndzc8\" (UniqueName: \"kubernetes.io/projected/6083f760-7c9b-4e96-8e69-9272cdc25aa0-kube-api-access-ndzc8\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.902100 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.901986 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-serving-cert\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.902100 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.902036 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-trusted-ca-bundle\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.902100 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.902069 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-config\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.902260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.902231 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-service-ca\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.902315 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.902301 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-oauth-config\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.902407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.902349 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-oauth-serving-cert\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.902856 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.902819 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-config\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.903101 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.903071 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-trusted-ca-bundle\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.903101 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.903092 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-oauth-serving-cert\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.903223 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.903092 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-service-ca\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.904719 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.904688 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-serving-cert\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.905006 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.904984 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-oauth-config\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:38.911411 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:38.911390 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndzc8\" (UniqueName: \"kubernetes.io/projected/6083f760-7c9b-4e96-8e69-9272cdc25aa0-kube-api-access-ndzc8\") pod \"console-587f6fb5d5-5k2s7\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:39.023205 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:39.023150 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:39.154132 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:39.154007 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-587f6fb5d5-5k2s7"] Jun 02 21:42:39.157690 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:42:39.157639 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6083f760_7c9b_4e96_8e69_9272cdc25aa0.slice/crio-aa97d14169a48f883993b2d229bd22963a42a1838f752dcf31fd2832fb8e4342 WatchSource:0}: Error finding container aa97d14169a48f883993b2d229bd22963a42a1838f752dcf31fd2832fb8e4342: Status 404 returned error can't find the container with id aa97d14169a48f883993b2d229bd22963a42a1838f752dcf31fd2832fb8e4342 Jun 02 21:42:39.934090 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:39.934057 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-587f6fb5d5-5k2s7" event={"ID":"6083f760-7c9b-4e96-8e69-9272cdc25aa0","Type":"ContainerStarted","Data":"4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a"} Jun 02 21:42:39.934090 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:39.934093 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-587f6fb5d5-5k2s7" event={"ID":"6083f760-7c9b-4e96-8e69-9272cdc25aa0","Type":"ContainerStarted","Data":"aa97d14169a48f883993b2d229bd22963a42a1838f752dcf31fd2832fb8e4342"} Jun 02 21:42:39.953451 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:39.953402 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-587f6fb5d5-5k2s7" podStartSLOduration=1.953384714 podStartE2EDuration="1.953384714s" podCreationTimestamp="2026-06-02 21:42:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:42:39.951718579 +0000 UTC m=+166.393166598" watchObservedRunningTime="2026-06-02 21:42:39.953384714 +0000 UTC m=+166.394832727" Jun 02 21:42:41.936108 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:41.936063 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:42:49.023817 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:49.023769 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:49.023817 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:49.023828 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:49.028726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:49.028700 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:49.966416 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:49.966385 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:42:50.016086 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:42:50.016060 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b68f6f668-c57gb"] Jun 02 21:43:03.698976 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:03.698913 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6cb4d7447-twszf" podUID="b39bd152-9d26-4d2a-be0f-c420dd0208d0" containerName="console" containerID="cri-o://b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358" gracePeriod=15 Jun 02 21:43:03.938340 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:03.938309 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cb4d7447-twszf_b39bd152-9d26-4d2a-be0f-c420dd0208d0/console/0.log" Jun 02 21:43:03.938437 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:03.938393 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:43:04.021589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.021530 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cb4d7447-twszf_b39bd152-9d26-4d2a-be0f-c420dd0208d0/console/0.log" Jun 02 21:43:04.021589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.021575 2567 generic.go:358] "Generic (PLEG): container finished" podID="b39bd152-9d26-4d2a-be0f-c420dd0208d0" containerID="b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358" exitCode=2 Jun 02 21:43:04.021740 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.021676 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb4d7447-twszf" Jun 02 21:43:04.021783 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.021670 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb4d7447-twszf" event={"ID":"b39bd152-9d26-4d2a-be0f-c420dd0208d0","Type":"ContainerDied","Data":"b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358"} Jun 02 21:43:04.021819 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.021784 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb4d7447-twszf" event={"ID":"b39bd152-9d26-4d2a-be0f-c420dd0208d0","Type":"ContainerDied","Data":"5fb0996317bc6be20b77959d89d4229fc59db97e380faaaf3d57093192c667ca"} Jun 02 21:43:04.021819 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.021800 2567 scope.go:117] "RemoveContainer" containerID="b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358" Jun 02 21:43:04.030238 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.030224 2567 scope.go:117] "RemoveContainer" containerID="b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358" Jun 02 21:43:04.030505 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:43:04.030483 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358\": container with ID starting with b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358 not found: ID does not exist" containerID="b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358" Jun 02 21:43:04.030559 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.030512 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358"} err="failed to get container status \"b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358\": rpc error: code = NotFound desc = could not find container \"b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358\": container with ID starting with b40f0209610e265a7edaa6c6e89fa7a1a20a4ac8e3932f35940bacffb533d358 not found: ID does not exist" Jun 02 21:43:04.079878 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.079857 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-config\") pod \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " Jun 02 21:43:04.079958 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.079891 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-trusted-ca-bundle\") pod \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " Jun 02 21:43:04.079958 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.079942 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-serving-cert\") pod \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " Jun 02 21:43:04.080067 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.080038 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsxcq\" (UniqueName: \"kubernetes.io/projected/b39bd152-9d26-4d2a-be0f-c420dd0208d0-kube-api-access-lsxcq\") pod \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " Jun 02 21:43:04.080122 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.080100 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-service-ca\") pod \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " Jun 02 21:43:04.080122 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.080119 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-oauth-config\") pod \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " Jun 02 21:43:04.080224 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.080135 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-oauth-serving-cert\") pod \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\" (UID: \"b39bd152-9d26-4d2a-be0f-c420dd0208d0\") " Jun 02 21:43:04.080293 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.080265 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-config" (OuterVolumeSpecName: "console-config") pod "b39bd152-9d26-4d2a-be0f-c420dd0208d0" (UID: "b39bd152-9d26-4d2a-be0f-c420dd0208d0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:04.080428 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.080399 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b39bd152-9d26-4d2a-be0f-c420dd0208d0" (UID: "b39bd152-9d26-4d2a-be0f-c420dd0208d0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:04.080500 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.080433 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:04.080567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.080544 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-service-ca" (OuterVolumeSpecName: "service-ca") pod "b39bd152-9d26-4d2a-be0f-c420dd0208d0" (UID: "b39bd152-9d26-4d2a-be0f-c420dd0208d0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:04.080664 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.080637 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b39bd152-9d26-4d2a-be0f-c420dd0208d0" (UID: "b39bd152-9d26-4d2a-be0f-c420dd0208d0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:04.082441 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.082410 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b39bd152-9d26-4d2a-be0f-c420dd0208d0" (UID: "b39bd152-9d26-4d2a-be0f-c420dd0208d0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:43:04.082684 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.082664 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b39bd152-9d26-4d2a-be0f-c420dd0208d0-kube-api-access-lsxcq" (OuterVolumeSpecName: "kube-api-access-lsxcq") pod "b39bd152-9d26-4d2a-be0f-c420dd0208d0" (UID: "b39bd152-9d26-4d2a-be0f-c420dd0208d0"). InnerVolumeSpecName "kube-api-access-lsxcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:04.082742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.082685 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b39bd152-9d26-4d2a-be0f-c420dd0208d0" (UID: "b39bd152-9d26-4d2a-be0f-c420dd0208d0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:43:04.181645 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.181624 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-service-ca\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:04.181645 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.181646 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-oauth-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:04.181759 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.181656 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-oauth-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:04.181759 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.181665 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39bd152-9d26-4d2a-be0f-c420dd0208d0-trusted-ca-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:04.181759 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.181675 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b39bd152-9d26-4d2a-be0f-c420dd0208d0-console-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:04.181759 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.181684 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsxcq\" (UniqueName: \"kubernetes.io/projected/b39bd152-9d26-4d2a-be0f-c420dd0208d0-kube-api-access-lsxcq\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:04.338064 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.338030 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb4d7447-twszf"] Jun 02 21:43:04.343304 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:04.343281 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cb4d7447-twszf"] Jun 02 21:43:06.127674 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:06.127641 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b39bd152-9d26-4d2a-be0f-c420dd0208d0" path="/var/lib/kubelet/pods/b39bd152-9d26-4d2a-be0f-c420dd0208d0/volumes" Jun 02 21:43:15.036909 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.036846 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7b68f6f668-c57gb" podUID="6fa897ba-93d2-4d6c-b408-6b0468c9568a" containerName="console" containerID="cri-o://94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6" gracePeriod=15 Jun 02 21:43:15.275284 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.275260 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b68f6f668-c57gb_6fa897ba-93d2-4d6c-b408-6b0468c9568a/console/0.log" Jun 02 21:43:15.275414 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.275319 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:43:15.364218 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364191 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-oauth-config\") pod \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " Jun 02 21:43:15.364352 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364239 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-config\") pod \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " Jun 02 21:43:15.364352 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364257 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-trusted-ca-bundle\") pod \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " Jun 02 21:43:15.364352 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364299 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-oauth-serving-cert\") pod \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " Jun 02 21:43:15.364352 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364314 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-service-ca\") pod \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " Jun 02 21:43:15.364558 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364368 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-serving-cert\") pod \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " Jun 02 21:43:15.364558 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364401 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld565\" (UniqueName: \"kubernetes.io/projected/6fa897ba-93d2-4d6c-b408-6b0468c9568a-kube-api-access-ld565\") pod \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\" (UID: \"6fa897ba-93d2-4d6c-b408-6b0468c9568a\") " Jun 02 21:43:15.364736 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364698 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-config" (OuterVolumeSpecName: "console-config") pod "6fa897ba-93d2-4d6c-b408-6b0468c9568a" (UID: "6fa897ba-93d2-4d6c-b408-6b0468c9568a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:15.364845 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364722 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6fa897ba-93d2-4d6c-b408-6b0468c9568a" (UID: "6fa897ba-93d2-4d6c-b408-6b0468c9568a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:15.364897 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364841 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6fa897ba-93d2-4d6c-b408-6b0468c9568a" (UID: "6fa897ba-93d2-4d6c-b408-6b0468c9568a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:15.364996 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.364974 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-service-ca" (OuterVolumeSpecName: "service-ca") pod "6fa897ba-93d2-4d6c-b408-6b0468c9568a" (UID: "6fa897ba-93d2-4d6c-b408-6b0468c9568a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:15.366482 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.366456 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6fa897ba-93d2-4d6c-b408-6b0468c9568a" (UID: "6fa897ba-93d2-4d6c-b408-6b0468c9568a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:43:15.366814 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.366790 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa897ba-93d2-4d6c-b408-6b0468c9568a-kube-api-access-ld565" (OuterVolumeSpecName: "kube-api-access-ld565") pod "6fa897ba-93d2-4d6c-b408-6b0468c9568a" (UID: "6fa897ba-93d2-4d6c-b408-6b0468c9568a"). InnerVolumeSpecName "kube-api-access-ld565". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:15.366887 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.366808 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6fa897ba-93d2-4d6c-b408-6b0468c9568a" (UID: "6fa897ba-93d2-4d6c-b408-6b0468c9568a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:43:15.465697 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.465649 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld565\" (UniqueName: \"kubernetes.io/projected/6fa897ba-93d2-4d6c-b408-6b0468c9568a-kube-api-access-ld565\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:15.465697 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.465693 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-oauth-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:15.465697 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.465704 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:15.465697 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.465713 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-trusted-ca-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:15.465956 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.465723 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-oauth-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:15.465956 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.465733 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa897ba-93d2-4d6c-b408-6b0468c9568a-service-ca\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:15.465956 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:15.465741 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa897ba-93d2-4d6c-b408-6b0468c9568a-console-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:43:16.062082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.062055 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b68f6f668-c57gb_6fa897ba-93d2-4d6c-b408-6b0468c9568a/console/0.log" Jun 02 21:43:16.062492 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.062099 2567 generic.go:358] "Generic (PLEG): container finished" podID="6fa897ba-93d2-4d6c-b408-6b0468c9568a" containerID="94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6" exitCode=2 Jun 02 21:43:16.062492 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.062135 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b68f6f668-c57gb" event={"ID":"6fa897ba-93d2-4d6c-b408-6b0468c9568a","Type":"ContainerDied","Data":"94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6"} Jun 02 21:43:16.062492 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.062168 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b68f6f668-c57gb" Jun 02 21:43:16.062492 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.062175 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b68f6f668-c57gb" event={"ID":"6fa897ba-93d2-4d6c-b408-6b0468c9568a","Type":"ContainerDied","Data":"ce8c8ea5536c31a5d202f9a5cba9cc39e23211b7c81ebcb2c07bdc2b1ef81132"} Jun 02 21:43:16.062492 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.062191 2567 scope.go:117] "RemoveContainer" containerID="94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6" Jun 02 21:43:16.070503 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.070483 2567 scope.go:117] "RemoveContainer" containerID="94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6" Jun 02 21:43:16.070749 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:43:16.070732 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6\": container with ID starting with 94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6 not found: ID does not exist" containerID="94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6" Jun 02 21:43:16.070812 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.070755 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6"} err="failed to get container status \"94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6\": rpc error: code = NotFound desc = could not find container \"94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6\": container with ID starting with 94555afcc5af2a763f069291461deebcb7bf47321458cdbddbd03488af4ed2a6 not found: ID does not exist" Jun 02 21:43:16.082683 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.082655 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b68f6f668-c57gb"] Jun 02 21:43:16.086570 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.086548 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b68f6f668-c57gb"] Jun 02 21:43:16.127070 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:16.127044 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fa897ba-93d2-4d6c-b408-6b0468c9568a" path="/var/lib/kubelet/pods/6fa897ba-93d2-4d6c-b408-6b0468c9568a/volumes" Jun 02 21:43:26.222198 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.222168 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ngh2s"] Jun 02 21:43:26.222614 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.222507 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b39bd152-9d26-4d2a-be0f-c420dd0208d0" containerName="console" Jun 02 21:43:26.222614 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.222520 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b39bd152-9d26-4d2a-be0f-c420dd0208d0" containerName="console" Jun 02 21:43:26.222614 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.222529 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa897ba-93d2-4d6c-b408-6b0468c9568a" containerName="console" Jun 02 21:43:26.222614 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.222534 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa897ba-93d2-4d6c-b408-6b0468c9568a" containerName="console" Jun 02 21:43:26.222614 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.222604 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="6fa897ba-93d2-4d6c-b408-6b0468c9568a" containerName="console" Jun 02 21:43:26.222614 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.222614 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="b39bd152-9d26-4d2a-be0f-c420dd0208d0" containerName="console" Jun 02 21:43:26.225607 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.225591 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.228818 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.228796 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 21:43:26.234603 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.234581 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ngh2s"] Jun 02 21:43:26.346262 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.346223 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/503ab3a6-50d9-46e7-a6a7-187bb3166894-dbus\") pod \"global-pull-secret-syncer-ngh2s\" (UID: \"503ab3a6-50d9-46e7-a6a7-187bb3166894\") " pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.346262 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.346265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/503ab3a6-50d9-46e7-a6a7-187bb3166894-kubelet-config\") pod \"global-pull-secret-syncer-ngh2s\" (UID: \"503ab3a6-50d9-46e7-a6a7-187bb3166894\") " pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.346488 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.346358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/503ab3a6-50d9-46e7-a6a7-187bb3166894-original-pull-secret\") pod \"global-pull-secret-syncer-ngh2s\" (UID: \"503ab3a6-50d9-46e7-a6a7-187bb3166894\") " pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.447623 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.447586 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/503ab3a6-50d9-46e7-a6a7-187bb3166894-original-pull-secret\") pod \"global-pull-secret-syncer-ngh2s\" (UID: \"503ab3a6-50d9-46e7-a6a7-187bb3166894\") " pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.447752 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.447646 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/503ab3a6-50d9-46e7-a6a7-187bb3166894-dbus\") pod \"global-pull-secret-syncer-ngh2s\" (UID: \"503ab3a6-50d9-46e7-a6a7-187bb3166894\") " pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.447810 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.447749 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/503ab3a6-50d9-46e7-a6a7-187bb3166894-kubelet-config\") pod \"global-pull-secret-syncer-ngh2s\" (UID: \"503ab3a6-50d9-46e7-a6a7-187bb3166894\") " pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.447810 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.447757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/503ab3a6-50d9-46e7-a6a7-187bb3166894-dbus\") pod \"global-pull-secret-syncer-ngh2s\" (UID: \"503ab3a6-50d9-46e7-a6a7-187bb3166894\") " pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.447913 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.447837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/503ab3a6-50d9-46e7-a6a7-187bb3166894-kubelet-config\") pod \"global-pull-secret-syncer-ngh2s\" (UID: \"503ab3a6-50d9-46e7-a6a7-187bb3166894\") " pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.450039 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.450018 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/503ab3a6-50d9-46e7-a6a7-187bb3166894-original-pull-secret\") pod \"global-pull-secret-syncer-ngh2s\" (UID: \"503ab3a6-50d9-46e7-a6a7-187bb3166894\") " pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.535031 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.534983 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngh2s" Jun 02 21:43:26.663780 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:26.663750 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ngh2s"] Jun 02 21:43:26.667277 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:43:26.667249 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503ab3a6_50d9_46e7_a6a7_187bb3166894.slice/crio-a2c389c62888e7e19c879d829f069c6af82c25613c8b8594c9780feed8bd709a WatchSource:0}: Error finding container a2c389c62888e7e19c879d829f069c6af82c25613c8b8594c9780feed8bd709a: Status 404 returned error can't find the container with id a2c389c62888e7e19c879d829f069c6af82c25613c8b8594c9780feed8bd709a Jun 02 21:43:27.096693 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:27.096654 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ngh2s" event={"ID":"503ab3a6-50d9-46e7-a6a7-187bb3166894","Type":"ContainerStarted","Data":"a2c389c62888e7e19c879d829f069c6af82c25613c8b8594c9780feed8bd709a"} Jun 02 21:43:31.109083 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:31.109050 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ngh2s" event={"ID":"503ab3a6-50d9-46e7-a6a7-187bb3166894","Type":"ContainerStarted","Data":"d461e2bff3f971fa95d171b78e656dc29f238890001a292fc23c145f76da7926"} Jun 02 21:43:52.448440 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.448358 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ngh2s" podStartSLOduration=22.200488142 podStartE2EDuration="26.448342091s" podCreationTimestamp="2026-06-02 21:43:26 +0000 UTC" firstStartedPulling="2026-06-02 21:43:26.668914961 +0000 UTC m=+213.110362960" lastFinishedPulling="2026-06-02 21:43:30.916768912 +0000 UTC m=+217.358216909" observedRunningTime="2026-06-02 21:43:31.141525087 +0000 UTC m=+217.582973118" watchObservedRunningTime="2026-06-02 21:43:52.448342091 +0000 UTC m=+238.889790140" Jun 02 21:43:52.448907 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.448612 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b"] Jun 02 21:43:52.452255 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.452238 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.455307 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.455276 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j4swd\"" Jun 02 21:43:52.455307 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.455279 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:43:52.455501 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.455283 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:43:52.461198 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.461171 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b"] Jun 02 21:43:52.568932 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.568898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2pxg\" (UniqueName: \"kubernetes.io/projected/08f4465a-225b-4109-92c6-aeb930498887-kube-api-access-s2pxg\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.569115 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.568967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.569115 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.569026 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.670398 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.670365 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.670398 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.670408 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.670610 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.670468 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2pxg\" (UniqueName: \"kubernetes.io/projected/08f4465a-225b-4109-92c6-aeb930498887-kube-api-access-s2pxg\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.670788 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.670769 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.670823 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.670790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.680349 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.680296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2pxg\" (UniqueName: \"kubernetes.io/projected/08f4465a-225b-4109-92c6-aeb930498887-kube-api-access-s2pxg\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.762261 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.762160 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:43:52.893267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:52.893224 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b"] Jun 02 21:43:52.899275 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:43:52.899248 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f4465a_225b_4109_92c6_aeb930498887.slice/crio-7928382d3b30da9713b1f474a877ad4374293539815d7b7031ef6341edac46f7 WatchSource:0}: Error finding container 7928382d3b30da9713b1f474a877ad4374293539815d7b7031ef6341edac46f7: Status 404 returned error can't find the container with id 7928382d3b30da9713b1f474a877ad4374293539815d7b7031ef6341edac46f7 Jun 02 21:43:53.174392 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:53.174347 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" event={"ID":"08f4465a-225b-4109-92c6-aeb930498887","Type":"ContainerStarted","Data":"7928382d3b30da9713b1f474a877ad4374293539815d7b7031ef6341edac46f7"} Jun 02 21:43:59.193913 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:59.193873 2567 generic.go:358] "Generic (PLEG): container finished" podID="08f4465a-225b-4109-92c6-aeb930498887" containerID="1db85cd8dbd058f7f33295ae7d722952e89d472824456126ed3cd127d3a9fb58" exitCode=0 Jun 02 21:43:59.194403 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:43:59.193964 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" event={"ID":"08f4465a-225b-4109-92c6-aeb930498887","Type":"ContainerDied","Data":"1db85cd8dbd058f7f33295ae7d722952e89d472824456126ed3cd127d3a9fb58"} Jun 02 21:44:02.204758 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:02.204722 2567 generic.go:358] "Generic (PLEG): container finished" podID="08f4465a-225b-4109-92c6-aeb930498887" containerID="e3a88f82b08d4ffdc6d466aabad498498c42b026fa1fae8d8f1b8ed3bfff412c" exitCode=0 Jun 02 21:44:02.205138 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:02.204774 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" event={"ID":"08f4465a-225b-4109-92c6-aeb930498887","Type":"ContainerDied","Data":"e3a88f82b08d4ffdc6d466aabad498498c42b026fa1fae8d8f1b8ed3bfff412c"} Jun 02 21:44:10.241729 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:10.241649 2567 generic.go:358] "Generic (PLEG): container finished" podID="08f4465a-225b-4109-92c6-aeb930498887" containerID="335f8ab1c8c443dd1fae313a60f5269dc01aee95b2efe6fde47c018f882b7d90" exitCode=0 Jun 02 21:44:10.242096 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:10.241734 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" event={"ID":"08f4465a-225b-4109-92c6-aeb930498887","Type":"ContainerDied","Data":"335f8ab1c8c443dd1fae313a60f5269dc01aee95b2efe6fde47c018f882b7d90"} Jun 02 21:44:11.368232 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.368205 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:44:11.429516 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.429482 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2pxg\" (UniqueName: \"kubernetes.io/projected/08f4465a-225b-4109-92c6-aeb930498887-kube-api-access-s2pxg\") pod \"08f4465a-225b-4109-92c6-aeb930498887\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " Jun 02 21:44:11.429707 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.429597 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-bundle\") pod \"08f4465a-225b-4109-92c6-aeb930498887\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " Jun 02 21:44:11.429707 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.429625 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-util\") pod \"08f4465a-225b-4109-92c6-aeb930498887\" (UID: \"08f4465a-225b-4109-92c6-aeb930498887\") " Jun 02 21:44:11.430267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.430240 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-bundle" (OuterVolumeSpecName: "bundle") pod "08f4465a-225b-4109-92c6-aeb930498887" (UID: "08f4465a-225b-4109-92c6-aeb930498887"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:44:11.431726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.431694 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f4465a-225b-4109-92c6-aeb930498887-kube-api-access-s2pxg" (OuterVolumeSpecName: "kube-api-access-s2pxg") pod "08f4465a-225b-4109-92c6-aeb930498887" (UID: "08f4465a-225b-4109-92c6-aeb930498887"). InnerVolumeSpecName "kube-api-access-s2pxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:44:11.434117 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.434091 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-util" (OuterVolumeSpecName: "util") pod "08f4465a-225b-4109-92c6-aeb930498887" (UID: "08f4465a-225b-4109-92c6-aeb930498887"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:44:11.530433 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.530351 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2pxg\" (UniqueName: \"kubernetes.io/projected/08f4465a-225b-4109-92c6-aeb930498887-kube-api-access-s2pxg\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:44:11.530433 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.530379 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:44:11.530433 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:11.530389 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f4465a-225b-4109-92c6-aeb930498887-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:44:12.248236 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:12.248207 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" Jun 02 21:44:12.248236 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:12.248213 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgrm8b" event={"ID":"08f4465a-225b-4109-92c6-aeb930498887","Type":"ContainerDied","Data":"7928382d3b30da9713b1f474a877ad4374293539815d7b7031ef6341edac46f7"} Jun 02 21:44:12.248236 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:12.248244 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7928382d3b30da9713b1f474a877ad4374293539815d7b7031ef6341edac46f7" Jun 02 21:44:15.478509 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.478475 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v"] Jun 02 21:44:15.478862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.478801 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f4465a-225b-4109-92c6-aeb930498887" containerName="extract" Jun 02 21:44:15.478862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.478813 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f4465a-225b-4109-92c6-aeb930498887" containerName="extract" Jun 02 21:44:15.478862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.478827 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f4465a-225b-4109-92c6-aeb930498887" containerName="util" Jun 02 21:44:15.478862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.478832 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f4465a-225b-4109-92c6-aeb930498887" containerName="util" Jun 02 21:44:15.478862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.478842 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f4465a-225b-4109-92c6-aeb930498887" containerName="pull" Jun 02 21:44:15.478862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.478847 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f4465a-225b-4109-92c6-aeb930498887" containerName="pull" Jun 02 21:44:15.479042 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.478904 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="08f4465a-225b-4109-92c6-aeb930498887" containerName="extract" Jun 02 21:44:15.483078 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.483062 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" Jun 02 21:44:15.486223 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.486197 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:44:15.486405 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.486388 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lwv2t\"" Jun 02 21:44:15.486480 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.486427 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 21:44:15.494252 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.494231 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v"] Jun 02 21:44:15.564210 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.564171 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-hlm8v\" (UID: \"8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" Jun 02 21:44:15.564405 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.564217 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2pk\" (UniqueName: \"kubernetes.io/projected/8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b-kube-api-access-jt2pk\") pod \"cert-manager-operator-controller-manager-54b9655956-hlm8v\" (UID: \"8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" Jun 02 21:44:15.664869 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.664833 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-hlm8v\" (UID: \"8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" Jun 02 21:44:15.665022 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.664873 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2pk\" (UniqueName: \"kubernetes.io/projected/8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b-kube-api-access-jt2pk\") pod \"cert-manager-operator-controller-manager-54b9655956-hlm8v\" (UID: \"8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" Jun 02 21:44:15.665187 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.665165 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-hlm8v\" (UID: \"8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" Jun 02 21:44:15.673749 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.673724 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2pk\" (UniqueName: \"kubernetes.io/projected/8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b-kube-api-access-jt2pk\") pod \"cert-manager-operator-controller-manager-54b9655956-hlm8v\" (UID: \"8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" Jun 02 21:44:15.793002 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.792921 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" Jun 02 21:44:15.925194 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:15.925169 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v"] Jun 02 21:44:15.928379 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:44:15.928350 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd1d43d_116d_44aa_b2e4_ed4cfed72f2b.slice/crio-5f2b83454301b99382e73fe5fdce4fa798adc408930dd63a86e67dbfec22f14b WatchSource:0}: Error finding container 5f2b83454301b99382e73fe5fdce4fa798adc408930dd63a86e67dbfec22f14b: Status 404 returned error can't find the container with id 5f2b83454301b99382e73fe5fdce4fa798adc408930dd63a86e67dbfec22f14b Jun 02 21:44:16.261951 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:16.261915 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" event={"ID":"8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b","Type":"ContainerStarted","Data":"5f2b83454301b99382e73fe5fdce4fa798adc408930dd63a86e67dbfec22f14b"} Jun 02 21:44:18.270871 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:18.270834 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" event={"ID":"8fd1d43d-116d-44aa-b2e4-ed4cfed72f2b","Type":"ContainerStarted","Data":"902197f731be63bd6db121e7b82f5e1aed383da8f1f2dea35b420ff7d091f1b7"} Jun 02 21:44:18.308812 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:18.308759 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hlm8v" podStartSLOduration=1.662351358 podStartE2EDuration="3.308742471s" podCreationTimestamp="2026-06-02 21:44:15 +0000 UTC" firstStartedPulling="2026-06-02 21:44:15.93070854 +0000 UTC m=+262.372156538" lastFinishedPulling="2026-06-02 21:44:17.577099653 +0000 UTC m=+264.018547651" observedRunningTime="2026-06-02 21:44:18.308635011 +0000 UTC m=+264.750083030" watchObservedRunningTime="2026-06-02 21:44:18.308742471 +0000 UTC m=+264.750190490" Jun 02 21:44:19.621812 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.621776 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p"] Jun 02 21:44:19.625407 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.625390 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.628559 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.628538 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:44:19.628811 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.628794 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j4swd\"" Jun 02 21:44:19.629840 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.629825 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:44:19.634031 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.634007 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p"] Jun 02 21:44:19.702823 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.702776 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j477w\" (UniqueName: \"kubernetes.io/projected/8e57a466-4756-4eab-857d-22299d08d2a6-kube-api-access-j477w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.702823 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.702821 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.703041 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.702847 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.803857 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.803802 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j477w\" (UniqueName: \"kubernetes.io/projected/8e57a466-4756-4eab-857d-22299d08d2a6-kube-api-access-j477w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.804064 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.803873 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.804064 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.803914 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.804257 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.804233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.804359 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.804287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.813514 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.813487 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j477w\" (UniqueName: \"kubernetes.io/projected/8e57a466-4756-4eab-857d-22299d08d2a6-kube-api-access-j477w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:19.934460 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:19.934373 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:20.077165 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:20.077142 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p"] Jun 02 21:44:20.079040 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:44:20.079011 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e57a466_4756_4eab_857d_22299d08d2a6.slice/crio-8bdca5cfbf8624fa06e94db3917b2a953a09fa0952ad149946b9f76a112926db WatchSource:0}: Error finding container 8bdca5cfbf8624fa06e94db3917b2a953a09fa0952ad149946b9f76a112926db: Status 404 returned error can't find the container with id 8bdca5cfbf8624fa06e94db3917b2a953a09fa0952ad149946b9f76a112926db Jun 02 21:44:20.278304 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:20.278260 2567 generic.go:358] "Generic (PLEG): container finished" podID="8e57a466-4756-4eab-857d-22299d08d2a6" containerID="5d75116228be11363819fb5632d3de76be9362697c26016fed2344b8f2299a1a" exitCode=0 Jun 02 21:44:20.278469 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:20.278304 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" event={"ID":"8e57a466-4756-4eab-857d-22299d08d2a6","Type":"ContainerDied","Data":"5d75116228be11363819fb5632d3de76be9362697c26016fed2344b8f2299a1a"} Jun 02 21:44:20.278469 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:20.278356 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" event={"ID":"8e57a466-4756-4eab-857d-22299d08d2a6","Type":"ContainerStarted","Data":"8bdca5cfbf8624fa06e94db3917b2a953a09fa0952ad149946b9f76a112926db"} Jun 02 21:44:22.287691 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.287651 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" event={"ID":"8e57a466-4756-4eab-857d-22299d08d2a6","Type":"ContainerStarted","Data":"b1a4231c9217a1a5df55b35514682cb8dc1c8f46ad232d7ebc29f49aac691e57"} Jun 02 21:44:22.388395 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.388362 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-xrkdt"] Jun 02 21:44:22.391676 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.391661 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" Jun 02 21:44:22.394447 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.394423 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 21:44:22.394588 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.394570 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-t2mk7\"" Jun 02 21:44:22.394663 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.394612 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 21:44:22.401939 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.401917 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-xrkdt"] Jun 02 21:44:22.426579 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.426551 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-xrkdt\" (UID: \"48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" Jun 02 21:44:22.426669 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.426623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vpqh\" (UniqueName: \"kubernetes.io/projected/48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e-kube-api-access-8vpqh\") pod \"cert-manager-cainjector-68b757865b-xrkdt\" (UID: \"48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" Jun 02 21:44:22.527913 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.527837 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vpqh\" (UniqueName: \"kubernetes.io/projected/48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e-kube-api-access-8vpqh\") pod \"cert-manager-cainjector-68b757865b-xrkdt\" (UID: \"48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" Jun 02 21:44:22.527913 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.527898 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-xrkdt\" (UID: \"48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" Jun 02 21:44:22.536275 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.536243 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-xrkdt\" (UID: \"48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" Jun 02 21:44:22.539955 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.539928 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vpqh\" (UniqueName: \"kubernetes.io/projected/48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e-kube-api-access-8vpqh\") pod \"cert-manager-cainjector-68b757865b-xrkdt\" (UID: \"48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" Jun 02 21:44:22.709456 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.709415 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" Jun 02 21:44:22.832976 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:22.832944 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-xrkdt"] Jun 02 21:44:22.837275 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:44:22.837250 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48b9a3aa_cc62_4274_95e3_b3e0ccdfef6e.slice/crio-d50f113eb20fc50b75bcbdc4437b2d5ea004e370581de1e032659cde12a02953 WatchSource:0}: Error finding container d50f113eb20fc50b75bcbdc4437b2d5ea004e370581de1e032659cde12a02953: Status 404 returned error can't find the container with id d50f113eb20fc50b75bcbdc4437b2d5ea004e370581de1e032659cde12a02953 Jun 02 21:44:23.292762 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.292727 2567 generic.go:358] "Generic (PLEG): container finished" podID="8e57a466-4756-4eab-857d-22299d08d2a6" containerID="b1a4231c9217a1a5df55b35514682cb8dc1c8f46ad232d7ebc29f49aac691e57" exitCode=0 Jun 02 21:44:23.293195 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.292809 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" event={"ID":"8e57a466-4756-4eab-857d-22299d08d2a6","Type":"ContainerDied","Data":"b1a4231c9217a1a5df55b35514682cb8dc1c8f46ad232d7ebc29f49aac691e57"} Jun 02 21:44:23.293916 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.293895 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" event={"ID":"48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e","Type":"ContainerStarted","Data":"d50f113eb20fc50b75bcbdc4437b2d5ea004e370581de1e032659cde12a02953"} Jun 02 21:44:23.779805 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.779767 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jhsmf"] Jun 02 21:44:23.783396 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.783372 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:23.786067 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.786043 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9njcx\"" Jun 02 21:44:23.790077 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.790044 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jhsmf"] Jun 02 21:44:23.839013 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.838982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg9n6\" (UniqueName: \"kubernetes.io/projected/1fafe07c-337b-47e9-ac69-942484ea9283-kube-api-access-gg9n6\") pod \"cert-manager-webhook-587ccfb98-jhsmf\" (UID: \"1fafe07c-337b-47e9-ac69-942484ea9283\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:23.839153 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.839043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1fafe07c-337b-47e9-ac69-942484ea9283-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jhsmf\" (UID: \"1fafe07c-337b-47e9-ac69-942484ea9283\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:23.939768 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.939731 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gg9n6\" (UniqueName: \"kubernetes.io/projected/1fafe07c-337b-47e9-ac69-942484ea9283-kube-api-access-gg9n6\") pod \"cert-manager-webhook-587ccfb98-jhsmf\" (UID: \"1fafe07c-337b-47e9-ac69-942484ea9283\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:23.939941 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.939788 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1fafe07c-337b-47e9-ac69-942484ea9283-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jhsmf\" (UID: \"1fafe07c-337b-47e9-ac69-942484ea9283\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:23.948977 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.948949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1fafe07c-337b-47e9-ac69-942484ea9283-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jhsmf\" (UID: \"1fafe07c-337b-47e9-ac69-942484ea9283\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:23.949171 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:23.949143 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg9n6\" (UniqueName: \"kubernetes.io/projected/1fafe07c-337b-47e9-ac69-942484ea9283-kube-api-access-gg9n6\") pod \"cert-manager-webhook-587ccfb98-jhsmf\" (UID: \"1fafe07c-337b-47e9-ac69-942484ea9283\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:24.095750 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:24.095722 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:24.225542 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:24.225516 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jhsmf"] Jun 02 21:44:24.227590 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:44:24.227560 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fafe07c_337b_47e9_ac69_942484ea9283.slice/crio-edb5956cd595bc533bb010a558adec50b7821672dbc41957148456a2afbe9264 WatchSource:0}: Error finding container edb5956cd595bc533bb010a558adec50b7821672dbc41957148456a2afbe9264: Status 404 returned error can't find the container with id edb5956cd595bc533bb010a558adec50b7821672dbc41957148456a2afbe9264 Jun 02 21:44:24.298386 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:24.298351 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" event={"ID":"1fafe07c-337b-47e9-ac69-942484ea9283","Type":"ContainerStarted","Data":"edb5956cd595bc533bb010a558adec50b7821672dbc41957148456a2afbe9264"} Jun 02 21:44:24.300180 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:24.300155 2567 generic.go:358] "Generic (PLEG): container finished" podID="8e57a466-4756-4eab-857d-22299d08d2a6" containerID="e5e363ba6557c2070b1db24fa755065bfba47819e3e929d1278d96bb5deb8985" exitCode=0 Jun 02 21:44:24.300276 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:24.300195 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" event={"ID":"8e57a466-4756-4eab-857d-22299d08d2a6","Type":"ContainerDied","Data":"e5e363ba6557c2070b1db24fa755065bfba47819e3e929d1278d96bb5deb8985"} Jun 02 21:44:25.868776 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:25.868748 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:25.958655 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:25.958626 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-util\") pod \"8e57a466-4756-4eab-857d-22299d08d2a6\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " Jun 02 21:44:25.958777 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:25.958696 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-bundle\") pod \"8e57a466-4756-4eab-857d-22299d08d2a6\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " Jun 02 21:44:25.958831 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:25.958803 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j477w\" (UniqueName: \"kubernetes.io/projected/8e57a466-4756-4eab-857d-22299d08d2a6-kube-api-access-j477w\") pod \"8e57a466-4756-4eab-857d-22299d08d2a6\" (UID: \"8e57a466-4756-4eab-857d-22299d08d2a6\") " Jun 02 21:44:25.959154 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:25.959115 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-bundle" (OuterVolumeSpecName: "bundle") pod "8e57a466-4756-4eab-857d-22299d08d2a6" (UID: "8e57a466-4756-4eab-857d-22299d08d2a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:44:25.961038 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:25.961004 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e57a466-4756-4eab-857d-22299d08d2a6-kube-api-access-j477w" (OuterVolumeSpecName: "kube-api-access-j477w") pod "8e57a466-4756-4eab-857d-22299d08d2a6" (UID: "8e57a466-4756-4eab-857d-22299d08d2a6"). InnerVolumeSpecName "kube-api-access-j477w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:44:25.962914 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:25.962885 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-util" (OuterVolumeSpecName: "util") pod "8e57a466-4756-4eab-857d-22299d08d2a6" (UID: "8e57a466-4756-4eab-857d-22299d08d2a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:44:26.060589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.060507 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j477w\" (UniqueName: \"kubernetes.io/projected/8e57a466-4756-4eab-857d-22299d08d2a6-kube-api-access-j477w\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:44:26.060589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.060546 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:44:26.060589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.060561 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e57a466-4756-4eab-857d-22299d08d2a6-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:44:26.309718 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.309674 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" event={"ID":"8e57a466-4756-4eab-857d-22299d08d2a6","Type":"ContainerDied","Data":"8bdca5cfbf8624fa06e94db3917b2a953a09fa0952ad149946b9f76a112926db"} Jun 02 21:44:26.309718 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.309719 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bdca5cfbf8624fa06e94db3917b2a953a09fa0952ad149946b9f76a112926db" Jun 02 21:44:26.309718 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.309721 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpcx2p" Jun 02 21:44:26.311305 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.311277 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" event={"ID":"1fafe07c-337b-47e9-ac69-942484ea9283","Type":"ContainerStarted","Data":"342f823cb5f6aa81dfbd37e8a39486fe3c829b610a746bb5ccdb168bb29e717e"} Jun 02 21:44:26.311460 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.311373 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:26.312956 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.312929 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" event={"ID":"48b9a3aa-cc62-4274-95e3-b3e0ccdfef6e","Type":"ContainerStarted","Data":"164eca3bb2e08219c363b39767238c2274ee952f3fcd1f9f06549a8e1e6dbb02"} Jun 02 21:44:26.330563 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.330521 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" podStartSLOduration=1.618202927 podStartE2EDuration="3.330509924s" podCreationTimestamp="2026-06-02 21:44:23 +0000 UTC" firstStartedPulling="2026-06-02 21:44:24.229578137 +0000 UTC m=+270.671026133" lastFinishedPulling="2026-06-02 21:44:25.941885133 +0000 UTC m=+272.383333130" observedRunningTime="2026-06-02 21:44:26.329658799 +0000 UTC m=+272.771106818" watchObservedRunningTime="2026-06-02 21:44:26.330509924 +0000 UTC m=+272.771957943" Jun 02 21:44:26.350281 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:26.350239 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-xrkdt" podStartSLOduration=1.253470025 podStartE2EDuration="4.350227404s" podCreationTimestamp="2026-06-02 21:44:22 +0000 UTC" firstStartedPulling="2026-06-02 21:44:22.839057946 +0000 UTC m=+269.280505943" lastFinishedPulling="2026-06-02 21:44:25.935815325 +0000 UTC m=+272.377263322" observedRunningTime="2026-06-02 21:44:26.34966872 +0000 UTC m=+272.791116740" watchObservedRunningTime="2026-06-02 21:44:26.350227404 +0000 UTC m=+272.791675422" Jun 02 21:44:32.319795 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.319748 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jhsmf" Jun 02 21:44:32.787194 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.787115 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2"] Jun 02 21:44:32.787473 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.787453 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e57a466-4756-4eab-857d-22299d08d2a6" containerName="pull" Jun 02 21:44:32.787522 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.787475 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e57a466-4756-4eab-857d-22299d08d2a6" containerName="pull" Jun 02 21:44:32.787522 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.787490 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e57a466-4756-4eab-857d-22299d08d2a6" containerName="util" Jun 02 21:44:32.787522 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.787495 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e57a466-4756-4eab-857d-22299d08d2a6" containerName="util" Jun 02 21:44:32.787522 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.787505 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e57a466-4756-4eab-857d-22299d08d2a6" containerName="extract" Jun 02 21:44:32.787522 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.787510 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e57a466-4756-4eab-857d-22299d08d2a6" containerName="extract" Jun 02 21:44:32.787672 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.787571 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e57a466-4756-4eab-857d-22299d08d2a6" containerName="extract" Jun 02 21:44:32.811783 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.811744 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2"] Jun 02 21:44:32.811961 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.811859 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" Jun 02 21:44:32.815198 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.815175 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:44:32.815401 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.815268 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 21:44:32.815401 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.815269 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zxctf\"" Jun 02 21:44:32.919181 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.919150 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qth\" (UniqueName: \"kubernetes.io/projected/1e15cbf3-d60a-4533-b28a-0a8e6ac81d12-kube-api-access-92qth\") pod \"openshift-lws-operator-bfc7f696d-s7nk2\" (UID: \"1e15cbf3-d60a-4533-b28a-0a8e6ac81d12\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" Jun 02 21:44:32.919181 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:32.919186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e15cbf3-d60a-4533-b28a-0a8e6ac81d12-tmp\") pod \"openshift-lws-operator-bfc7f696d-s7nk2\" (UID: \"1e15cbf3-d60a-4533-b28a-0a8e6ac81d12\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" Jun 02 21:44:33.019702 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:33.019667 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92qth\" (UniqueName: \"kubernetes.io/projected/1e15cbf3-d60a-4533-b28a-0a8e6ac81d12-kube-api-access-92qth\") pod \"openshift-lws-operator-bfc7f696d-s7nk2\" (UID: \"1e15cbf3-d60a-4533-b28a-0a8e6ac81d12\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" Jun 02 21:44:33.019702 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:33.019706 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e15cbf3-d60a-4533-b28a-0a8e6ac81d12-tmp\") pod \"openshift-lws-operator-bfc7f696d-s7nk2\" (UID: \"1e15cbf3-d60a-4533-b28a-0a8e6ac81d12\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" Jun 02 21:44:33.020036 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:33.020019 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e15cbf3-d60a-4533-b28a-0a8e6ac81d12-tmp\") pod \"openshift-lws-operator-bfc7f696d-s7nk2\" (UID: \"1e15cbf3-d60a-4533-b28a-0a8e6ac81d12\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" Jun 02 21:44:33.028868 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:33.028842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qth\" (UniqueName: \"kubernetes.io/projected/1e15cbf3-d60a-4533-b28a-0a8e6ac81d12-kube-api-access-92qth\") pod \"openshift-lws-operator-bfc7f696d-s7nk2\" (UID: \"1e15cbf3-d60a-4533-b28a-0a8e6ac81d12\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" Jun 02 21:44:33.121576 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:33.121543 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" Jun 02 21:44:33.250508 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:33.250483 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2"] Jun 02 21:44:33.252942 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:44:33.252905 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e15cbf3_d60a_4533_b28a_0a8e6ac81d12.slice/crio-f65c9fd2dd4765a2669395fd19c9b929872b982adc50da07e494d0c2de8bc36f WatchSource:0}: Error finding container f65c9fd2dd4765a2669395fd19c9b929872b982adc50da07e494d0c2de8bc36f: Status 404 returned error can't find the container with id f65c9fd2dd4765a2669395fd19c9b929872b982adc50da07e494d0c2de8bc36f Jun 02 21:44:33.337612 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:33.337577 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" event={"ID":"1e15cbf3-d60a-4533-b28a-0a8e6ac81d12","Type":"ContainerStarted","Data":"f65c9fd2dd4765a2669395fd19c9b929872b982adc50da07e494d0c2de8bc36f"} Jun 02 21:44:36.349287 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:36.349241 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" event={"ID":"1e15cbf3-d60a-4533-b28a-0a8e6ac81d12","Type":"ContainerStarted","Data":"488a471f5fdaba6798cd781c1c91ad21cbc71426f05ce2a98e84d48731a0d502"} Jun 02 21:44:36.366218 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:36.366164 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-s7nk2" podStartSLOduration=1.78481212 podStartE2EDuration="4.366149162s" podCreationTimestamp="2026-06-02 21:44:32 +0000 UTC" firstStartedPulling="2026-06-02 21:44:33.254425342 +0000 UTC m=+279.695873339" lastFinishedPulling="2026-06-02 21:44:35.835762364 +0000 UTC m=+282.277210381" observedRunningTime="2026-06-02 21:44:36.365383845 +0000 UTC m=+282.806831867" watchObservedRunningTime="2026-06-02 21:44:36.366149162 +0000 UTC m=+282.807597180" Jun 02 21:44:38.605510 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.605480 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq"] Jun 02 21:44:38.627795 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.627769 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq"] Jun 02 21:44:38.627933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.627888 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.631299 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.631279 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:44:38.631443 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.631303 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:44:38.631523 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.631483 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j4swd\"" Jun 02 21:44:38.771183 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.771154 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.771357 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.771192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bshg\" (UniqueName: \"kubernetes.io/projected/1e87b5ba-ad10-44cb-85ee-44efaacaa891-kube-api-access-2bshg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.771357 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.771225 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.871701 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.871624 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.871701 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.871669 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bshg\" (UniqueName: \"kubernetes.io/projected/1e87b5ba-ad10-44cb-85ee-44efaacaa891-kube-api-access-2bshg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.871894 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.871708 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.872075 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.872052 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.872075 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.872068 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.880882 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.880852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bshg\" (UniqueName: \"kubernetes.io/projected/1e87b5ba-ad10-44cb-85ee-44efaacaa891-kube-api-access-2bshg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:38.937644 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:38.937614 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:39.098178 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.098139 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq"] Jun 02 21:44:39.100357 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:44:39.100307 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e87b5ba_ad10_44cb_85ee_44efaacaa891.slice/crio-cb153d2ef1a1b580f24966cb6e8ed78215b07a7ad9da04ca4ccf3d14da2cd5db WatchSource:0}: Error finding container cb153d2ef1a1b580f24966cb6e8ed78215b07a7ad9da04ca4ccf3d14da2cd5db: Status 404 returned error can't find the container with id cb153d2ef1a1b580f24966cb6e8ed78215b07a7ad9da04ca4ccf3d14da2cd5db Jun 02 21:44:39.360741 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.360710 2567 generic.go:358] "Generic (PLEG): container finished" podID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerID="725cd3faf2d550c7f9f445629de1de8cbe3ed85fb41405468b7d7a1b2465ce7f" exitCode=0 Jun 02 21:44:39.360910 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.360798 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" event={"ID":"1e87b5ba-ad10-44cb-85ee-44efaacaa891","Type":"ContainerDied","Data":"725cd3faf2d550c7f9f445629de1de8cbe3ed85fb41405468b7d7a1b2465ce7f"} Jun 02 21:44:39.360910 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.360844 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" event={"ID":"1e87b5ba-ad10-44cb-85ee-44efaacaa891","Type":"ContainerStarted","Data":"cb153d2ef1a1b580f24966cb6e8ed78215b07a7ad9da04ca4ccf3d14da2cd5db"} Jun 02 21:44:39.459502 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.459412 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-7drbd"] Jun 02 21:44:39.482434 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.482402 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-7drbd"] Jun 02 21:44:39.482593 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.482518 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-7drbd" Jun 02 21:44:39.485364 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.485316 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6lqd8\"" Jun 02 21:44:39.577535 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.577508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/176534e3-60d8-4fb9-82ec-7124d885af9c-bound-sa-token\") pod \"cert-manager-79c8d999ff-7drbd\" (UID: \"176534e3-60d8-4fb9-82ec-7124d885af9c\") " pod="cert-manager/cert-manager-79c8d999ff-7drbd" Jun 02 21:44:39.577662 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.577572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7f2m\" (UniqueName: \"kubernetes.io/projected/176534e3-60d8-4fb9-82ec-7124d885af9c-kube-api-access-z7f2m\") pod \"cert-manager-79c8d999ff-7drbd\" (UID: \"176534e3-60d8-4fb9-82ec-7124d885af9c\") " pod="cert-manager/cert-manager-79c8d999ff-7drbd" Jun 02 21:44:39.678808 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.678762 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7f2m\" (UniqueName: \"kubernetes.io/projected/176534e3-60d8-4fb9-82ec-7124d885af9c-kube-api-access-z7f2m\") pod \"cert-manager-79c8d999ff-7drbd\" (UID: \"176534e3-60d8-4fb9-82ec-7124d885af9c\") " pod="cert-manager/cert-manager-79c8d999ff-7drbd" Jun 02 21:44:39.679193 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.678862 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/176534e3-60d8-4fb9-82ec-7124d885af9c-bound-sa-token\") pod \"cert-manager-79c8d999ff-7drbd\" (UID: \"176534e3-60d8-4fb9-82ec-7124d885af9c\") " pod="cert-manager/cert-manager-79c8d999ff-7drbd" Jun 02 21:44:39.690532 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.690498 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/176534e3-60d8-4fb9-82ec-7124d885af9c-bound-sa-token\") pod \"cert-manager-79c8d999ff-7drbd\" (UID: \"176534e3-60d8-4fb9-82ec-7124d885af9c\") " pod="cert-manager/cert-manager-79c8d999ff-7drbd" Jun 02 21:44:39.690651 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.690603 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7f2m\" (UniqueName: \"kubernetes.io/projected/176534e3-60d8-4fb9-82ec-7124d885af9c-kube-api-access-z7f2m\") pod \"cert-manager-79c8d999ff-7drbd\" (UID: \"176534e3-60d8-4fb9-82ec-7124d885af9c\") " pod="cert-manager/cert-manager-79c8d999ff-7drbd" Jun 02 21:44:39.792769 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.792704 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-7drbd" Jun 02 21:44:39.918711 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:39.918674 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-7drbd"] Jun 02 21:44:39.920299 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:44:39.920270 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod176534e3_60d8_4fb9_82ec_7124d885af9c.slice/crio-89fcf55e15147971a6649486670132380c97c41647bfba7be3303000476c061e WatchSource:0}: Error finding container 89fcf55e15147971a6649486670132380c97c41647bfba7be3303000476c061e: Status 404 returned error can't find the container with id 89fcf55e15147971a6649486670132380c97c41647bfba7be3303000476c061e Jun 02 21:44:40.370313 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:40.370273 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-7drbd" event={"ID":"176534e3-60d8-4fb9-82ec-7124d885af9c","Type":"ContainerStarted","Data":"a80c58bff84d65e42613da1387b69a9c5d094369429267d1a841742bd0806f35"} Jun 02 21:44:40.370513 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:40.370317 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-7drbd" event={"ID":"176534e3-60d8-4fb9-82ec-7124d885af9c","Type":"ContainerStarted","Data":"89fcf55e15147971a6649486670132380c97c41647bfba7be3303000476c061e"} Jun 02 21:44:40.388833 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:40.388786 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-7drbd" podStartSLOduration=1.388773314 podStartE2EDuration="1.388773314s" podCreationTimestamp="2026-06-02 21:44:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:44:40.387124273 +0000 UTC m=+286.828572292" watchObservedRunningTime="2026-06-02 21:44:40.388773314 +0000 UTC m=+286.830221333" Jun 02 21:44:41.376479 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:41.376441 2567 generic.go:358] "Generic (PLEG): container finished" podID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerID="cc3e97df259612110954b3e3c4af7a5868f0337ddbd512e7ac503aa6d42e331e" exitCode=0 Jun 02 21:44:41.376887 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:41.376519 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" event={"ID":"1e87b5ba-ad10-44cb-85ee-44efaacaa891","Type":"ContainerDied","Data":"cc3e97df259612110954b3e3c4af7a5868f0337ddbd512e7ac503aa6d42e331e"} Jun 02 21:44:42.381822 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:42.381785 2567 generic.go:358] "Generic (PLEG): container finished" podID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerID="f741ea0dcac670175b790d337834d268d9cf60aa9e4b53cd59ee67bca41fd35a" exitCode=0 Jun 02 21:44:42.382239 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:42.381858 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" event={"ID":"1e87b5ba-ad10-44cb-85ee-44efaacaa891","Type":"ContainerDied","Data":"f741ea0dcac670175b790d337834d268d9cf60aa9e4b53cd59ee67bca41fd35a"} Jun 02 21:44:43.509209 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.509184 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:43.616667 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.616634 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bshg\" (UniqueName: \"kubernetes.io/projected/1e87b5ba-ad10-44cb-85ee-44efaacaa891-kube-api-access-2bshg\") pod \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " Jun 02 21:44:43.616852 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.616694 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-util\") pod \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " Jun 02 21:44:43.616852 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.616763 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-bundle\") pod \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\" (UID: \"1e87b5ba-ad10-44cb-85ee-44efaacaa891\") " Jun 02 21:44:43.617457 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.617430 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-bundle" (OuterVolumeSpecName: "bundle") pod "1e87b5ba-ad10-44cb-85ee-44efaacaa891" (UID: "1e87b5ba-ad10-44cb-85ee-44efaacaa891"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:44:43.618863 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.618838 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e87b5ba-ad10-44cb-85ee-44efaacaa891-kube-api-access-2bshg" (OuterVolumeSpecName: "kube-api-access-2bshg") pod "1e87b5ba-ad10-44cb-85ee-44efaacaa891" (UID: "1e87b5ba-ad10-44cb-85ee-44efaacaa891"). InnerVolumeSpecName "kube-api-access-2bshg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:44:43.622275 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.622236 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-util" (OuterVolumeSpecName: "util") pod "1e87b5ba-ad10-44cb-85ee-44efaacaa891" (UID: "1e87b5ba-ad10-44cb-85ee-44efaacaa891"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:44:43.717486 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.717388 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bshg\" (UniqueName: \"kubernetes.io/projected/1e87b5ba-ad10-44cb-85ee-44efaacaa891-kube-api-access-2bshg\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:44:43.717486 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.717428 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:44:43.717486 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:43.717442 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e87b5ba-ad10-44cb-85ee-44efaacaa891-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:44:44.390746 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:44.390641 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" event={"ID":"1e87b5ba-ad10-44cb-85ee-44efaacaa891","Type":"ContainerDied","Data":"cb153d2ef1a1b580f24966cb6e8ed78215b07a7ad9da04ca4ccf3d14da2cd5db"} Jun 02 21:44:44.390746 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:44.390685 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb153d2ef1a1b580f24966cb6e8ed78215b07a7ad9da04ca4ccf3d14da2cd5db" Jun 02 21:44:44.390746 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:44.390700 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt4swq" Jun 02 21:44:54.028801 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:54.028771 2567 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 21:44:55.629271 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.629242 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2"] Jun 02 21:44:55.631726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.629677 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerName="extract" Jun 02 21:44:55.631726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.629693 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerName="extract" Jun 02 21:44:55.631726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.629707 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerName="pull" Jun 02 21:44:55.631726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.629714 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerName="pull" Jun 02 21:44:55.631726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.629731 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerName="util" Jun 02 21:44:55.631726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.629742 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerName="util" Jun 02 21:44:55.631726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.629817 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e87b5ba-ad10-44cb-85ee-44efaacaa891" containerName="extract" Jun 02 21:44:55.632862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.632844 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.636425 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.636399 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 21:44:55.636565 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.636544 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nvhhq\"" Jun 02 21:44:55.636634 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.636620 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 21:44:55.636686 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.636657 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 21:44:55.636723 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.636697 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 21:44:55.650023 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.650000 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2"] Jun 02 21:44:55.725389 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.725309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8f9572e-3281-4996-98c5-148a3cb0da76-tmp\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.725581 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.725436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8f9572e-3281-4996-98c5-148a3cb0da76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.725581 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.725487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjfn5\" (UniqueName: \"kubernetes.io/projected/a8f9572e-3281-4996-98c5-148a3cb0da76-kube-api-access-mjfn5\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.725581 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.725533 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8f9572e-3281-4996-98c5-148a3cb0da76-manifests\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.725581 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.725551 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8f9572e-3281-4996-98c5-148a3cb0da76-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.826186 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.826146 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8f9572e-3281-4996-98c5-148a3cb0da76-manifests\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.826186 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.826185 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8f9572e-3281-4996-98c5-148a3cb0da76-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.826434 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.826352 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8f9572e-3281-4996-98c5-148a3cb0da76-tmp\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.826434 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.826415 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8f9572e-3281-4996-98c5-148a3cb0da76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.826590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.826447 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjfn5\" (UniqueName: \"kubernetes.io/projected/a8f9572e-3281-4996-98c5-148a3cb0da76-kube-api-access-mjfn5\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.826703 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.826680 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8f9572e-3281-4996-98c5-148a3cb0da76-manifests\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.828919 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.828891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8f9572e-3281-4996-98c5-148a3cb0da76-tmp\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.829038 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.828978 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8f9572e-3281-4996-98c5-148a3cb0da76-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.829130 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.829107 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8f9572e-3281-4996-98c5-148a3cb0da76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.836862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.836829 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjfn5\" (UniqueName: \"kubernetes.io/projected/a8f9572e-3281-4996-98c5-148a3cb0da76-kube-api-access-mjfn5\") pod \"opendatahub-operator-controller-manager-6d44dd895c-wd2q2\" (UID: \"a8f9572e-3281-4996-98c5-148a3cb0da76\") " pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:55.943624 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:55.943538 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:44:56.099274 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:56.099241 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2"] Jun 02 21:44:56.102677 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:44:56.102640 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f9572e_3281_4996_98c5_148a3cb0da76.slice/crio-4eac1946d7552877ed821e3ad36b2adbe3df1f86de26e8cf0ebc644b4860d2b4 WatchSource:0}: Error finding container 4eac1946d7552877ed821e3ad36b2adbe3df1f86de26e8cf0ebc644b4860d2b4: Status 404 returned error can't find the container with id 4eac1946d7552877ed821e3ad36b2adbe3df1f86de26e8cf0ebc644b4860d2b4 Jun 02 21:44:56.104541 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:56.104525 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:44:56.435489 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:56.435441 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" event={"ID":"a8f9572e-3281-4996-98c5-148a3cb0da76","Type":"ContainerStarted","Data":"4eac1946d7552877ed821e3ad36b2adbe3df1f86de26e8cf0ebc644b4860d2b4"} Jun 02 21:44:59.449819 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:44:59.449785 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" event={"ID":"a8f9572e-3281-4996-98c5-148a3cb0da76","Type":"ContainerStarted","Data":"b595d906740d8c92ba84c924c496abbf68b90cedc72855616e6a35628b80e42e"} Jun 02 21:45:00.455197 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:00.455160 2567 generic.go:358] "Generic (PLEG): container finished" podID="a8f9572e-3281-4996-98c5-148a3cb0da76" containerID="b595d906740d8c92ba84c924c496abbf68b90cedc72855616e6a35628b80e42e" exitCode=0 Jun 02 21:45:00.455623 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:00.455243 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" event={"ID":"a8f9572e-3281-4996-98c5-148a3cb0da76","Type":"ContainerDied","Data":"b595d906740d8c92ba84c924c496abbf68b90cedc72855616e6a35628b80e42e"} Jun 02 21:45:01.460512 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:01.460470 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" event={"ID":"a8f9572e-3281-4996-98c5-148a3cb0da76","Type":"ContainerStarted","Data":"27a54a67911bfb1ad8eabc41b93c0b50482b650696461112097fe8e8d77debee"} Jun 02 21:45:01.460874 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:01.460569 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:45:01.496763 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:01.496693 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" podStartSLOduration=1.885014956 podStartE2EDuration="6.496676737s" podCreationTimestamp="2026-06-02 21:44:55 +0000 UTC" firstStartedPulling="2026-06-02 21:44:56.104650845 +0000 UTC m=+302.546098845" lastFinishedPulling="2026-06-02 21:45:00.716312629 +0000 UTC m=+307.157760626" observedRunningTime="2026-06-02 21:45:01.494129592 +0000 UTC m=+307.935577622" watchObservedRunningTime="2026-06-02 21:45:01.496676737 +0000 UTC m=+307.938124756" Jun 02 21:45:12.467096 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:12.467061 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d44dd895c-wd2q2" Jun 02 21:45:15.573742 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.573701 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh"] Jun 02 21:45:15.578556 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.578534 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:15.588744 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.588716 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 21:45:15.588851 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.588716 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 21:45:15.599080 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:45:15.599049 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-7ktmx\" is forbidden: User \"system:node:ip-10-0-135-204.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7ktmx\"" type="*v1.Secret" Jun 02 21:45:15.599080 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.599066 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 21:45:15.599238 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:45:15.599095 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-135-204.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" Jun 02 21:45:15.617618 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.617589 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh"] Jun 02 21:45:15.701125 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.701087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6402a48a-ad0a-44f2-bf4e-ea2100fd0653-tmp\") pod \"kube-auth-proxy-567f8cc9bf-r77zh\" (UID: \"6402a48a-ad0a-44f2-bf4e-ea2100fd0653\") " pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:15.701289 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.701187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzzft\" (UniqueName: \"kubernetes.io/projected/6402a48a-ad0a-44f2-bf4e-ea2100fd0653-kube-api-access-zzzft\") pod \"kube-auth-proxy-567f8cc9bf-r77zh\" (UID: \"6402a48a-ad0a-44f2-bf4e-ea2100fd0653\") " pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:15.701289 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.701226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6402a48a-ad0a-44f2-bf4e-ea2100fd0653-tls-certs\") pod \"kube-auth-proxy-567f8cc9bf-r77zh\" (UID: \"6402a48a-ad0a-44f2-bf4e-ea2100fd0653\") " pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:15.794887 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.794857 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5"] Jun 02 21:45:15.797627 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.797604 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:15.801837 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.801813 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzzft\" (UniqueName: \"kubernetes.io/projected/6402a48a-ad0a-44f2-bf4e-ea2100fd0653-kube-api-access-zzzft\") pod \"kube-auth-proxy-567f8cc9bf-r77zh\" (UID: \"6402a48a-ad0a-44f2-bf4e-ea2100fd0653\") " pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:15.801954 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.801884 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6402a48a-ad0a-44f2-bf4e-ea2100fd0653-tls-certs\") pod \"kube-auth-proxy-567f8cc9bf-r77zh\" (UID: \"6402a48a-ad0a-44f2-bf4e-ea2100fd0653\") " pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:15.801954 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.801936 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6402a48a-ad0a-44f2-bf4e-ea2100fd0653-tmp\") pod \"kube-auth-proxy-567f8cc9bf-r77zh\" (UID: \"6402a48a-ad0a-44f2-bf4e-ea2100fd0653\") " pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:15.802078 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.802055 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:45:15.802135 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.802092 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:45:15.802251 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.802230 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j4swd\"" Jun 02 21:45:15.804541 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.804412 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6402a48a-ad0a-44f2-bf4e-ea2100fd0653-tmp\") pod \"kube-auth-proxy-567f8cc9bf-r77zh\" (UID: \"6402a48a-ad0a-44f2-bf4e-ea2100fd0653\") " pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:15.811992 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.811970 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5"] Jun 02 21:45:15.820250 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.820227 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzzft\" (UniqueName: \"kubernetes.io/projected/6402a48a-ad0a-44f2-bf4e-ea2100fd0653-kube-api-access-zzzft\") pod \"kube-auth-proxy-567f8cc9bf-r77zh\" (UID: \"6402a48a-ad0a-44f2-bf4e-ea2100fd0653\") " pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:15.903010 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.902930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:15.903010 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.902992 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:15.903184 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:15.903109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8zn\" (UniqueName: \"kubernetes.io/projected/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-kube-api-access-5n8zn\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:16.003727 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.003684 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:16.003892 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.003763 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8zn\" (UniqueName: \"kubernetes.io/projected/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-kube-api-access-5n8zn\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:16.003892 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.003821 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:16.004164 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.004143 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:16.004200 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.004190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:16.020992 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.020955 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8zn\" (UniqueName: \"kubernetes.io/projected/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-kube-api-access-5n8zn\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:16.115183 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.115136 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:16.261990 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.261964 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5"] Jun 02 21:45:16.263952 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:45:16.263913 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2c7322_76c7_4da3_a4ae_9b0dec0f9093.slice/crio-5e7c90bc56a0a4af8ba49fe069c8a79d70daee13f8fb6af4c4acf5c00a3fa7f2 WatchSource:0}: Error finding container 5e7c90bc56a0a4af8ba49fe069c8a79d70daee13f8fb6af4c4acf5c00a3fa7f2: Status 404 returned error can't find the container with id 5e7c90bc56a0a4af8ba49fe069c8a79d70daee13f8fb6af4c4acf5c00a3fa7f2 Jun 02 21:45:16.460533 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.460448 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7ktmx\"" Jun 02 21:45:16.515831 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.515799 2567 generic.go:358] "Generic (PLEG): container finished" podID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerID="8bd11b75a6b370b2ef20dcbdbfaaf95867e2f6e006e45bbb1959bc2fdc3ebcaf" exitCode=0 Jun 02 21:45:16.515986 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.515861 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" event={"ID":"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093","Type":"ContainerDied","Data":"8bd11b75a6b370b2ef20dcbdbfaaf95867e2f6e006e45bbb1959bc2fdc3ebcaf"} Jun 02 21:45:16.515986 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.515885 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" event={"ID":"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093","Type":"ContainerStarted","Data":"5e7c90bc56a0a4af8ba49fe069c8a79d70daee13f8fb6af4c4acf5c00a3fa7f2"} Jun 02 21:45:16.637768 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.637737 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 21:45:16.644607 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.644580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6402a48a-ad0a-44f2-bf4e-ea2100fd0653-tls-certs\") pod \"kube-auth-proxy-567f8cc9bf-r77zh\" (UID: \"6402a48a-ad0a-44f2-bf4e-ea2100fd0653\") " pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:16.788473 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.788373 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" Jun 02 21:45:16.924616 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:16.924593 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh"] Jun 02 21:45:16.926543 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:45:16.926506 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6402a48a_ad0a_44f2_bf4e_ea2100fd0653.slice/crio-e3ae3e08ac19769534e362052921d2b828bb7b031161f81b36c0631bd816d84a WatchSource:0}: Error finding container e3ae3e08ac19769534e362052921d2b828bb7b031161f81b36c0631bd816d84a: Status 404 returned error can't find the container with id e3ae3e08ac19769534e362052921d2b828bb7b031161f81b36c0631bd816d84a Jun 02 21:45:17.523888 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.523847 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" event={"ID":"6402a48a-ad0a-44f2-bf4e-ea2100fd0653","Type":"ContainerStarted","Data":"e3ae3e08ac19769534e362052921d2b828bb7b031161f81b36c0631bd816d84a"} Jun 02 21:45:17.843845 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.843810 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc"] Jun 02 21:45:17.846619 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.846600 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:17.851740 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.851702 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 21:45:17.852825 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.852794 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 21:45:17.852947 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.852836 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 21:45:17.853162 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.853144 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lgj5c\"" Jun 02 21:45:17.865048 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.865005 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc"] Jun 02 21:45:17.921628 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.921544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac56b04c-6a03-4423-8c78-b7121d9eb672-manager-config\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:17.921628 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.921606 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac56b04c-6a03-4423-8c78-b7121d9eb672-cert\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:17.921889 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.921650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac56b04c-6a03-4423-8c78-b7121d9eb672-metrics-cert\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:17.921889 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:17.921699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lvsz\" (UniqueName: \"kubernetes.io/projected/ac56b04c-6a03-4423-8c78-b7121d9eb672-kube-api-access-8lvsz\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.023403 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.022958 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac56b04c-6a03-4423-8c78-b7121d9eb672-manager-config\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.023403 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.023011 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac56b04c-6a03-4423-8c78-b7121d9eb672-cert\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.023403 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.023053 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac56b04c-6a03-4423-8c78-b7121d9eb672-metrics-cert\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.023403 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.023102 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lvsz\" (UniqueName: \"kubernetes.io/projected/ac56b04c-6a03-4423-8c78-b7121d9eb672-kube-api-access-8lvsz\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.024169 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.024109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac56b04c-6a03-4423-8c78-b7121d9eb672-manager-config\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.026612 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.026563 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac56b04c-6a03-4423-8c78-b7121d9eb672-cert\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.026767 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.026731 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac56b04c-6a03-4423-8c78-b7121d9eb672-metrics-cert\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.046195 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.046167 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lvsz\" (UniqueName: \"kubernetes.io/projected/ac56b04c-6a03-4423-8c78-b7121d9eb672-kube-api-access-8lvsz\") pod \"lws-controller-manager-dd5fdcbbf-kq8sc\" (UID: \"ac56b04c-6a03-4423-8c78-b7121d9eb672\") " pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.161454 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.161258 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:18.532809 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.532709 2567 generic.go:358] "Generic (PLEG): container finished" podID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerID="eaa9e3abbc2e5367b99b387b8654e03b663cb0aef64386565787f7598ad30216" exitCode=0 Jun 02 21:45:18.532990 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:18.532874 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" event={"ID":"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093","Type":"ContainerDied","Data":"eaa9e3abbc2e5367b99b387b8654e03b663cb0aef64386565787f7598ad30216"} Jun 02 21:45:19.659221 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:19.659148 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc"] Jun 02 21:45:19.661951 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:45:19.661905 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac56b04c_6a03_4423_8c78_b7121d9eb672.slice/crio-12f897935cea2ffcf2524cbb9e20b57cda38e35bf23e2fb32d26ea4ca9123759 WatchSource:0}: Error finding container 12f897935cea2ffcf2524cbb9e20b57cda38e35bf23e2fb32d26ea4ca9123759: Status 404 returned error can't find the container with id 12f897935cea2ffcf2524cbb9e20b57cda38e35bf23e2fb32d26ea4ca9123759 Jun 02 21:45:20.547538 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:20.547368 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" event={"ID":"6402a48a-ad0a-44f2-bf4e-ea2100fd0653","Type":"ContainerStarted","Data":"722887c17ce68a23bcb6119cbc642d10626e9d6dc22214dabf1c46e2e79f4619"} Jun 02 21:45:20.548608 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:20.548574 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" event={"ID":"ac56b04c-6a03-4423-8c78-b7121d9eb672","Type":"ContainerStarted","Data":"12f897935cea2ffcf2524cbb9e20b57cda38e35bf23e2fb32d26ea4ca9123759"} Jun 02 21:45:20.550569 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:20.550539 2567 generic.go:358] "Generic (PLEG): container finished" podID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerID="d7cd754607556a31be88393f9300b5bdc30fdcb364bea1e8ed029a85d6e33410" exitCode=0 Jun 02 21:45:20.550672 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:20.550601 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" event={"ID":"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093","Type":"ContainerDied","Data":"d7cd754607556a31be88393f9300b5bdc30fdcb364bea1e8ed029a85d6e33410"} Jun 02 21:45:20.568671 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:20.568627 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-567f8cc9bf-r77zh" podStartSLOduration=2.947197843 podStartE2EDuration="5.568611773s" podCreationTimestamp="2026-06-02 21:45:15 +0000 UTC" firstStartedPulling="2026-06-02 21:45:16.928273908 +0000 UTC m=+323.369721905" lastFinishedPulling="2026-06-02 21:45:19.549687835 +0000 UTC m=+325.991135835" observedRunningTime="2026-06-02 21:45:20.565682123 +0000 UTC m=+327.007130153" watchObservedRunningTime="2026-06-02 21:45:20.568611773 +0000 UTC m=+327.010059792" Jun 02 21:45:21.561790 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.561732 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" event={"ID":"ac56b04c-6a03-4423-8c78-b7121d9eb672","Type":"ContainerStarted","Data":"bb66cb4f77e88a4491bd248ae450ab989c1a5031ae402480c2b1bc68f44c4377"} Jun 02 21:45:21.590545 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.590445 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" podStartSLOduration=2.935685329 podStartE2EDuration="4.59043021s" podCreationTimestamp="2026-06-02 21:45:17 +0000 UTC" firstStartedPulling="2026-06-02 21:45:19.664572203 +0000 UTC m=+326.106020200" lastFinishedPulling="2026-06-02 21:45:21.319317071 +0000 UTC m=+327.760765081" observedRunningTime="2026-06-02 21:45:21.589401926 +0000 UTC m=+328.030849944" watchObservedRunningTime="2026-06-02 21:45:21.59043021 +0000 UTC m=+328.031878229" Jun 02 21:45:21.691229 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.691203 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:21.760548 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.760512 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n8zn\" (UniqueName: \"kubernetes.io/projected/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-kube-api-access-5n8zn\") pod \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " Jun 02 21:45:21.760722 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.760579 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-util\") pod \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " Jun 02 21:45:21.760722 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.760665 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-bundle\") pod \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\" (UID: \"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093\") " Jun 02 21:45:21.761739 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.761704 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-bundle" (OuterVolumeSpecName: "bundle") pod "2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" (UID: "2a2c7322-76c7-4da3-a4ae-9b0dec0f9093"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:45:21.762691 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.762666 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-kube-api-access-5n8zn" (OuterVolumeSpecName: "kube-api-access-5n8zn") pod "2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" (UID: "2a2c7322-76c7-4da3-a4ae-9b0dec0f9093"). InnerVolumeSpecName "kube-api-access-5n8zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:45:21.765087 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.765062 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-util" (OuterVolumeSpecName: "util") pod "2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" (UID: "2a2c7322-76c7-4da3-a4ae-9b0dec0f9093"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:45:21.861978 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.861888 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:45:21.861978 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.861922 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n8zn\" (UniqueName: \"kubernetes.io/projected/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-kube-api-access-5n8zn\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:45:21.861978 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:21.861934 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a2c7322-76c7-4da3-a4ae-9b0dec0f9093-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:45:22.567509 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:22.567475 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" Jun 02 21:45:22.567873 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:22.567504 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wmdh5" event={"ID":"2a2c7322-76c7-4da3-a4ae-9b0dec0f9093","Type":"ContainerDied","Data":"5e7c90bc56a0a4af8ba49fe069c8a79d70daee13f8fb6af4c4acf5c00a3fa7f2"} Jun 02 21:45:22.567873 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:22.567536 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e7c90bc56a0a4af8ba49fe069c8a79d70daee13f8fb6af4c4acf5c00a3fa7f2" Jun 02 21:45:22.567992 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:22.567887 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:30.485057 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.484971 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq"] Jun 02 21:45:30.485525 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.485354 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerName="util" Jun 02 21:45:30.485525 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.485367 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerName="util" Jun 02 21:45:30.485525 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.485381 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerName="extract" Jun 02 21:45:30.485525 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.485387 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerName="extract" Jun 02 21:45:30.485525 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.485399 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerName="pull" Jun 02 21:45:30.485525 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.485405 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerName="pull" Jun 02 21:45:30.485525 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.485462 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a2c7322-76c7-4da3-a4ae-9b0dec0f9093" containerName="extract" Jun 02 21:45:30.560596 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.560569 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq"] Jun 02 21:45:30.560759 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.560695 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.565696 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.565667 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:45:30.565848 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.565811 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:45:30.565916 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.565841 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j4swd\"" Jun 02 21:45:30.644314 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.644272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.644532 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.644422 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.644532 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.644472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvdrv\" (UniqueName: \"kubernetes.io/projected/953b4b19-2042-4f9c-a55d-fe28806d0ddd-kube-api-access-gvdrv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.745481 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.745387 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.745481 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.745438 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvdrv\" (UniqueName: \"kubernetes.io/projected/953b4b19-2042-4f9c-a55d-fe28806d0ddd-kube-api-access-gvdrv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.745481 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.745464 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.745854 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.745836 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.745915 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.745849 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.849743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.849708 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvdrv\" (UniqueName: \"kubernetes.io/projected/953b4b19-2042-4f9c-a55d-fe28806d0ddd-kube-api-access-gvdrv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:30.871139 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:30.871109 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:31.047115 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:31.047082 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq"] Jun 02 21:45:31.048207 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:45:31.048179 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953b4b19_2042_4f9c_a55d_fe28806d0ddd.slice/crio-ab152b4eaf960976095034a23f6628a1332a5bbe7650111b5bb963110fd5cc8e WatchSource:0}: Error finding container ab152b4eaf960976095034a23f6628a1332a5bbe7650111b5bb963110fd5cc8e: Status 404 returned error can't find the container with id ab152b4eaf960976095034a23f6628a1332a5bbe7650111b5bb963110fd5cc8e Jun 02 21:45:31.603675 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:31.603633 2567 generic.go:358] "Generic (PLEG): container finished" podID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerID="ddca28457f8418dc7add2622497754fa634f65e20a08dbec4b538c4595870741" exitCode=0 Jun 02 21:45:31.604117 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:31.603704 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" event={"ID":"953b4b19-2042-4f9c-a55d-fe28806d0ddd","Type":"ContainerDied","Data":"ddca28457f8418dc7add2622497754fa634f65e20a08dbec4b538c4595870741"} Jun 02 21:45:31.604117 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:31.603737 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" event={"ID":"953b4b19-2042-4f9c-a55d-fe28806d0ddd","Type":"ContainerStarted","Data":"ab152b4eaf960976095034a23f6628a1332a5bbe7650111b5bb963110fd5cc8e"} Jun 02 21:45:33.574533 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:33.574500 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dd5fdcbbf-kq8sc" Jun 02 21:45:33.612888 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:33.612855 2567 generic.go:358] "Generic (PLEG): container finished" podID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerID="b0c37d23df494b893d8e8f01fd5546d6ee6fa2ac2d65e2cd4067060a30c25c75" exitCode=0 Jun 02 21:45:33.613047 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:33.612919 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" event={"ID":"953b4b19-2042-4f9c-a55d-fe28806d0ddd","Type":"ContainerDied","Data":"b0c37d23df494b893d8e8f01fd5546d6ee6fa2ac2d65e2cd4067060a30c25c75"} Jun 02 21:45:34.618656 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:34.618618 2567 generic.go:358] "Generic (PLEG): container finished" podID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerID="9b55f09ef7799d3dd22f1df959f51b1ebd829d5971172f2dd3ff5e52744da404" exitCode=0 Jun 02 21:45:34.619027 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:34.618711 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" event={"ID":"953b4b19-2042-4f9c-a55d-fe28806d0ddd","Type":"ContainerDied","Data":"9b55f09ef7799d3dd22f1df959f51b1ebd829d5971172f2dd3ff5e52744da404"} Jun 02 21:45:35.751753 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.751724 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:45:35.893427 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.893300 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-util\") pod \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " Jun 02 21:45:35.893427 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.893399 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvdrv\" (UniqueName: \"kubernetes.io/projected/953b4b19-2042-4f9c-a55d-fe28806d0ddd-kube-api-access-gvdrv\") pod \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " Jun 02 21:45:35.893659 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.893459 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-bundle\") pod \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\" (UID: \"953b4b19-2042-4f9c-a55d-fe28806d0ddd\") " Jun 02 21:45:35.894373 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.894341 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-bundle" (OuterVolumeSpecName: "bundle") pod "953b4b19-2042-4f9c-a55d-fe28806d0ddd" (UID: "953b4b19-2042-4f9c-a55d-fe28806d0ddd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:45:35.895685 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.895648 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953b4b19-2042-4f9c-a55d-fe28806d0ddd-kube-api-access-gvdrv" (OuterVolumeSpecName: "kube-api-access-gvdrv") pod "953b4b19-2042-4f9c-a55d-fe28806d0ddd" (UID: "953b4b19-2042-4f9c-a55d-fe28806d0ddd"). InnerVolumeSpecName "kube-api-access-gvdrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:45:35.899610 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.899575 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-util" (OuterVolumeSpecName: "util") pod "953b4b19-2042-4f9c-a55d-fe28806d0ddd" (UID: "953b4b19-2042-4f9c-a55d-fe28806d0ddd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:45:35.994143 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.994107 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:45:35.994143 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.994139 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvdrv\" (UniqueName: \"kubernetes.io/projected/953b4b19-2042-4f9c-a55d-fe28806d0ddd-kube-api-access-gvdrv\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:45:35.994143 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:35.994150 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953b4b19-2042-4f9c-a55d-fe28806d0ddd-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:45:36.627111 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:36.627078 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" event={"ID":"953b4b19-2042-4f9c-a55d-fe28806d0ddd","Type":"ContainerDied","Data":"ab152b4eaf960976095034a23f6628a1332a5bbe7650111b5bb963110fd5cc8e"} Jun 02 21:45:36.627111 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:36.627110 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab152b4eaf960976095034a23f6628a1332a5bbe7650111b5bb963110fd5cc8e" Jun 02 21:45:36.627317 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:45:36.627109 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6mxnq" Jun 02 21:46:32.090029 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.089990 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb"] Jun 02 21:46:32.090447 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.090395 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerName="util" Jun 02 21:46:32.090447 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.090408 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerName="util" Jun 02 21:46:32.090447 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.090419 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerName="extract" Jun 02 21:46:32.090447 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.090424 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerName="extract" Jun 02 21:46:32.090447 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.090434 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerName="pull" Jun 02 21:46:32.090447 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.090441 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerName="pull" Jun 02 21:46:32.090637 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.090509 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="953b4b19-2042-4f9c-a55d-fe28806d0ddd" containerName="extract" Jun 02 21:46:32.093769 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.093751 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.097260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.097232 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 21:46:32.097260 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.097245 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vwmsl\"" Jun 02 21:46:32.098294 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.098273 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 21:46:32.102509 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.102487 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb"] Jun 02 21:46:32.276586 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.276553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.276767 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.276690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkh8c\" (UniqueName: \"kubernetes.io/projected/c7de961f-a59f-4218-9760-bf8326388b72-kube-api-access-kkh8c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.276845 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.276828 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.377666 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.377589 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.377807 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.377692 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkh8c\" (UniqueName: \"kubernetes.io/projected/c7de961f-a59f-4218-9760-bf8326388b72-kube-api-access-kkh8c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.377807 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.377723 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.378010 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.377986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.378072 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.378025 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.387756 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.387729 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkh8c\" (UniqueName: \"kubernetes.io/projected/c7de961f-a59f-4218-9760-bf8326388b72-kube-api-access-kkh8c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.404552 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.404523 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:32.532698 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.532669 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb"] Jun 02 21:46:32.534733 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:46:32.534706 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7de961f_a59f_4218_9760_bf8326388b72.slice/crio-f13c81fa3e1669194c950e5b8f63cacecc192128346488c420c5b0495e910c9d WatchSource:0}: Error finding container f13c81fa3e1669194c950e5b8f63cacecc192128346488c420c5b0495e910c9d: Status 404 returned error can't find the container with id f13c81fa3e1669194c950e5b8f63cacecc192128346488c420c5b0495e910c9d Jun 02 21:46:32.665909 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.665883 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4"] Jun 02 21:46:32.669300 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.669285 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:32.678163 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.678140 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4"] Jun 02 21:46:32.780418 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.780396 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:32.780515 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.780435 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:32.780515 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.780455 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsmvt\" (UniqueName: \"kubernetes.io/projected/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-kube-api-access-nsmvt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:32.825633 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.825610 2567 generic.go:358] "Generic (PLEG): container finished" podID="c7de961f-a59f-4218-9760-bf8326388b72" containerID="a99df82cc79901f87d7e60207257e7c3d6ee658818c76aa5d9ff4b66d2a5b9f0" exitCode=0 Jun 02 21:46:32.825719 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.825693 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" event={"ID":"c7de961f-a59f-4218-9760-bf8326388b72","Type":"ContainerDied","Data":"a99df82cc79901f87d7e60207257e7c3d6ee658818c76aa5d9ff4b66d2a5b9f0"} Jun 02 21:46:32.825763 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.825721 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" event={"ID":"c7de961f-a59f-4218-9760-bf8326388b72","Type":"ContainerStarted","Data":"f13c81fa3e1669194c950e5b8f63cacecc192128346488c420c5b0495e910c9d"} Jun 02 21:46:32.881101 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.881079 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:32.881202 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.881117 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:32.881202 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.881137 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nsmvt\" (UniqueName: \"kubernetes.io/projected/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-kube-api-access-nsmvt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:32.881458 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.881435 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:32.881523 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.881507 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:32.889938 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:32.889919 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsmvt\" (UniqueName: \"kubernetes.io/projected/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-kube-api-access-nsmvt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:33.001300 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.001246 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:33.128134 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.128111 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4"] Jun 02 21:46:33.130075 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:46:33.130042 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2a5bf9_131f_4c30_9636_bd54cf7f00d7.slice/crio-2e41042c40dc89c4ad90fe1e0b48ee608eef175fa61b9c657a7a220c0fc3b2fb WatchSource:0}: Error finding container 2e41042c40dc89c4ad90fe1e0b48ee608eef175fa61b9c657a7a220c0fc3b2fb: Status 404 returned error can't find the container with id 2e41042c40dc89c4ad90fe1e0b48ee608eef175fa61b9c657a7a220c0fc3b2fb Jun 02 21:46:33.265757 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.265685 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h"] Jun 02 21:46:33.269117 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.269102 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.276446 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.276420 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h"] Jun 02 21:46:33.384999 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.384963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2lq5\" (UniqueName: \"kubernetes.io/projected/e6fbed83-b1f1-4058-b6d4-ceb896463619-kube-api-access-t2lq5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.385149 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.385030 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.385149 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.385069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.486619 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.486575 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2lq5\" (UniqueName: \"kubernetes.io/projected/e6fbed83-b1f1-4058-b6d4-ceb896463619-kube-api-access-t2lq5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.486796 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.486632 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.486796 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.486683 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.487011 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.486990 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.487063 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.487021 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.496002 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.495967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2lq5\" (UniqueName: \"kubernetes.io/projected/e6fbed83-b1f1-4058-b6d4-ceb896463619-kube-api-access-t2lq5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.589632 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.589610 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:33.671097 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.671072 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh"] Jun 02 21:46:33.680589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.680560 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.688550 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.688511 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh"] Jun 02 21:46:33.755245 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.755217 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h"] Jun 02 21:46:33.765238 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:46:33.765209 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6fbed83_b1f1_4058_b6d4_ceb896463619.slice/crio-c96ef42ce3c33abe21e61a45bf9486588d2c5fba704dc8276bbb58f148cdd48f WatchSource:0}: Error finding container c96ef42ce3c33abe21e61a45bf9486588d2c5fba704dc8276bbb58f148cdd48f: Status 404 returned error can't find the container with id c96ef42ce3c33abe21e61a45bf9486588d2c5fba704dc8276bbb58f148cdd48f Jun 02 21:46:33.790029 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.789999 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.790136 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.790093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.790198 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.790141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5l74\" (UniqueName: \"kubernetes.io/projected/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-kube-api-access-q5l74\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.831349 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.831291 2567 generic.go:358] "Generic (PLEG): container finished" podID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerID="ba19192848d372fe4dc8ff54ab36de1ecffc2721211a02a05aad5ddc2853fd5b" exitCode=0 Jun 02 21:46:33.831536 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.831366 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" event={"ID":"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7","Type":"ContainerDied","Data":"ba19192848d372fe4dc8ff54ab36de1ecffc2721211a02a05aad5ddc2853fd5b"} Jun 02 21:46:33.831536 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.831416 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" event={"ID":"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7","Type":"ContainerStarted","Data":"2e41042c40dc89c4ad90fe1e0b48ee608eef175fa61b9c657a7a220c0fc3b2fb"} Jun 02 21:46:33.833101 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.833071 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" event={"ID":"e6fbed83-b1f1-4058-b6d4-ceb896463619","Type":"ContainerStarted","Data":"5b3b1134a54f6eca6c1d98df54177ce5b4f13629ff0b8e088ebee2e878ddc40b"} Jun 02 21:46:33.833225 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.833110 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" event={"ID":"e6fbed83-b1f1-4058-b6d4-ceb896463619","Type":"ContainerStarted","Data":"c96ef42ce3c33abe21e61a45bf9486588d2c5fba704dc8276bbb58f148cdd48f"} Jun 02 21:46:33.834752 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.834727 2567 generic.go:358] "Generic (PLEG): container finished" podID="c7de961f-a59f-4218-9760-bf8326388b72" containerID="8fbe4b107aeb64cb12efba9aebca1048b58ffc5f5993859b339100aac4ca4262" exitCode=0 Jun 02 21:46:33.834890 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.834782 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" event={"ID":"c7de961f-a59f-4218-9760-bf8326388b72","Type":"ContainerDied","Data":"8fbe4b107aeb64cb12efba9aebca1048b58ffc5f5993859b339100aac4ca4262"} Jun 02 21:46:33.891198 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.891169 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.891386 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.891213 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5l74\" (UniqueName: \"kubernetes.io/projected/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-kube-api-access-q5l74\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.891386 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.891270 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.891661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.891642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.891699 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.891661 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.910879 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.910846 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5l74\" (UniqueName: \"kubernetes.io/projected/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-kube-api-access-q5l74\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:33.994065 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:33.994037 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:34.125888 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:46:34.125859 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a612c9_cadd_4cd0_b7d0_c5d382b5dc20.slice/crio-1a1abec0f36f8331a58aec84801a42c2f11d04d29964280da09e99deb541594c WatchSource:0}: Error finding container 1a1abec0f36f8331a58aec84801a42c2f11d04d29964280da09e99deb541594c: Status 404 returned error can't find the container with id 1a1abec0f36f8331a58aec84801a42c2f11d04d29964280da09e99deb541594c Jun 02 21:46:34.129749 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.129725 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh"] Jun 02 21:46:34.841276 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.841241 2567 generic.go:358] "Generic (PLEG): container finished" podID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerID="c9a101bc623964ed27670c2995d18ef19f4e5d89b53e074dfcacdbdf4d41ebc0" exitCode=0 Jun 02 21:46:34.841463 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.841344 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" event={"ID":"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20","Type":"ContainerDied","Data":"c9a101bc623964ed27670c2995d18ef19f4e5d89b53e074dfcacdbdf4d41ebc0"} Jun 02 21:46:34.841463 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.841380 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" event={"ID":"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20","Type":"ContainerStarted","Data":"1a1abec0f36f8331a58aec84801a42c2f11d04d29964280da09e99deb541594c"} Jun 02 21:46:34.843151 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.843127 2567 generic.go:358] "Generic (PLEG): container finished" podID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerID="701c770fa87f571be3e058872c417fc5a22e66bcd50c8ba12a066e1d23167d89" exitCode=0 Jun 02 21:46:34.843274 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.843204 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" event={"ID":"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7","Type":"ContainerDied","Data":"701c770fa87f571be3e058872c417fc5a22e66bcd50c8ba12a066e1d23167d89"} Jun 02 21:46:34.844665 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.844640 2567 generic.go:358] "Generic (PLEG): container finished" podID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerID="5b3b1134a54f6eca6c1d98df54177ce5b4f13629ff0b8e088ebee2e878ddc40b" exitCode=0 Jun 02 21:46:34.844785 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.844668 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" event={"ID":"e6fbed83-b1f1-4058-b6d4-ceb896463619","Type":"ContainerDied","Data":"5b3b1134a54f6eca6c1d98df54177ce5b4f13629ff0b8e088ebee2e878ddc40b"} Jun 02 21:46:34.846772 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.846756 2567 generic.go:358] "Generic (PLEG): container finished" podID="c7de961f-a59f-4218-9760-bf8326388b72" containerID="65f6c0b85d51ed11436c33461b91e15630f0af75b9e78cdbd246684a2f7c8613" exitCode=0 Jun 02 21:46:34.846868 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:34.846783 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" event={"ID":"c7de961f-a59f-4218-9760-bf8326388b72","Type":"ContainerDied","Data":"65f6c0b85d51ed11436c33461b91e15630f0af75b9e78cdbd246684a2f7c8613"} Jun 02 21:46:35.037155 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:46:35.037117 2567 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2a5bf9_131f_4c30_9636_bd54cf7f00d7.slice/crio-conmon-7b314f109b92b5c2b767ed9eb510f0c8d5796eff9483329fe6aecf766cf142cb.scope\": RecentStats: unable to find data in memory cache]" Jun 02 21:46:35.852361 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:35.852307 2567 generic.go:358] "Generic (PLEG): container finished" podID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerID="4d3781cd5424a9144da2a06203691ba0e635b605c0121c0505ec9f353fa1e21d" exitCode=0 Jun 02 21:46:35.852690 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:35.852359 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" event={"ID":"e6fbed83-b1f1-4058-b6d4-ceb896463619","Type":"ContainerDied","Data":"4d3781cd5424a9144da2a06203691ba0e635b605c0121c0505ec9f353fa1e21d"} Jun 02 21:46:35.854075 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:35.854055 2567 generic.go:358] "Generic (PLEG): container finished" podID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerID="8606ffbe3ccc42441cb5cfa12a21a7bbde3839b5bb9a847dd4f9bb876c955c84" exitCode=0 Jun 02 21:46:35.854152 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:35.854118 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" event={"ID":"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20","Type":"ContainerDied","Data":"8606ffbe3ccc42441cb5cfa12a21a7bbde3839b5bb9a847dd4f9bb876c955c84"} Jun 02 21:46:35.856117 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:35.856095 2567 generic.go:358] "Generic (PLEG): container finished" podID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerID="7b314f109b92b5c2b767ed9eb510f0c8d5796eff9483329fe6aecf766cf142cb" exitCode=0 Jun 02 21:46:35.856201 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:35.856181 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" event={"ID":"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7","Type":"ContainerDied","Data":"7b314f109b92b5c2b767ed9eb510f0c8d5796eff9483329fe6aecf766cf142cb"} Jun 02 21:46:35.981757 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:35.981649 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:36.008995 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.008967 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-util\") pod \"c7de961f-a59f-4218-9760-bf8326388b72\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " Jun 02 21:46:36.009186 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.009017 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkh8c\" (UniqueName: \"kubernetes.io/projected/c7de961f-a59f-4218-9760-bf8326388b72-kube-api-access-kkh8c\") pod \"c7de961f-a59f-4218-9760-bf8326388b72\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " Jun 02 21:46:36.009186 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.009061 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-bundle\") pod \"c7de961f-a59f-4218-9760-bf8326388b72\" (UID: \"c7de961f-a59f-4218-9760-bf8326388b72\") " Jun 02 21:46:36.009874 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.009786 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-bundle" (OuterVolumeSpecName: "bundle") pod "c7de961f-a59f-4218-9760-bf8326388b72" (UID: "c7de961f-a59f-4218-9760-bf8326388b72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:36.012281 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.012248 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7de961f-a59f-4218-9760-bf8326388b72-kube-api-access-kkh8c" (OuterVolumeSpecName: "kube-api-access-kkh8c") pod "c7de961f-a59f-4218-9760-bf8326388b72" (UID: "c7de961f-a59f-4218-9760-bf8326388b72"). InnerVolumeSpecName "kube-api-access-kkh8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:46:36.016684 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.016625 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-util" (OuterVolumeSpecName: "util") pod "c7de961f-a59f-4218-9760-bf8326388b72" (UID: "c7de961f-a59f-4218-9760-bf8326388b72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:36.110432 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.110395 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:36.110432 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.110426 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkh8c\" (UniqueName: \"kubernetes.io/projected/c7de961f-a59f-4218-9760-bf8326388b72-kube-api-access-kkh8c\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:36.110432 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.110437 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7de961f-a59f-4218-9760-bf8326388b72-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:36.861380 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.861348 2567 generic.go:358] "Generic (PLEG): container finished" podID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerID="a9532c6b7e164c83abccfbe9e2a937d06ba5ba1733cfc3c7d6d8c29543b670a0" exitCode=0 Jun 02 21:46:36.861791 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.861422 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" event={"ID":"e6fbed83-b1f1-4058-b6d4-ceb896463619","Type":"ContainerDied","Data":"a9532c6b7e164c83abccfbe9e2a937d06ba5ba1733cfc3c7d6d8c29543b670a0"} Jun 02 21:46:36.863116 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.863094 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" event={"ID":"c7de961f-a59f-4218-9760-bf8326388b72","Type":"ContainerDied","Data":"f13c81fa3e1669194c950e5b8f63cacecc192128346488c420c5b0495e910c9d"} Jun 02 21:46:36.863116 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.863118 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f13c81fa3e1669194c950e5b8f63cacecc192128346488c420c5b0495e910c9d" Jun 02 21:46:36.863292 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.863100 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb" Jun 02 21:46:36.864971 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.864946 2567 generic.go:358] "Generic (PLEG): container finished" podID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerID="9dc2ceca286371e99fa8c8afa17a16f22ce53e2445962471d01d588742ce7027" exitCode=0 Jun 02 21:46:36.865095 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.865012 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" event={"ID":"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20","Type":"ContainerDied","Data":"9dc2ceca286371e99fa8c8afa17a16f22ce53e2445962471d01d588742ce7027"} Jun 02 21:46:36.988274 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:36.988254 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:37.019147 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.019124 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsmvt\" (UniqueName: \"kubernetes.io/projected/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-kube-api-access-nsmvt\") pod \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " Jun 02 21:46:37.019271 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.019247 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-bundle\") pod \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " Jun 02 21:46:37.019360 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.019283 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-util\") pod \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\" (UID: \"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7\") " Jun 02 21:46:37.019988 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.019912 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-bundle" (OuterVolumeSpecName: "bundle") pod "6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" (UID: "6b2a5bf9-131f-4c30-9636-bd54cf7f00d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:37.021355 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.021305 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-kube-api-access-nsmvt" (OuterVolumeSpecName: "kube-api-access-nsmvt") pod "6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" (UID: "6b2a5bf9-131f-4c30-9636-bd54cf7f00d7"). InnerVolumeSpecName "kube-api-access-nsmvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:46:37.028293 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.028267 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-util" (OuterVolumeSpecName: "util") pod "6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" (UID: "6b2a5bf9-131f-4c30-9636-bd54cf7f00d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:37.120465 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.120406 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:37.120465 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.120428 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:37.120465 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.120438 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsmvt\" (UniqueName: \"kubernetes.io/projected/6b2a5bf9-131f-4c30-9636-bd54cf7f00d7-kube-api-access-nsmvt\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:37.869968 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.869936 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" Jun 02 21:46:37.869968 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.869935 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4" event={"ID":"6b2a5bf9-131f-4c30-9636-bd54cf7f00d7","Type":"ContainerDied","Data":"2e41042c40dc89c4ad90fe1e0b48ee608eef175fa61b9c657a7a220c0fc3b2fb"} Jun 02 21:46:37.870876 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:37.869986 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e41042c40dc89c4ad90fe1e0b48ee608eef175fa61b9c657a7a220c0fc3b2fb" Jun 02 21:46:38.016130 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.016110 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:38.019370 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.019351 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:46:38.028144 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.028121 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-util\") pod \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " Jun 02 21:46:38.028245 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.028172 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-bundle\") pod \"e6fbed83-b1f1-4058-b6d4-ceb896463619\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " Jun 02 21:46:38.028245 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.028229 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2lq5\" (UniqueName: \"kubernetes.io/projected/e6fbed83-b1f1-4058-b6d4-ceb896463619-kube-api-access-t2lq5\") pod \"e6fbed83-b1f1-4058-b6d4-ceb896463619\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " Jun 02 21:46:38.028384 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.028259 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5l74\" (UniqueName: \"kubernetes.io/projected/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-kube-api-access-q5l74\") pod \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " Jun 02 21:46:38.028384 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.028356 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-util\") pod \"e6fbed83-b1f1-4058-b6d4-ceb896463619\" (UID: \"e6fbed83-b1f1-4058-b6d4-ceb896463619\") " Jun 02 21:46:38.028487 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.028382 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-bundle\") pod \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\" (UID: \"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20\") " Jun 02 21:46:38.029033 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.029006 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-bundle" (OuterVolumeSpecName: "bundle") pod "b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" (UID: "b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:38.029125 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.029100 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-bundle" (OuterVolumeSpecName: "bundle") pod "e6fbed83-b1f1-4058-b6d4-ceb896463619" (UID: "e6fbed83-b1f1-4058-b6d4-ceb896463619"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:38.030905 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.030881 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6fbed83-b1f1-4058-b6d4-ceb896463619-kube-api-access-t2lq5" (OuterVolumeSpecName: "kube-api-access-t2lq5") pod "e6fbed83-b1f1-4058-b6d4-ceb896463619" (UID: "e6fbed83-b1f1-4058-b6d4-ceb896463619"). InnerVolumeSpecName "kube-api-access-t2lq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:46:38.031015 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.030930 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-kube-api-access-q5l74" (OuterVolumeSpecName: "kube-api-access-q5l74") pod "b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" (UID: "b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20"). InnerVolumeSpecName "kube-api-access-q5l74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:46:38.034897 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.034871 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-util" (OuterVolumeSpecName: "util") pod "e6fbed83-b1f1-4058-b6d4-ceb896463619" (UID: "e6fbed83-b1f1-4058-b6d4-ceb896463619"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:38.035387 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.035365 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-util" (OuterVolumeSpecName: "util") pod "b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" (UID: "b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:38.129267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.129196 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2lq5\" (UniqueName: \"kubernetes.io/projected/e6fbed83-b1f1-4058-b6d4-ceb896463619-kube-api-access-t2lq5\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:38.129267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.129224 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5l74\" (UniqueName: \"kubernetes.io/projected/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-kube-api-access-q5l74\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:38.129267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.129234 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:38.129267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.129244 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:38.129267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.129252 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:38.129267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.129260 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6fbed83-b1f1-4058-b6d4-ceb896463619-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:46:38.876152 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.876125 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" Jun 02 21:46:38.876567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.876145 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh" event={"ID":"b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20","Type":"ContainerDied","Data":"1a1abec0f36f8331a58aec84801a42c2f11d04d29964280da09e99deb541594c"} Jun 02 21:46:38.876567 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.876177 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a1abec0f36f8331a58aec84801a42c2f11d04d29964280da09e99deb541594c" Jun 02 21:46:38.878097 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.878071 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" event={"ID":"e6fbed83-b1f1-4058-b6d4-ceb896463619","Type":"ContainerDied","Data":"c96ef42ce3c33abe21e61a45bf9486588d2c5fba704dc8276bbb58f148cdd48f"} Jun 02 21:46:38.878214 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.878101 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c96ef42ce3c33abe21e61a45bf9486588d2c5fba704dc8276bbb58f148cdd48f" Jun 02 21:46:38.878214 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:46:38.878153 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h" Jun 02 21:47:06.158400 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158307 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw"] Jun 02 21:47:06.158773 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158732 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7de961f-a59f-4218-9760-bf8326388b72" containerName="pull" Jun 02 21:47:06.158773 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158746 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7de961f-a59f-4218-9760-bf8326388b72" containerName="pull" Jun 02 21:47:06.158773 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158755 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7de961f-a59f-4218-9760-bf8326388b72" containerName="extract" Jun 02 21:47:06.158773 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158761 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7de961f-a59f-4218-9760-bf8326388b72" containerName="extract" Jun 02 21:47:06.158773 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158774 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerName="util" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158780 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerName="util" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158788 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7de961f-a59f-4218-9760-bf8326388b72" containerName="util" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158794 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7de961f-a59f-4218-9760-bf8326388b72" containerName="util" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158798 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerName="pull" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158803 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerName="pull" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158814 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerName="util" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158820 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerName="util" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158825 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerName="pull" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158829 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerName="pull" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158836 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerName="extract" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158841 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerName="extract" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158846 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerName="extract" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158851 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerName="extract" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158859 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerName="util" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158863 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerName="util" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158869 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerName="extract" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158873 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerName="extract" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158878 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerName="pull" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158882 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerName="pull" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158933 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7de961f-a59f-4218-9760-bf8326388b72" containerName="extract" Jun 02 21:47:06.158933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158940 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6fbed83-b1f1-4058-b6d4-ceb896463619" containerName="extract" Jun 02 21:47:06.159674 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158949 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20" containerName="extract" Jun 02 21:47:06.159674 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.158956 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b2a5bf9-131f-4c30-9636-bd54cf7f00d7" containerName="extract" Jun 02 21:47:06.161857 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.161840 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.164603 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.164577 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 21:47:06.164708 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.164639 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 02 21:47:06.164708 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.164670 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vwmsl\"" Jun 02 21:47:06.164708 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.164683 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 02 21:47:06.165833 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.165816 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 21:47:06.174795 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.174776 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw"] Jun 02 21:47:06.262083 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.262049 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e966c09-bbab-4929-82e8-6fec7ccd90eb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-v7zxw\" (UID: \"2e966c09-bbab-4929-82e8-6fec7ccd90eb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.262274 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.262118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtc8c\" (UniqueName: \"kubernetes.io/projected/2e966c09-bbab-4929-82e8-6fec7ccd90eb-kube-api-access-xtc8c\") pod \"kuadrant-console-plugin-6cb54b5c86-v7zxw\" (UID: \"2e966c09-bbab-4929-82e8-6fec7ccd90eb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.262274 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.262178 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e966c09-bbab-4929-82e8-6fec7ccd90eb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-v7zxw\" (UID: \"2e966c09-bbab-4929-82e8-6fec7ccd90eb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.363720 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.363682 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e966c09-bbab-4929-82e8-6fec7ccd90eb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-v7zxw\" (UID: \"2e966c09-bbab-4929-82e8-6fec7ccd90eb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.363900 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.363744 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtc8c\" (UniqueName: \"kubernetes.io/projected/2e966c09-bbab-4929-82e8-6fec7ccd90eb-kube-api-access-xtc8c\") pod \"kuadrant-console-plugin-6cb54b5c86-v7zxw\" (UID: \"2e966c09-bbab-4929-82e8-6fec7ccd90eb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.363900 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.363761 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e966c09-bbab-4929-82e8-6fec7ccd90eb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-v7zxw\" (UID: \"2e966c09-bbab-4929-82e8-6fec7ccd90eb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.364414 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.364397 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e966c09-bbab-4929-82e8-6fec7ccd90eb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-v7zxw\" (UID: \"2e966c09-bbab-4929-82e8-6fec7ccd90eb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.366229 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.366210 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e966c09-bbab-4929-82e8-6fec7ccd90eb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-v7zxw\" (UID: \"2e966c09-bbab-4929-82e8-6fec7ccd90eb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.371528 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.371503 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtc8c\" (UniqueName: \"kubernetes.io/projected/2e966c09-bbab-4929-82e8-6fec7ccd90eb-kube-api-access-xtc8c\") pod \"kuadrant-console-plugin-6cb54b5c86-v7zxw\" (UID: \"2e966c09-bbab-4929-82e8-6fec7ccd90eb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.471880 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.471785 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" Jun 02 21:47:06.601983 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.601952 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw"] Jun 02 21:47:06.603348 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:47:06.603308 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e966c09_bbab_4929_82e8_6fec7ccd90eb.slice/crio-ead3aadc305d5b8679508d78c13264fd63349309ef2299d5d1a4244abcfd603d WatchSource:0}: Error finding container ead3aadc305d5b8679508d78c13264fd63349309ef2299d5d1a4244abcfd603d: Status 404 returned error can't find the container with id ead3aadc305d5b8679508d78c13264fd63349309ef2299d5d1a4244abcfd603d Jun 02 21:47:06.988206 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:06.988165 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" event={"ID":"2e966c09-bbab-4929-82e8-6fec7ccd90eb","Type":"ContainerStarted","Data":"ead3aadc305d5b8679508d78c13264fd63349309ef2299d5d1a4244abcfd603d"} Jun 02 21:47:15.798051 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:15.798017 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx"] Jun 02 21:47:15.801517 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:15.801501 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:15.806080 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:15.806060 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f8gcd\"" Jun 02 21:47:15.826570 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:15.826536 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx"] Jun 02 21:47:15.954199 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:15.954164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwxnk\" (UniqueName: \"kubernetes.io/projected/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-kube-api-access-bwxnk\") pod \"kuadrant-operator-controller-manager-84b657d985-sttfx\" (UID: \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:15.954364 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:15.954283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-sttfx\" (UID: \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:16.055793 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:16.055715 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-sttfx\" (UID: \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:16.055793 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:16.055783 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwxnk\" (UniqueName: \"kubernetes.io/projected/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-kube-api-access-bwxnk\") pod \"kuadrant-operator-controller-manager-84b657d985-sttfx\" (UID: \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:16.056138 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:16.056116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-sttfx\" (UID: \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:16.066950 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:16.066920 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwxnk\" (UniqueName: \"kubernetes.io/projected/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-kube-api-access-bwxnk\") pod \"kuadrant-operator-controller-manager-84b657d985-sttfx\" (UID: \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:16.111746 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:16.111717 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:16.231937 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:16.231906 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx"] Jun 02 21:47:16.242711 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:16.242681 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx"] Jun 02 21:47:28.898519 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:28.898481 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz"] Jun 02 21:47:29.185564 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:29.185478 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz"] Jun 02 21:47:29.185730 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:29.185559 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:47:29.288131 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:29.288096 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce896ea3-1194-419b-aab4-93069e515ddc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9wzfz\" (UID: \"ce896ea3-1194-419b-aab4-93069e515ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:47:29.288571 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:29.288311 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4sdm\" (UniqueName: \"kubernetes.io/projected/ce896ea3-1194-419b-aab4-93069e515ddc-kube-api-access-q4sdm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9wzfz\" (UID: \"ce896ea3-1194-419b-aab4-93069e515ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:47:29.388835 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:29.388808 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4sdm\" (UniqueName: \"kubernetes.io/projected/ce896ea3-1194-419b-aab4-93069e515ddc-kube-api-access-q4sdm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9wzfz\" (UID: \"ce896ea3-1194-419b-aab4-93069e515ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:47:29.388962 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:29.388862 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce896ea3-1194-419b-aab4-93069e515ddc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9wzfz\" (UID: \"ce896ea3-1194-419b-aab4-93069e515ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:47:29.389297 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:29.389276 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce896ea3-1194-419b-aab4-93069e515ddc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9wzfz\" (UID: \"ce896ea3-1194-419b-aab4-93069e515ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:47:29.413373 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:29.413315 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4sdm\" (UniqueName: \"kubernetes.io/projected/ce896ea3-1194-419b-aab4-93069e515ddc-kube-api-access-q4sdm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9wzfz\" (UID: \"ce896ea3-1194-419b-aab4-93069e515ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:47:29.498737 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:29.498656 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:47:30.404095 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:30.404064 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz"] Jun 02 21:47:30.486689 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:47:30.486659 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce896ea3_1194_419b_aab4_93069e515ddc.slice/crio-f544c31bc99a1e77b1b0a5c8e908976d68d2c22a1de3aefaef0f6bc5412a519d WatchSource:0}: Error finding container f544c31bc99a1e77b1b0a5c8e908976d68d2c22a1de3aefaef0f6bc5412a519d: Status 404 returned error can't find the container with id f544c31bc99a1e77b1b0a5c8e908976d68d2c22a1de3aefaef0f6bc5412a519d Jun 02 21:47:31.097752 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:31.097717 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" event={"ID":"ce896ea3-1194-419b-aab4-93069e515ddc","Type":"ContainerStarted","Data":"f544c31bc99a1e77b1b0a5c8e908976d68d2c22a1de3aefaef0f6bc5412a519d"} Jun 02 21:47:31.099094 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:31.099048 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" event={"ID":"2e966c09-bbab-4929-82e8-6fec7ccd90eb","Type":"ContainerStarted","Data":"29cd3743dad2e515e3745577ae3defb30323bb13ab18f6fa1daddce59e1ac172"} Jun 02 21:47:31.122466 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:31.122425 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-v7zxw" podStartSLOduration=1.189314247 podStartE2EDuration="25.122412636s" podCreationTimestamp="2026-06-02 21:47:06 +0000 UTC" firstStartedPulling="2026-06-02 21:47:06.604935334 +0000 UTC m=+433.046383332" lastFinishedPulling="2026-06-02 21:47:30.538033723 +0000 UTC m=+456.979481721" observedRunningTime="2026-06-02 21:47:31.119521124 +0000 UTC m=+457.560969142" watchObservedRunningTime="2026-06-02 21:47:31.122412636 +0000 UTC m=+457.563860654" Jun 02 21:47:32.908754 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:47:32.908701 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecc3bf8_659b_43e0_9e11_c3eece9bef31.slice/crio-fb81a46b0d4ea80ed660712fb8f686649f27a516d80cb4cabc9dbb32b412c32b WatchSource:0}: Error finding container fb81a46b0d4ea80ed660712fb8f686649f27a516d80cb4cabc9dbb32b412c32b: Status 404 returned error can't find the container with id fb81a46b0d4ea80ed660712fb8f686649f27a516d80cb4cabc9dbb32b412c32b Jun 02 21:47:34.769308 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.769245 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d5947bd59-4j8kc"] Jun 02 21:47:34.791243 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.791183 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5947bd59-4j8kc"] Jun 02 21:47:34.791243 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.791231 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.839518 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.839477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-service-ca\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.839661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.839537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-trusted-ca-bundle\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.839661 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.839638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-console-config\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.839789 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.839717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/282d8a90-938d-419f-9ff4-1b06a9f5e10e-console-oauth-config\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.839834 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.839806 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-oauth-serving-cert\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.839869 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.839853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxfm8\" (UniqueName: \"kubernetes.io/projected/282d8a90-938d-419f-9ff4-1b06a9f5e10e-kube-api-access-vxfm8\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.839913 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.839901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/282d8a90-938d-419f-9ff4-1b06a9f5e10e-console-serving-cert\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.940846 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.940809 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/282d8a90-938d-419f-9ff4-1b06a9f5e10e-console-oauth-config\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.940988 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.940869 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-oauth-serving-cert\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.940988 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.940897 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxfm8\" (UniqueName: \"kubernetes.io/projected/282d8a90-938d-419f-9ff4-1b06a9f5e10e-kube-api-access-vxfm8\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.940988 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.940939 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/282d8a90-938d-419f-9ff4-1b06a9f5e10e-console-serving-cert\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.940988 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.940972 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-service-ca\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.941198 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.941009 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-trusted-ca-bundle\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.941198 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.941038 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-console-config\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.941775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.941747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-oauth-serving-cert\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.941775 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.941760 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-console-config\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.942242 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.942184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-trusted-ca-bundle\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.942242 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.942184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/282d8a90-938d-419f-9ff4-1b06a9f5e10e-service-ca\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.944591 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.944546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/282d8a90-938d-419f-9ff4-1b06a9f5e10e-console-serving-cert\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.944963 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.944942 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/282d8a90-938d-419f-9ff4-1b06a9f5e10e-console-oauth-config\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:34.950169 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:34.950147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxfm8\" (UniqueName: \"kubernetes.io/projected/282d8a90-938d-419f-9ff4-1b06a9f5e10e-kube-api-access-vxfm8\") pod \"console-d5947bd59-4j8kc\" (UID: \"282d8a90-938d-419f-9ff4-1b06a9f5e10e\") " pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:35.104113 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:35.104070 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:35.908854 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:35.908683 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5947bd59-4j8kc"] Jun 02 21:47:35.911630 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:47:35.911606 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282d8a90_938d_419f_9ff4_1b06a9f5e10e.slice/crio-5092e7c27452109daf7531818f48303b0c2180aa44cddddd4cdafd016a5e9a53 WatchSource:0}: Error finding container 5092e7c27452109daf7531818f48303b0c2180aa44cddddd4cdafd016a5e9a53: Status 404 returned error can't find the container with id 5092e7c27452109daf7531818f48303b0c2180aa44cddddd4cdafd016a5e9a53 Jun 02 21:47:36.120618 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.120587 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5947bd59-4j8kc" event={"ID":"282d8a90-938d-419f-9ff4-1b06a9f5e10e","Type":"ContainerStarted","Data":"c3fd307230c5fa1a22bb106d21f2cd55fdafef9adeb6b0f9f7dd3fbf9d14d598"} Jun 02 21:47:36.120743 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.120628 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5947bd59-4j8kc" event={"ID":"282d8a90-938d-419f-9ff4-1b06a9f5e10e","Type":"ContainerStarted","Data":"5092e7c27452109daf7531818f48303b0c2180aa44cddddd4cdafd016a5e9a53"} Jun 02 21:47:36.122017 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.121995 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" event={"ID":"ce896ea3-1194-419b-aab4-93069e515ddc","Type":"ContainerStarted","Data":"de8b1f6cd1ebb328094538d7610c24bd75d6319d3d60b9ee64deb351cd5e6d53"} Jun 02 21:47:36.122146 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.122126 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:47:36.123429 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.123406 2567 generic.go:358] "Generic (PLEG): container finished" podID="0ecc3bf8-659b-43e0-9e11-c3eece9bef31" containerID="615fe15cd29c328da0ab6bf7e60c1d903615da854b8d14d9c5517422e170972a" exitCode=1 Jun 02 21:47:36.141758 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.141706 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d5947bd59-4j8kc" podStartSLOduration=2.141689119 podStartE2EDuration="2.141689119s" podCreationTimestamp="2026-06-02 21:47:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:47:36.138892446 +0000 UTC m=+462.580340488" watchObservedRunningTime="2026-06-02 21:47:36.141689119 +0000 UTC m=+462.583137139" Jun 02 21:47:36.158653 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.158596 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" podStartSLOduration=2.833322658 podStartE2EDuration="8.15857898s" podCreationTimestamp="2026-06-02 21:47:28 +0000 UTC" firstStartedPulling="2026-06-02 21:47:30.504521268 +0000 UTC m=+456.945969277" lastFinishedPulling="2026-06-02 21:47:35.829777596 +0000 UTC m=+462.271225599" observedRunningTime="2026-06-02 21:47:36.157431043 +0000 UTC m=+462.598879063" watchObservedRunningTime="2026-06-02 21:47:36.15857898 +0000 UTC m=+462.600027000" Jun 02 21:47:36.166614 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.166595 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:36.169359 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.169335 2567 status_manager.go:895] "Failed to get status for pod" podUID="0ecc3bf8-659b-43e0-9e11-c3eece9bef31" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" err="pods \"kuadrant-operator-controller-manager-84b657d985-sttfx\" is forbidden: User \"system:node:ip-10-0-135-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-204.ec2.internal' and this object" Jun 02 21:47:36.252750 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.252721 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-extensions-socket-volume\") pod \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\" (UID: \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\") " Jun 02 21:47:36.252859 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.252811 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwxnk\" (UniqueName: \"kubernetes.io/projected/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-kube-api-access-bwxnk\") pod \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\" (UID: \"0ecc3bf8-659b-43e0-9e11-c3eece9bef31\") " Jun 02 21:47:36.252995 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.252969 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0ecc3bf8-659b-43e0-9e11-c3eece9bef31" (UID: "0ecc3bf8-659b-43e0-9e11-c3eece9bef31"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:47:36.253476 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.253455 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-extensions-socket-volume\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:47:36.255025 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.255006 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-kube-api-access-bwxnk" (OuterVolumeSpecName: "kube-api-access-bwxnk") pod "0ecc3bf8-659b-43e0-9e11-c3eece9bef31" (UID: "0ecc3bf8-659b-43e0-9e11-c3eece9bef31"). InnerVolumeSpecName "kube-api-access-bwxnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:47:36.354867 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:36.354805 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwxnk\" (UniqueName: \"kubernetes.io/projected/0ecc3bf8-659b-43e0-9e11-c3eece9bef31-kube-api-access-bwxnk\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:47:37.128564 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:37.128533 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" Jun 02 21:47:37.128564 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:37.128524 2567 scope.go:117] "RemoveContainer" containerID="615fe15cd29c328da0ab6bf7e60c1d903615da854b8d14d9c5517422e170972a" Jun 02 21:47:37.131499 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:37.131466 2567 status_manager.go:895] "Failed to get status for pod" podUID="0ecc3bf8-659b-43e0-9e11-c3eece9bef31" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" err="pods \"kuadrant-operator-controller-manager-84b657d985-sttfx\" is forbidden: User \"system:node:ip-10-0-135-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-204.ec2.internal' and this object" Jun 02 21:47:37.139570 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:37.139544 2567 status_manager.go:895] "Failed to get status for pod" podUID="0ecc3bf8-659b-43e0-9e11-c3eece9bef31" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sttfx" err="pods \"kuadrant-operator-controller-manager-84b657d985-sttfx\" is forbidden: User \"system:node:ip-10-0-135-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-204.ec2.internal' and this object" Jun 02 21:47:38.129018 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:38.128981 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ecc3bf8-659b-43e0-9e11-c3eece9bef31" path="/var/lib/kubelet/pods/0ecc3bf8-659b-43e0-9e11-c3eece9bef31/volumes" Jun 02 21:47:45.104961 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:45.104930 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:45.105369 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:45.104980 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:45.109709 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:45.109686 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:45.172426 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:45.172396 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d5947bd59-4j8kc" Jun 02 21:47:45.276862 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:45.276829 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-587f6fb5d5-5k2s7"] Jun 02 21:47:47.131480 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:47:47.131440 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9wzfz" Jun 02 21:48:06.487217 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.487185 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-2mws7"] Jun 02 21:48:06.487671 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.487555 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ecc3bf8-659b-43e0-9e11-c3eece9bef31" containerName="manager" Jun 02 21:48:06.487671 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.487567 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ecc3bf8-659b-43e0-9e11-c3eece9bef31" containerName="manager" Jun 02 21:48:06.487671 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.487650 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ecc3bf8-659b-43e0-9e11-c3eece9bef31" containerName="manager" Jun 02 21:48:06.539006 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.538979 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-2mws7"] Jun 02 21:48:06.539155 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.539075 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-2mws7" Jun 02 21:48:06.542713 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.542689 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8w9n7\"" Jun 02 21:48:06.691253 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.691226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zgz4\" (UniqueName: \"kubernetes.io/projected/6e37c276-7bf8-4a9a-994b-5c196c399bc2-kube-api-access-7zgz4\") pod \"authorino-7498df8756-2mws7\" (UID: \"6e37c276-7bf8-4a9a-994b-5c196c399bc2\") " pod="kuadrant-system/authorino-7498df8756-2mws7" Jun 02 21:48:06.792615 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.792546 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zgz4\" (UniqueName: \"kubernetes.io/projected/6e37c276-7bf8-4a9a-994b-5c196c399bc2-kube-api-access-7zgz4\") pod \"authorino-7498df8756-2mws7\" (UID: \"6e37c276-7bf8-4a9a-994b-5c196c399bc2\") " pod="kuadrant-system/authorino-7498df8756-2mws7" Jun 02 21:48:06.805663 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.805627 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zgz4\" (UniqueName: \"kubernetes.io/projected/6e37c276-7bf8-4a9a-994b-5c196c399bc2-kube-api-access-7zgz4\") pod \"authorino-7498df8756-2mws7\" (UID: \"6e37c276-7bf8-4a9a-994b-5c196c399bc2\") " pod="kuadrant-system/authorino-7498df8756-2mws7" Jun 02 21:48:06.848230 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.848205 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-2mws7" Jun 02 21:48:06.991435 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:06.991404 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-2mws7"] Jun 02 21:48:06.991934 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:48:06.991905 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e37c276_7bf8_4a9a_994b_5c196c399bc2.slice/crio-680a66103d712edf3c18cc3c9eab03ffcb69872a5c57580f20591e424ff2e1d3 WatchSource:0}: Error finding container 680a66103d712edf3c18cc3c9eab03ffcb69872a5c57580f20591e424ff2e1d3: Status 404 returned error can't find the container with id 680a66103d712edf3c18cc3c9eab03ffcb69872a5c57580f20591e424ff2e1d3 Jun 02 21:48:07.261061 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:07.261031 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-2mws7" event={"ID":"6e37c276-7bf8-4a9a-994b-5c196c399bc2","Type":"ContainerStarted","Data":"680a66103d712edf3c18cc3c9eab03ffcb69872a5c57580f20591e424ff2e1d3"} Jun 02 21:48:10.278637 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.278604 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-2mws7" event={"ID":"6e37c276-7bf8-4a9a-994b-5c196c399bc2","Type":"ContainerStarted","Data":"30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650"} Jun 02 21:48:10.302424 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.302380 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-2mws7" podStartSLOduration=1.541341864 podStartE2EDuration="4.302368003s" podCreationTimestamp="2026-06-02 21:48:06 +0000 UTC" firstStartedPulling="2026-06-02 21:48:06.99316342 +0000 UTC m=+493.434611418" lastFinishedPulling="2026-06-02 21:48:09.75418956 +0000 UTC m=+496.195637557" observedRunningTime="2026-06-02 21:48:10.302278869 +0000 UTC m=+496.743726888" watchObservedRunningTime="2026-06-02 21:48:10.302368003 +0000 UTC m=+496.743816022" Jun 02 21:48:10.303618 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.303588 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-587f6fb5d5-5k2s7" podUID="6083f760-7c9b-4e96-8e69-9272cdc25aa0" containerName="console" containerID="cri-o://4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a" gracePeriod=15 Jun 02 21:48:10.543590 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.543570 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-587f6fb5d5-5k2s7_6083f760-7c9b-4e96-8e69-9272cdc25aa0/console/0.log" Jun 02 21:48:10.543696 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.543629 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:48:10.626389 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626360 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-trusted-ca-bundle\") pod \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " Jun 02 21:48:10.626524 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626398 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-config\") pod \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " Jun 02 21:48:10.626524 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626465 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-oauth-config\") pod \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " Jun 02 21:48:10.626524 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626519 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndzc8\" (UniqueName: \"kubernetes.io/projected/6083f760-7c9b-4e96-8e69-9272cdc25aa0-kube-api-access-ndzc8\") pod \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " Jun 02 21:48:10.626682 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626550 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-serving-cert\") pod \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " Jun 02 21:48:10.626682 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626575 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-service-ca\") pod \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " Jun 02 21:48:10.626682 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626600 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-oauth-serving-cert\") pod \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\" (UID: \"6083f760-7c9b-4e96-8e69-9272cdc25aa0\") " Jun 02 21:48:10.626829 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626747 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6083f760-7c9b-4e96-8e69-9272cdc25aa0" (UID: "6083f760-7c9b-4e96-8e69-9272cdc25aa0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:48:10.626829 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626797 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-config" (OuterVolumeSpecName: "console-config") pod "6083f760-7c9b-4e96-8e69-9272cdc25aa0" (UID: "6083f760-7c9b-4e96-8e69-9272cdc25aa0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:48:10.626944 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626923 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-trusted-ca-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:10.626944 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626945 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:10.627140 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.626961 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-service-ca" (OuterVolumeSpecName: "service-ca") pod "6083f760-7c9b-4e96-8e69-9272cdc25aa0" (UID: "6083f760-7c9b-4e96-8e69-9272cdc25aa0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:48:10.627140 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.627123 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6083f760-7c9b-4e96-8e69-9272cdc25aa0" (UID: "6083f760-7c9b-4e96-8e69-9272cdc25aa0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:48:10.628992 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.628972 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6083f760-7c9b-4e96-8e69-9272cdc25aa0" (UID: "6083f760-7c9b-4e96-8e69-9272cdc25aa0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:48:10.629312 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.629294 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6083f760-7c9b-4e96-8e69-9272cdc25aa0-kube-api-access-ndzc8" (OuterVolumeSpecName: "kube-api-access-ndzc8") pod "6083f760-7c9b-4e96-8e69-9272cdc25aa0" (UID: "6083f760-7c9b-4e96-8e69-9272cdc25aa0"). InnerVolumeSpecName "kube-api-access-ndzc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:48:10.629403 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.629344 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6083f760-7c9b-4e96-8e69-9272cdc25aa0" (UID: "6083f760-7c9b-4e96-8e69-9272cdc25aa0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:48:10.727966 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.727943 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndzc8\" (UniqueName: \"kubernetes.io/projected/6083f760-7c9b-4e96-8e69-9272cdc25aa0-kube-api-access-ndzc8\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:10.727966 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.727965 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:10.728083 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.727975 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-service-ca\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:10.728083 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.727984 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6083f760-7c9b-4e96-8e69-9272cdc25aa0-oauth-serving-cert\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:10.728083 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:10.727993 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6083f760-7c9b-4e96-8e69-9272cdc25aa0-console-oauth-config\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:11.284562 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.284540 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-587f6fb5d5-5k2s7_6083f760-7c9b-4e96-8e69-9272cdc25aa0/console/0.log" Jun 02 21:48:11.284976 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.284581 2567 generic.go:358] "Generic (PLEG): container finished" podID="6083f760-7c9b-4e96-8e69-9272cdc25aa0" containerID="4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a" exitCode=2 Jun 02 21:48:11.284976 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.284656 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-587f6fb5d5-5k2s7" Jun 02 21:48:11.284976 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.284686 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-587f6fb5d5-5k2s7" event={"ID":"6083f760-7c9b-4e96-8e69-9272cdc25aa0","Type":"ContainerDied","Data":"4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a"} Jun 02 21:48:11.284976 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.284736 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-587f6fb5d5-5k2s7" event={"ID":"6083f760-7c9b-4e96-8e69-9272cdc25aa0","Type":"ContainerDied","Data":"aa97d14169a48f883993b2d229bd22963a42a1838f752dcf31fd2832fb8e4342"} Jun 02 21:48:11.284976 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.284760 2567 scope.go:117] "RemoveContainer" containerID="4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a" Jun 02 21:48:11.295348 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.295311 2567 scope.go:117] "RemoveContainer" containerID="4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a" Jun 02 21:48:11.295636 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:48:11.295617 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a\": container with ID starting with 4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a not found: ID does not exist" containerID="4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a" Jun 02 21:48:11.295696 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.295645 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a"} err="failed to get container status \"4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a\": rpc error: code = NotFound desc = could not find container \"4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a\": container with ID starting with 4d93363ccedddd1903223d1d27d4d1cd522a612490e8019df2ec492a6c49570a not found: ID does not exist" Jun 02 21:48:11.308823 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.308797 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-587f6fb5d5-5k2s7"] Jun 02 21:48:11.312844 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:11.312823 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-587f6fb5d5-5k2s7"] Jun 02 21:48:12.127875 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:12.127835 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6083f760-7c9b-4e96-8e69-9272cdc25aa0" path="/var/lib/kubelet/pods/6083f760-7c9b-4e96-8e69-9272cdc25aa0/volumes" Jun 02 21:48:36.540082 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.540044 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz"] Jun 02 21:48:36.540625 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.540605 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6083f760-7c9b-4e96-8e69-9272cdc25aa0" containerName="console" Jun 02 21:48:36.540704 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.540628 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6083f760-7c9b-4e96-8e69-9272cdc25aa0" containerName="console" Jun 02 21:48:36.540792 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.540780 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="6083f760-7c9b-4e96-8e69-9272cdc25aa0" containerName="console" Jun 02 21:48:36.542855 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.542835 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.546697 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.546676 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:48:36.547927 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.547904 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:48:36.547999 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.547933 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j4swd\"" Jun 02 21:48:36.555600 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.555583 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz"] Jun 02 21:48:36.619001 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.618973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.619001 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.619003 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.619149 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.619023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5zvq\" (UniqueName: \"kubernetes.io/projected/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-kube-api-access-t5zvq\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.720152 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.720120 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.720253 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.720159 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.720253 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.720192 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5zvq\" (UniqueName: \"kubernetes.io/projected/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-kube-api-access-t5zvq\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.720570 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.720550 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.720570 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.720563 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.732207 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.732188 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5zvq\" (UniqueName: \"kubernetes.io/projected/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-kube-api-access-t5zvq\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.852230 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.852207 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:36.991027 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:36.991003 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz"] Jun 02 21:48:36.991992 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:48:36.991967 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447e0e9e_a54c_40b7_a11b_4e83fde5b6fe.slice/crio-f8d3a271238e9afa3303e449dd523b2cba744778748dfba6c18066fa50855801 WatchSource:0}: Error finding container f8d3a271238e9afa3303e449dd523b2cba744778748dfba6c18066fa50855801: Status 404 returned error can't find the container with id f8d3a271238e9afa3303e449dd523b2cba744778748dfba6c18066fa50855801 Jun 02 21:48:37.391207 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:37.391177 2567 generic.go:358] "Generic (PLEG): container finished" podID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerID="74a3c1b25ccb640df1d5930f2469394f8274a375c09be0c550ebb4824a48ddef" exitCode=0 Jun 02 21:48:37.391360 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:37.391266 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" event={"ID":"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe","Type":"ContainerDied","Data":"74a3c1b25ccb640df1d5930f2469394f8274a375c09be0c550ebb4824a48ddef"} Jun 02 21:48:37.391360 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:37.391300 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" event={"ID":"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe","Type":"ContainerStarted","Data":"f8d3a271238e9afa3303e449dd523b2cba744778748dfba6c18066fa50855801"} Jun 02 21:48:38.395801 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:38.395774 2567 generic.go:358] "Generic (PLEG): container finished" podID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerID="e360f7067a02980deaa21e503ce41cb17791e178eede16b41fd54da3dbbed882" exitCode=0 Jun 02 21:48:38.396177 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:38.395858 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" event={"ID":"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe","Type":"ContainerDied","Data":"e360f7067a02980deaa21e503ce41cb17791e178eede16b41fd54da3dbbed882"} Jun 02 21:48:39.401626 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:39.401596 2567 generic.go:358] "Generic (PLEG): container finished" podID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerID="815c8cd91fc00cab7225cf1c0e8c7d9136348cce9da521dafec64c497c86580b" exitCode=0 Jun 02 21:48:39.401954 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:39.401677 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" event={"ID":"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe","Type":"ContainerDied","Data":"815c8cd91fc00cab7225cf1c0e8c7d9136348cce9da521dafec64c497c86580b"} Jun 02 21:48:40.536372 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.536351 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:40.651680 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.651658 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5zvq\" (UniqueName: \"kubernetes.io/projected/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-kube-api-access-t5zvq\") pod \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " Jun 02 21:48:40.651811 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.651766 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-bundle\") pod \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " Jun 02 21:48:40.651811 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.651791 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-util\") pod \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\" (UID: \"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe\") " Jun 02 21:48:40.652348 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.652301 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-bundle" (OuterVolumeSpecName: "bundle") pod "447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" (UID: "447e0e9e-a54c-40b7-a11b-4e83fde5b6fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:40.653704 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.653682 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-kube-api-access-t5zvq" (OuterVolumeSpecName: "kube-api-access-t5zvq") pod "447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" (UID: "447e0e9e-a54c-40b7-a11b-4e83fde5b6fe"). InnerVolumeSpecName "kube-api-access-t5zvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:48:40.658157 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.658101 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-util" (OuterVolumeSpecName: "util") pod "447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" (UID: "447e0e9e-a54c-40b7-a11b-4e83fde5b6fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:40.753212 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.753189 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-bundle\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:40.753212 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.753213 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-util\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:40.753342 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:40.753224 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5zvq\" (UniqueName: \"kubernetes.io/projected/447e0e9e-a54c-40b7-a11b-4e83fde5b6fe-kube-api-access-t5zvq\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:48:41.410392 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:41.410368 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" Jun 02 21:48:41.410528 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:41.410357 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704bfdz" event={"ID":"447e0e9e-a54c-40b7-a11b-4e83fde5b6fe","Type":"ContainerDied","Data":"f8d3a271238e9afa3303e449dd523b2cba744778748dfba6c18066fa50855801"} Jun 02 21:48:41.410528 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:48:41.410475 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8d3a271238e9afa3303e449dd523b2cba744778748dfba6c18066fa50855801" Jun 02 21:49:29.734019 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.733984 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xqhng"] Jun 02 21:49:29.734462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.734343 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerName="util" Jun 02 21:49:29.734462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.734354 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerName="util" Jun 02 21:49:29.734462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.734361 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerName="extract" Jun 02 21:49:29.734462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.734367 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerName="extract" Jun 02 21:49:29.734462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.734375 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerName="pull" Jun 02 21:49:29.734462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.734380 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerName="pull" Jun 02 21:49:29.734462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.734433 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="447e0e9e-a54c-40b7-a11b-4e83fde5b6fe" containerName="extract" Jun 02 21:49:29.737774 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.737760 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xqhng" Jun 02 21:49:29.746467 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.746443 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xqhng"] Jun 02 21:49:29.817262 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.817239 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2nrj\" (UniqueName: \"kubernetes.io/projected/84dfa5ec-458e-4dc7-898e-d070af1d965b-kube-api-access-w2nrj\") pod \"authorino-8b475cf9f-xqhng\" (UID: \"84dfa5ec-458e-4dc7-898e-d070af1d965b\") " pod="kuadrant-system/authorino-8b475cf9f-xqhng" Jun 02 21:49:29.917910 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.917886 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2nrj\" (UniqueName: \"kubernetes.io/projected/84dfa5ec-458e-4dc7-898e-d070af1d965b-kube-api-access-w2nrj\") pod \"authorino-8b475cf9f-xqhng\" (UID: \"84dfa5ec-458e-4dc7-898e-d070af1d965b\") " pod="kuadrant-system/authorino-8b475cf9f-xqhng" Jun 02 21:49:29.926797 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.926776 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2nrj\" (UniqueName: \"kubernetes.io/projected/84dfa5ec-458e-4dc7-898e-d070af1d965b-kube-api-access-w2nrj\") pod \"authorino-8b475cf9f-xqhng\" (UID: \"84dfa5ec-458e-4dc7-898e-d070af1d965b\") " pod="kuadrant-system/authorino-8b475cf9f-xqhng" Jun 02 21:49:29.985524 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.985461 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xqhng"] Jun 02 21:49:29.985665 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:29.985650 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xqhng" Jun 02 21:49:30.012008 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.011981 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-hxg9c"] Jun 02 21:49:30.016908 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.016885 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" Jun 02 21:49:30.019133 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.019100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fw94\" (UniqueName: \"kubernetes.io/projected/379df9e1-89d9-40f3-81bf-ef6cb880d1d0-kube-api-access-4fw94\") pod \"authorino-5459bdcdf7-hxg9c\" (UID: \"379df9e1-89d9-40f3-81bf-ef6cb880d1d0\") " pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" Jun 02 21:49:30.021786 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.021753 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-hxg9c"] Jun 02 21:49:30.113440 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.113409 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xqhng"] Jun 02 21:49:30.114985 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:49:30.114959 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84dfa5ec_458e_4dc7_898e_d070af1d965b.slice/crio-7fa67f13c6c9b0f8d2f3c04f72f53d6e3de8a52b0694356fe1e1911fb97ebc53 WatchSource:0}: Error finding container 7fa67f13c6c9b0f8d2f3c04f72f53d6e3de8a52b0694356fe1e1911fb97ebc53: Status 404 returned error can't find the container with id 7fa67f13c6c9b0f8d2f3c04f72f53d6e3de8a52b0694356fe1e1911fb97ebc53 Jun 02 21:49:30.120019 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.119996 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fw94\" (UniqueName: \"kubernetes.io/projected/379df9e1-89d9-40f3-81bf-ef6cb880d1d0-kube-api-access-4fw94\") pod \"authorino-5459bdcdf7-hxg9c\" (UID: \"379df9e1-89d9-40f3-81bf-ef6cb880d1d0\") " pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" Jun 02 21:49:30.128736 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.128713 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fw94\" (UniqueName: \"kubernetes.io/projected/379df9e1-89d9-40f3-81bf-ef6cb880d1d0-kube-api-access-4fw94\") pod \"authorino-5459bdcdf7-hxg9c\" (UID: \"379df9e1-89d9-40f3-81bf-ef6cb880d1d0\") " pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" Jun 02 21:49:30.301528 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.301477 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-hxg9c"] Jun 02 21:49:30.301674 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.301663 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" Jun 02 21:49:30.432596 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.432572 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-hxg9c"] Jun 02 21:49:30.433902 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:49:30.433877 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod379df9e1_89d9_40f3_81bf_ef6cb880d1d0.slice/crio-a4b645634d38b72e41c6d733eacc489ebd97f0e899b2b4f2eb570349a5c3f929 WatchSource:0}: Error finding container a4b645634d38b72e41c6d733eacc489ebd97f0e899b2b4f2eb570349a5c3f929: Status 404 returned error can't find the container with id a4b645634d38b72e41c6d733eacc489ebd97f0e899b2b4f2eb570349a5c3f929 Jun 02 21:49:30.585062 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.585026 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" event={"ID":"379df9e1-89d9-40f3-81bf-ef6cb880d1d0","Type":"ContainerStarted","Data":"a4b645634d38b72e41c6d733eacc489ebd97f0e899b2b4f2eb570349a5c3f929"} Jun 02 21:49:30.586229 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.586201 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xqhng" event={"ID":"84dfa5ec-458e-4dc7-898e-d070af1d965b","Type":"ContainerStarted","Data":"7fa67f13c6c9b0f8d2f3c04f72f53d6e3de8a52b0694356fe1e1911fb97ebc53"} Jun 02 21:49:30.617128 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.617107 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-z7b8f"] Jun 02 21:49:30.620726 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.620710 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" Jun 02 21:49:30.624467 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.624441 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-z7b8f"] Jun 02 21:49:30.624701 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.624681 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9bjb\" (UniqueName: \"kubernetes.io/projected/9b20379d-ce1f-4742-9eaf-fb330b35e149-kube-api-access-j9bjb\") pod \"authorino-5459bdcdf7-z7b8f\" (UID: \"9b20379d-ce1f-4742-9eaf-fb330b35e149\") " pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" Jun 02 21:49:30.725734 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.725707 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bjb\" (UniqueName: \"kubernetes.io/projected/9b20379d-ce1f-4742-9eaf-fb330b35e149-kube-api-access-j9bjb\") pod \"authorino-5459bdcdf7-z7b8f\" (UID: \"9b20379d-ce1f-4742-9eaf-fb330b35e149\") " pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" Jun 02 21:49:30.734052 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.734031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9bjb\" (UniqueName: \"kubernetes.io/projected/9b20379d-ce1f-4742-9eaf-fb330b35e149-kube-api-access-j9bjb\") pod \"authorino-5459bdcdf7-z7b8f\" (UID: \"9b20379d-ce1f-4742-9eaf-fb330b35e149\") " pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" Jun 02 21:49:30.932461 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:30.932432 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" Jun 02 21:49:31.056906 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.056882 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-z7b8f"] Jun 02 21:49:31.058554 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:49:31.058526 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b20379d_ce1f_4742_9eaf_fb330b35e149.slice/crio-e84a9d833e09d56dc8901b89ef6b84db9ee496956577c7414b22f0756122b99c WatchSource:0}: Error finding container e84a9d833e09d56dc8901b89ef6b84db9ee496956577c7414b22f0756122b99c: Status 404 returned error can't find the container with id e84a9d833e09d56dc8901b89ef6b84db9ee496956577c7414b22f0756122b99c Jun 02 21:49:31.593917 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.593881 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" event={"ID":"9b20379d-ce1f-4742-9eaf-fb330b35e149","Type":"ContainerStarted","Data":"043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101"} Jun 02 21:49:31.593917 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.593919 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" event={"ID":"9b20379d-ce1f-4742-9eaf-fb330b35e149","Type":"ContainerStarted","Data":"e84a9d833e09d56dc8901b89ef6b84db9ee496956577c7414b22f0756122b99c"} Jun 02 21:49:31.595448 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.595406 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" event={"ID":"379df9e1-89d9-40f3-81bf-ef6cb880d1d0","Type":"ContainerStarted","Data":"bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c"} Jun 02 21:49:31.595629 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.595482 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" podUID="379df9e1-89d9-40f3-81bf-ef6cb880d1d0" containerName="authorino" containerID="cri-o://bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c" gracePeriod=30 Jun 02 21:49:31.597006 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.596982 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xqhng" event={"ID":"84dfa5ec-458e-4dc7-898e-d070af1d965b","Type":"ContainerStarted","Data":"45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee"} Jun 02 21:49:31.597120 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.597065 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-xqhng" podUID="84dfa5ec-458e-4dc7-898e-d070af1d965b" containerName="authorino" containerID="cri-o://45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee" gracePeriod=30 Jun 02 21:49:31.615813 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.615774 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" podStartSLOduration=1.208752046 podStartE2EDuration="1.615761748s" podCreationTimestamp="2026-06-02 21:49:30 +0000 UTC" firstStartedPulling="2026-06-02 21:49:31.059921419 +0000 UTC m=+577.501369414" lastFinishedPulling="2026-06-02 21:49:31.466931094 +0000 UTC m=+577.908379116" observedRunningTime="2026-06-02 21:49:31.612885513 +0000 UTC m=+578.054333531" watchObservedRunningTime="2026-06-02 21:49:31.615761748 +0000 UTC m=+578.057209766" Jun 02 21:49:31.628263 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.627998 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" podStartSLOduration=2.285506532 podStartE2EDuration="2.62798474s" podCreationTimestamp="2026-06-02 21:49:29 +0000 UTC" firstStartedPulling="2026-06-02 21:49:30.435823941 +0000 UTC m=+576.877271938" lastFinishedPulling="2026-06-02 21:49:30.778302151 +0000 UTC m=+577.219750146" observedRunningTime="2026-06-02 21:49:31.627019677 +0000 UTC m=+578.068467707" watchObservedRunningTime="2026-06-02 21:49:31.62798474 +0000 UTC m=+578.069432769" Jun 02 21:49:31.644838 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.644787 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-2mws7"] Jun 02 21:49:31.645073 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.645047 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-2mws7" podUID="6e37c276-7bf8-4a9a-994b-5c196c399bc2" containerName="authorino" containerID="cri-o://30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650" gracePeriod=30 Jun 02 21:49:31.647493 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.647454 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-xqhng" podStartSLOduration=2.199758893 podStartE2EDuration="2.647431876s" podCreationTimestamp="2026-06-02 21:49:29 +0000 UTC" firstStartedPulling="2026-06-02 21:49:30.116227042 +0000 UTC m=+576.557675037" lastFinishedPulling="2026-06-02 21:49:30.563900012 +0000 UTC m=+577.005348020" observedRunningTime="2026-06-02 21:49:31.645438257 +0000 UTC m=+578.086886275" watchObservedRunningTime="2026-06-02 21:49:31.647431876 +0000 UTC m=+578.088879898" Jun 02 21:49:31.878699 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.878673 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" Jun 02 21:49:31.915525 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.915501 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xqhng" Jun 02 21:49:31.919934 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.919918 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-2mws7" Jun 02 21:49:31.942561 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.936395 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zgz4\" (UniqueName: \"kubernetes.io/projected/6e37c276-7bf8-4a9a-994b-5c196c399bc2-kube-api-access-7zgz4\") pod \"6e37c276-7bf8-4a9a-994b-5c196c399bc2\" (UID: \"6e37c276-7bf8-4a9a-994b-5c196c399bc2\") " Jun 02 21:49:31.942561 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.936537 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2nrj\" (UniqueName: \"kubernetes.io/projected/84dfa5ec-458e-4dc7-898e-d070af1d965b-kube-api-access-w2nrj\") pod \"84dfa5ec-458e-4dc7-898e-d070af1d965b\" (UID: \"84dfa5ec-458e-4dc7-898e-d070af1d965b\") " Jun 02 21:49:31.942561 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.936605 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fw94\" (UniqueName: \"kubernetes.io/projected/379df9e1-89d9-40f3-81bf-ef6cb880d1d0-kube-api-access-4fw94\") pod \"379df9e1-89d9-40f3-81bf-ef6cb880d1d0\" (UID: \"379df9e1-89d9-40f3-81bf-ef6cb880d1d0\") " Jun 02 21:49:31.943233 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.943197 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e37c276-7bf8-4a9a-994b-5c196c399bc2-kube-api-access-7zgz4" (OuterVolumeSpecName: "kube-api-access-7zgz4") pod "6e37c276-7bf8-4a9a-994b-5c196c399bc2" (UID: "6e37c276-7bf8-4a9a-994b-5c196c399bc2"). InnerVolumeSpecName "kube-api-access-7zgz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:49:31.948379 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.948340 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/379df9e1-89d9-40f3-81bf-ef6cb880d1d0-kube-api-access-4fw94" (OuterVolumeSpecName: "kube-api-access-4fw94") pod "379df9e1-89d9-40f3-81bf-ef6cb880d1d0" (UID: "379df9e1-89d9-40f3-81bf-ef6cb880d1d0"). InnerVolumeSpecName "kube-api-access-4fw94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:49:31.948562 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:31.948533 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84dfa5ec-458e-4dc7-898e-d070af1d965b-kube-api-access-w2nrj" (OuterVolumeSpecName: "kube-api-access-w2nrj") pod "84dfa5ec-458e-4dc7-898e-d070af1d965b" (UID: "84dfa5ec-458e-4dc7-898e-d070af1d965b"). InnerVolumeSpecName "kube-api-access-w2nrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:49:32.038462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.038408 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zgz4\" (UniqueName: \"kubernetes.io/projected/6e37c276-7bf8-4a9a-994b-5c196c399bc2-kube-api-access-7zgz4\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:49:32.038462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.038429 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2nrj\" (UniqueName: \"kubernetes.io/projected/84dfa5ec-458e-4dc7-898e-d070af1d965b-kube-api-access-w2nrj\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:49:32.038462 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.038438 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fw94\" (UniqueName: \"kubernetes.io/projected/379df9e1-89d9-40f3-81bf-ef6cb880d1d0-kube-api-access-4fw94\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:49:32.602499 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.602474 2567 generic.go:358] "Generic (PLEG): container finished" podID="6e37c276-7bf8-4a9a-994b-5c196c399bc2" containerID="30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650" exitCode=0 Jun 02 21:49:32.602619 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.602541 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-2mws7" Jun 02 21:49:32.602619 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.602557 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-2mws7" event={"ID":"6e37c276-7bf8-4a9a-994b-5c196c399bc2","Type":"ContainerDied","Data":"30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650"} Jun 02 21:49:32.602619 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.602595 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-2mws7" event={"ID":"6e37c276-7bf8-4a9a-994b-5c196c399bc2","Type":"ContainerDied","Data":"680a66103d712edf3c18cc3c9eab03ffcb69872a5c57580f20591e424ff2e1d3"} Jun 02 21:49:32.602619 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.602615 2567 scope.go:117] "RemoveContainer" containerID="30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650" Jun 02 21:49:32.603813 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.603792 2567 generic.go:358] "Generic (PLEG): container finished" podID="379df9e1-89d9-40f3-81bf-ef6cb880d1d0" containerID="bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c" exitCode=0 Jun 02 21:49:32.603882 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.603863 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" event={"ID":"379df9e1-89d9-40f3-81bf-ef6cb880d1d0","Type":"ContainerDied","Data":"bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c"} Jun 02 21:49:32.603882 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.603874 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" Jun 02 21:49:32.603995 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.603891 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5459bdcdf7-hxg9c" event={"ID":"379df9e1-89d9-40f3-81bf-ef6cb880d1d0","Type":"ContainerDied","Data":"a4b645634d38b72e41c6d733eacc489ebd97f0e899b2b4f2eb570349a5c3f929"} Jun 02 21:49:32.605479 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.605456 2567 generic.go:358] "Generic (PLEG): container finished" podID="84dfa5ec-458e-4dc7-898e-d070af1d965b" containerID="45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee" exitCode=0 Jun 02 21:49:32.605596 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.605524 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xqhng" event={"ID":"84dfa5ec-458e-4dc7-898e-d070af1d965b","Type":"ContainerDied","Data":"45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee"} Jun 02 21:49:32.605596 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.605563 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xqhng" event={"ID":"84dfa5ec-458e-4dc7-898e-d070af1d965b","Type":"ContainerDied","Data":"7fa67f13c6c9b0f8d2f3c04f72f53d6e3de8a52b0694356fe1e1911fb97ebc53"} Jun 02 21:49:32.605596 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.605529 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xqhng" Jun 02 21:49:32.611782 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.611766 2567 scope.go:117] "RemoveContainer" containerID="30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650" Jun 02 21:49:32.612036 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:49:32.612017 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650\": container with ID starting with 30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650 not found: ID does not exist" containerID="30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650" Jun 02 21:49:32.612102 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.612046 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650"} err="failed to get container status \"30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650\": rpc error: code = NotFound desc = could not find container \"30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650\": container with ID starting with 30090856598acc5ba560476c38f857c9c13c6c40c7dbc34955bf2e724b978650 not found: ID does not exist" Jun 02 21:49:32.612102 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.612069 2567 scope.go:117] "RemoveContainer" containerID="bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c" Jun 02 21:49:32.619373 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.619359 2567 scope.go:117] "RemoveContainer" containerID="bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c" Jun 02 21:49:32.619610 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:49:32.619595 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c\": container with ID starting with bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c not found: ID does not exist" containerID="bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c" Jun 02 21:49:32.619676 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.619619 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c"} err="failed to get container status \"bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c\": rpc error: code = NotFound desc = could not find container \"bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c\": container with ID starting with bd71035e14eb4fa6b23ff2adbaf42e93642e54f6a7db607ef26e0f939f477a1c not found: ID does not exist" Jun 02 21:49:32.619676 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.619641 2567 scope.go:117] "RemoveContainer" containerID="45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee" Jun 02 21:49:32.626987 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.626970 2567 scope.go:117] "RemoveContainer" containerID="45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee" Jun 02 21:49:32.627231 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:49:32.627214 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee\": container with ID starting with 45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee not found: ID does not exist" containerID="45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee" Jun 02 21:49:32.627303 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.627236 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee"} err="failed to get container status \"45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee\": rpc error: code = NotFound desc = could not find container \"45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee\": container with ID starting with 45544a87811a4713cd736f3d5d5220cf766921575907378adb0f71150de6b9ee not found: ID does not exist" Jun 02 21:49:32.627303 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.627250 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-2mws7"] Jun 02 21:49:32.631111 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.631092 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-2mws7"] Jun 02 21:49:32.640813 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.640793 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-hxg9c"] Jun 02 21:49:32.644280 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.644262 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-hxg9c"] Jun 02 21:49:32.654595 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.654578 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xqhng"] Jun 02 21:49:32.659157 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:32.659136 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xqhng"] Jun 02 21:49:34.128077 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:34.128053 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="379df9e1-89d9-40f3-81bf-ef6cb880d1d0" path="/var/lib/kubelet/pods/379df9e1-89d9-40f3-81bf-ef6cb880d1d0/volumes" Jun 02 21:49:34.128503 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:34.128480 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e37c276-7bf8-4a9a-994b-5c196c399bc2" path="/var/lib/kubelet/pods/6e37c276-7bf8-4a9a-994b-5c196c399bc2/volumes" Jun 02 21:49:34.128796 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:34.128779 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84dfa5ec-458e-4dc7-898e-d070af1d965b" path="/var/lib/kubelet/pods/84dfa5ec-458e-4dc7-898e-d070af1d965b/volumes" Jun 02 21:49:35.366254 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.366203 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64878c5979-bzt9s"] Jun 02 21:49:35.367430 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.367406 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="379df9e1-89d9-40f3-81bf-ef6cb880d1d0" containerName="authorino" Jun 02 21:49:35.367645 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.367616 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="379df9e1-89d9-40f3-81bf-ef6cb880d1d0" containerName="authorino" Jun 02 21:49:35.367752 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.367742 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84dfa5ec-458e-4dc7-898e-d070af1d965b" containerName="authorino" Jun 02 21:49:35.367871 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.367862 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="84dfa5ec-458e-4dc7-898e-d070af1d965b" containerName="authorino" Jun 02 21:49:35.368010 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.368000 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e37c276-7bf8-4a9a-994b-5c196c399bc2" containerName="authorino" Jun 02 21:49:35.368090 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.368082 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e37c276-7bf8-4a9a-994b-5c196c399bc2" containerName="authorino" Jun 02 21:49:35.368237 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.368228 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e37c276-7bf8-4a9a-994b-5c196c399bc2" containerName="authorino" Jun 02 21:49:35.368302 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.368295 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="84dfa5ec-458e-4dc7-898e-d070af1d965b" containerName="authorino" Jun 02 21:49:35.368413 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.368403 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="379df9e1-89d9-40f3-81bf-ef6cb880d1d0" containerName="authorino" Jun 02 21:49:35.373782 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.373757 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64878c5979-bzt9s" Jun 02 21:49:35.376036 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.376013 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64878c5979-bzt9s"] Jun 02 21:49:35.376705 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.376685 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8klnz\"" Jun 02 21:49:35.376818 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.376738 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 21:49:35.461907 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.461875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbczr\" (UniqueName: \"kubernetes.io/projected/9ce9ca26-d0de-400c-a854-deda850012ce-kube-api-access-rbczr\") pod \"maas-controller-64878c5979-bzt9s\" (UID: \"9ce9ca26-d0de-400c-a854-deda850012ce\") " pod="opendatahub/maas-controller-64878c5979-bzt9s" Jun 02 21:49:35.562463 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.562433 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbczr\" (UniqueName: \"kubernetes.io/projected/9ce9ca26-d0de-400c-a854-deda850012ce-kube-api-access-rbczr\") pod \"maas-controller-64878c5979-bzt9s\" (UID: \"9ce9ca26-d0de-400c-a854-deda850012ce\") " pod="opendatahub/maas-controller-64878c5979-bzt9s" Jun 02 21:49:35.574317 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.571656 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbczr\" (UniqueName: \"kubernetes.io/projected/9ce9ca26-d0de-400c-a854-deda850012ce-kube-api-access-rbczr\") pod \"maas-controller-64878c5979-bzt9s\" (UID: \"9ce9ca26-d0de-400c-a854-deda850012ce\") " pod="opendatahub/maas-controller-64878c5979-bzt9s" Jun 02 21:49:35.686586 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:35.686529 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64878c5979-bzt9s" Jun 02 21:49:36.015601 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:36.015535 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64878c5979-bzt9s"] Jun 02 21:49:36.018001 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:49:36.017971 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce9ca26_d0de_400c_a854_deda850012ce.slice/crio-623e024c5dbca4761017dd2366a7c2de5e02f18f8a238b466e6620eb8f826824 WatchSource:0}: Error finding container 623e024c5dbca4761017dd2366a7c2de5e02f18f8a238b466e6620eb8f826824: Status 404 returned error can't find the container with id 623e024c5dbca4761017dd2366a7c2de5e02f18f8a238b466e6620eb8f826824 Jun 02 21:49:36.631149 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:36.631112 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64878c5979-bzt9s" event={"ID":"9ce9ca26-d0de-400c-a854-deda850012ce","Type":"ContainerStarted","Data":"623e024c5dbca4761017dd2366a7c2de5e02f18f8a238b466e6620eb8f826824"} Jun 02 21:49:38.641012 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:38.640977 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64878c5979-bzt9s" event={"ID":"9ce9ca26-d0de-400c-a854-deda850012ce","Type":"ContainerStarted","Data":"a7763475131566ffa524948d596d183797efdd99817e18517ed0582c607bb36c"} Jun 02 21:49:38.641384 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:38.641064 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64878c5979-bzt9s" Jun 02 21:49:38.658864 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:38.658822 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-64878c5979-bzt9s" podStartSLOduration=1.456392685 podStartE2EDuration="3.658810949s" podCreationTimestamp="2026-06-02 21:49:35 +0000 UTC" firstStartedPulling="2026-06-02 21:49:36.019941436 +0000 UTC m=+582.461389433" lastFinishedPulling="2026-06-02 21:49:38.222359694 +0000 UTC m=+584.663807697" observedRunningTime="2026-06-02 21:49:38.657706107 +0000 UTC m=+585.099154125" watchObservedRunningTime="2026-06-02 21:49:38.658810949 +0000 UTC m=+585.100258965" Jun 02 21:49:49.649776 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:49:49.649749 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64878c5979-bzt9s" Jun 02 21:50:09.769172 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:09.769096 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-67x6x"] Jun 02 21:50:09.775047 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:09.775028 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" Jun 02 21:50:09.778595 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:09.778565 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 21:50:09.779607 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:09.779589 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pqrt5\"" Jun 02 21:50:09.782725 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:09.782691 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-67x6x"] Jun 02 21:50:09.915317 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:09.915279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b7k4\" (UniqueName: \"kubernetes.io/projected/09f2a513-6ed9-4e76-9ad3-f400db246dd5-kube-api-access-8b7k4\") pod \"payload-processing-58b6c8fdc7-67x6x\" (UID: \"09f2a513-6ed9-4e76-9ad3-f400db246dd5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" Jun 02 21:50:10.016416 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:10.016385 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8b7k4\" (UniqueName: \"kubernetes.io/projected/09f2a513-6ed9-4e76-9ad3-f400db246dd5-kube-api-access-8b7k4\") pod \"payload-processing-58b6c8fdc7-67x6x\" (UID: \"09f2a513-6ed9-4e76-9ad3-f400db246dd5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" Jun 02 21:50:10.025120 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:10.025057 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b7k4\" (UniqueName: \"kubernetes.io/projected/09f2a513-6ed9-4e76-9ad3-f400db246dd5-kube-api-access-8b7k4\") pod \"payload-processing-58b6c8fdc7-67x6x\" (UID: \"09f2a513-6ed9-4e76-9ad3-f400db246dd5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" Jun 02 21:50:10.087297 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:10.087271 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" Jun 02 21:50:10.222126 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:10.222103 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-67x6x"] Jun 02 21:50:10.224203 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:50:10.224176 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f2a513_6ed9_4e76_9ad3_f400db246dd5.slice/crio-61d0264cdc9a729be5c5319e3473fb54cc4ea46e960f0d329a55fa70f501da6b WatchSource:0}: Error finding container 61d0264cdc9a729be5c5319e3473fb54cc4ea46e960f0d329a55fa70f501da6b: Status 404 returned error can't find the container with id 61d0264cdc9a729be5c5319e3473fb54cc4ea46e960f0d329a55fa70f501da6b Jun 02 21:50:10.226032 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:10.226016 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:50:10.756910 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:10.756871 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" event={"ID":"09f2a513-6ed9-4e76-9ad3-f400db246dd5","Type":"ContainerStarted","Data":"61d0264cdc9a729be5c5319e3473fb54cc4ea46e960f0d329a55fa70f501da6b"} Jun 02 21:50:12.766482 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:12.766391 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" event={"ID":"09f2a513-6ed9-4e76-9ad3-f400db246dd5","Type":"ContainerStarted","Data":"2c0875e685994bde6b5c0537461974e5602564aff79ab135e9bdd3520f719dbf"} Jun 02 21:50:12.766884 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:12.766533 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" Jun 02 21:50:12.802891 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:12.802842 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" podStartSLOduration=1.630812632 podStartE2EDuration="3.802830141s" podCreationTimestamp="2026-06-02 21:50:09 +0000 UTC" firstStartedPulling="2026-06-02 21:50:10.226134468 +0000 UTC m=+616.667582465" lastFinishedPulling="2026-06-02 21:50:12.398151963 +0000 UTC m=+618.839599974" observedRunningTime="2026-06-02 21:50:12.802472076 +0000 UTC m=+619.243920094" watchObservedRunningTime="2026-06-02 21:50:12.802830141 +0000 UTC m=+619.244278159" Jun 02 21:50:23.772501 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:50:23.772475 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-67x6x" Jun 02 21:52:34.104925 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.104893 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd"] Jun 02 21:52:34.108156 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.108141 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.112490 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.112459 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qmdwv\"" Jun 02 21:52:34.112674 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.112495 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 21:52:34.112674 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.112533 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 21:52:34.112674 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.112549 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 21:52:34.116596 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.116575 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd"] Jun 02 21:52:34.171790 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.171759 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.171918 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.171812 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.171918 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.171834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq7g5\" (UniqueName: \"kubernetes.io/projected/a14419ba-c6c7-4f7a-a048-db1eea646f81-kube-api-access-hq7g5\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.172021 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.171917 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a14419ba-c6c7-4f7a-a048-db1eea646f81-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.172021 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.171982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.172118 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.172025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.272405 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.272379 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.272518 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.272416 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.272518 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.272453 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.272606 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.272520 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.272606 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.272543 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq7g5\" (UniqueName: \"kubernetes.io/projected/a14419ba-c6c7-4f7a-a048-db1eea646f81-kube-api-access-hq7g5\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.272606 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.272578 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a14419ba-c6c7-4f7a-a048-db1eea646f81-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.272833 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.272813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.272927 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.272874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.272927 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.272904 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.274755 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.274734 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a14419ba-c6c7-4f7a-a048-db1eea646f81-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.275020 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.275004 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a14419ba-c6c7-4f7a-a048-db1eea646f81-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.280552 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.280534 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq7g5\" (UniqueName: \"kubernetes.io/projected/a14419ba-c6c7-4f7a-a048-db1eea646f81-kube-api-access-hq7g5\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd\" (UID: \"a14419ba-c6c7-4f7a-a048-db1eea646f81\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.418885 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.418834 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:52:34.548948 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:34.548916 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd"] Jun 02 21:52:34.550524 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:52:34.550490 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14419ba_c6c7_4f7a_a048_db1eea646f81.slice/crio-973ce8c766c8d52508c14a1e0ee8cff3663211904050f80324b41029bab31d8b WatchSource:0}: Error finding container 973ce8c766c8d52508c14a1e0ee8cff3663211904050f80324b41029bab31d8b: Status 404 returned error can't find the container with id 973ce8c766c8d52508c14a1e0ee8cff3663211904050f80324b41029bab31d8b Jun 02 21:52:35.312980 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:35.312938 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" event={"ID":"a14419ba-c6c7-4f7a-a048-db1eea646f81","Type":"ContainerStarted","Data":"973ce8c766c8d52508c14a1e0ee8cff3663211904050f80324b41029bab31d8b"} Jun 02 21:52:38.325292 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:52:38.325251 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" event={"ID":"a14419ba-c6c7-4f7a-a048-db1eea646f81","Type":"ContainerStarted","Data":"3125fc01e645e881b30a85ede1fad4fe9d49ca6280bcc4bd4511793946113968"} Jun 02 21:53:55.638641 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:53:55.638612 2567 generic.go:358] "Generic (PLEG): container finished" podID="a14419ba-c6c7-4f7a-a048-db1eea646f81" containerID="3125fc01e645e881b30a85ede1fad4fe9d49ca6280bcc4bd4511793946113968" exitCode=0 Jun 02 21:53:55.639005 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:53:55.638693 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" event={"ID":"a14419ba-c6c7-4f7a-a048-db1eea646f81","Type":"ContainerDied","Data":"3125fc01e645e881b30a85ede1fad4fe9d49ca6280bcc4bd4511793946113968"} Jun 02 21:53:57.648515 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:53:57.648480 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" event={"ID":"a14419ba-c6c7-4f7a-a048-db1eea646f81","Type":"ContainerStarted","Data":"04cf078fe78cf3dc2c5a6c7597f6250e25e2da644a0bc46dfc3170e74fd68b3e"} Jun 02 21:53:57.671828 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:53:57.671771 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" podStartSLOduration=1.5421768359999999 podStartE2EDuration="1m23.671755294s" podCreationTimestamp="2026-06-02 21:52:34 +0000 UTC" firstStartedPulling="2026-06-02 21:52:34.55211294 +0000 UTC m=+760.993560940" lastFinishedPulling="2026-06-02 21:53:56.681691402 +0000 UTC m=+843.123139398" observedRunningTime="2026-06-02 21:53:57.668304754 +0000 UTC m=+844.109752771" watchObservedRunningTime="2026-06-02 21:53:57.671755294 +0000 UTC m=+844.113203312" Jun 02 21:54:04.419317 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:04.419284 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:54:04.419317 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:04.419317 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:54:04.431422 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:04.431394 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:54:04.685476 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:04.685392 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd" Jun 02 21:54:05.909180 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:05.909145 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6ccb9c75d8-4hxsh"] Jun 02 21:54:05.913848 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:05.913829 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ccb9c75d8-4hxsh" Jun 02 21:54:05.921745 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:05.921722 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6ccb9c75d8-4hxsh"] Jun 02 21:54:06.025384 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:06.025356 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmpx\" (UniqueName: \"kubernetes.io/projected/d16b03ab-2224-4044-b59e-0fab5365c2fa-kube-api-access-hsmpx\") pod \"authorino-6ccb9c75d8-4hxsh\" (UID: \"d16b03ab-2224-4044-b59e-0fab5365c2fa\") " pod="kuadrant-system/authorino-6ccb9c75d8-4hxsh" Jun 02 21:54:06.125933 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:06.125909 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmpx\" (UniqueName: \"kubernetes.io/projected/d16b03ab-2224-4044-b59e-0fab5365c2fa-kube-api-access-hsmpx\") pod \"authorino-6ccb9c75d8-4hxsh\" (UID: \"d16b03ab-2224-4044-b59e-0fab5365c2fa\") " pod="kuadrant-system/authorino-6ccb9c75d8-4hxsh" Jun 02 21:54:06.134162 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:06.134138 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmpx\" (UniqueName: \"kubernetes.io/projected/d16b03ab-2224-4044-b59e-0fab5365c2fa-kube-api-access-hsmpx\") pod \"authorino-6ccb9c75d8-4hxsh\" (UID: \"d16b03ab-2224-4044-b59e-0fab5365c2fa\") " pod="kuadrant-system/authorino-6ccb9c75d8-4hxsh" Jun 02 21:54:06.223158 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:06.223098 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ccb9c75d8-4hxsh" Jun 02 21:54:06.351116 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:06.351086 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6ccb9c75d8-4hxsh"] Jun 02 21:54:06.352470 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:54:06.352443 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd16b03ab_2224_4044_b59e_0fab5365c2fa.slice/crio-1a1beecdb9f6356f76b5a9f2c7f6defec0069a7ab1363294bec41ec91d562cc7 WatchSource:0}: Error finding container 1a1beecdb9f6356f76b5a9f2c7f6defec0069a7ab1363294bec41ec91d562cc7: Status 404 returned error can't find the container with id 1a1beecdb9f6356f76b5a9f2c7f6defec0069a7ab1363294bec41ec91d562cc7 Jun 02 21:54:06.682184 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:06.682151 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6ccb9c75d8-4hxsh" event={"ID":"d16b03ab-2224-4044-b59e-0fab5365c2fa","Type":"ContainerStarted","Data":"1a1beecdb9f6356f76b5a9f2c7f6defec0069a7ab1363294bec41ec91d562cc7"} Jun 02 21:54:07.687067 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:07.687035 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6ccb9c75d8-4hxsh" event={"ID":"d16b03ab-2224-4044-b59e-0fab5365c2fa","Type":"ContainerStarted","Data":"9467c086dfa258d36dca42e47b2c4d37821179c81ecf3522414dba482a8d43ca"} Jun 02 21:54:07.704118 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:07.704058 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6ccb9c75d8-4hxsh" podStartSLOduration=2.250085981 podStartE2EDuration="2.704043807s" podCreationTimestamp="2026-06-02 21:54:05 +0000 UTC" firstStartedPulling="2026-06-02 21:54:06.353711005 +0000 UTC m=+852.795159001" lastFinishedPulling="2026-06-02 21:54:06.807668827 +0000 UTC m=+853.249116827" observedRunningTime="2026-06-02 21:54:07.701625928 +0000 UTC m=+854.143073959" watchObservedRunningTime="2026-06-02 21:54:07.704043807 +0000 UTC m=+854.145491827" Jun 02 21:54:07.729452 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:07.729418 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-z7b8f"] Jun 02 21:54:07.729671 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:07.729648 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" podUID="9b20379d-ce1f-4742-9eaf-fb330b35e149" containerName="authorino" containerID="cri-o://043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101" gracePeriod=30 Jun 02 21:54:07.979262 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:07.979240 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" Jun 02 21:54:08.044918 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.044891 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9bjb\" (UniqueName: \"kubernetes.io/projected/9b20379d-ce1f-4742-9eaf-fb330b35e149-kube-api-access-j9bjb\") pod \"9b20379d-ce1f-4742-9eaf-fb330b35e149\" (UID: \"9b20379d-ce1f-4742-9eaf-fb330b35e149\") " Jun 02 21:54:08.046958 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.046933 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b20379d-ce1f-4742-9eaf-fb330b35e149-kube-api-access-j9bjb" (OuterVolumeSpecName: "kube-api-access-j9bjb") pod "9b20379d-ce1f-4742-9eaf-fb330b35e149" (UID: "9b20379d-ce1f-4742-9eaf-fb330b35e149"). InnerVolumeSpecName "kube-api-access-j9bjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:54:08.145766 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.145745 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9bjb\" (UniqueName: \"kubernetes.io/projected/9b20379d-ce1f-4742-9eaf-fb330b35e149-kube-api-access-j9bjb\") on node \"ip-10-0-135-204.ec2.internal\" DevicePath \"\"" Jun 02 21:54:08.692120 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.692086 2567 generic.go:358] "Generic (PLEG): container finished" podID="9b20379d-ce1f-4742-9eaf-fb330b35e149" containerID="043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101" exitCode=0 Jun 02 21:54:08.692589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.692132 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" Jun 02 21:54:08.692589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.692171 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" event={"ID":"9b20379d-ce1f-4742-9eaf-fb330b35e149","Type":"ContainerDied","Data":"043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101"} Jun 02 21:54:08.692589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.692211 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5459bdcdf7-z7b8f" event={"ID":"9b20379d-ce1f-4742-9eaf-fb330b35e149","Type":"ContainerDied","Data":"e84a9d833e09d56dc8901b89ef6b84db9ee496956577c7414b22f0756122b99c"} Jun 02 21:54:08.692589 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.692227 2567 scope.go:117] "RemoveContainer" containerID="043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101" Jun 02 21:54:08.700979 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.700948 2567 scope.go:117] "RemoveContainer" containerID="043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101" Jun 02 21:54:08.701196 ip-10-0-135-204 kubenswrapper[2567]: E0602 21:54:08.701180 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101\": container with ID starting with 043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101 not found: ID does not exist" containerID="043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101" Jun 02 21:54:08.701245 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.701211 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101"} err="failed to get container status \"043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101\": rpc error: code = NotFound desc = could not find container \"043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101\": container with ID starting with 043687207c2805e8fd6a1e9d1b63e2cbb69b755a3743a31a50c85db7d07d6101 not found: ID does not exist" Jun 02 21:54:08.710456 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.710432 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-z7b8f"] Jun 02 21:54:08.713883 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:08.713863 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5459bdcdf7-z7b8f"] Jun 02 21:54:10.128258 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:10.128228 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b20379d-ce1f-4742-9eaf-fb330b35e149" path="/var/lib/kubelet/pods/9b20379d-ce1f-4742-9eaf-fb330b35e149/volumes" Jun 02 21:54:44.248555 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:44.248531 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6ccb9c75d8-4hxsh_d16b03ab-2224-4044-b59e-0fab5365c2fa/authorino/0.log" Jun 02 21:54:49.070792 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:49.070758 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64878c5979-bzt9s_9ce9ca26-d0de-400c-a854-deda850012ce/manager/0.log" Jun 02 21:54:49.627472 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:49.627446 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d44dd895c-wd2q2_a8f9572e-3281-4996-98c5-148a3cb0da76/copy-manifests/0.log" Jun 02 21:54:49.633754 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:49.633729 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d44dd895c-wd2q2_a8f9572e-3281-4996-98c5-148a3cb0da76/manager/0.log" Jun 02 21:54:50.470288 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.470264 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb_c7de961f-a59f-4218-9760-bf8326388b72/util/0.log" Jun 02 21:54:50.476402 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.476382 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb_c7de961f-a59f-4218-9760-bf8326388b72/pull/0.log" Jun 02 21:54:50.482027 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.482012 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb_c7de961f-a59f-4218-9760-bf8326388b72/extract/0.log" Jun 02 21:54:50.584732 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.584708 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh_b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20/util/0.log" Jun 02 21:54:50.590199 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.590186 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh_b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20/pull/0.log" Jun 02 21:54:50.595612 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.595596 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh_b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20/extract/0.log" Jun 02 21:54:50.700582 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.700563 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4_6b2a5bf9-131f-4c30-9636-bd54cf7f00d7/util/0.log" Jun 02 21:54:50.706834 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.706815 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4_6b2a5bf9-131f-4c30-9636-bd54cf7f00d7/pull/0.log" Jun 02 21:54:50.712434 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.712421 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4_6b2a5bf9-131f-4c30-9636-bd54cf7f00d7/extract/0.log" Jun 02 21:54:50.814036 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.813982 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h_e6fbed83-b1f1-4058-b6d4-ceb896463619/util/0.log" Jun 02 21:54:50.819710 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.819696 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h_e6fbed83-b1f1-4058-b6d4-ceb896463619/pull/0.log" Jun 02 21:54:50.825233 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.825214 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h_e6fbed83-b1f1-4058-b6d4-ceb896463619/extract/0.log" Jun 02 21:54:50.936601 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:50.936581 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6ccb9c75d8-4hxsh_d16b03ab-2224-4044-b59e-0fab5365c2fa/authorino/0.log" Jun 02 21:54:51.250340 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:51.250293 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-v7zxw_2e966c09-bbab-4929-82e8-6fec7ccd90eb/kuadrant-console-plugin/0.log" Jun 02 21:54:51.472762 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:51.472741 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9wzfz_ce896ea3-1194-419b-aab4-93069e515ddc/manager/0.log" Jun 02 21:54:52.242121 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:52.242095 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567f8cc9bf-r77zh_6402a48a-ad0a-44f2-bf4e-ea2100fd0653/kube-auth-proxy/0.log" Jun 02 21:54:52.552779 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:52.552708 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-67x6x_09f2a513-6ed9-4e76-9ad3-f400db246dd5/payload-processing/0.log" Jun 02 21:54:53.552200 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:53.552173 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd_a14419ba-c6c7-4f7a-a048-db1eea646f81/storage-initializer/0.log" Jun 02 21:54:53.559051 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:54:53.559029 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-vwpvd_a14419ba-c6c7-4f7a-a048-db1eea646f81/main/0.log" Jun 02 21:55:00.231463 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:00.231429 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ngh2s_503ab3a6-50d9-46e7-a6a7-187bb3166894/global-pull-secret-syncer/0.log" Jun 02 21:55:00.410716 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:00.410683 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vhshf_e1902331-28a2-41c2-8800-3e31f1d6579e/konnectivity-agent/0.log" Jun 02 21:55:00.451534 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:00.451513 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-204.ec2.internal_5d5b0ffb4b9babff687ba04be52a82fe/haproxy/0.log" Jun 02 21:55:04.031051 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.031022 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb_c7de961f-a59f-4218-9760-bf8326388b72/extract/0.log" Jun 02 21:55:04.058372 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.058353 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb_c7de961f-a59f-4218-9760-bf8326388b72/util/0.log" Jun 02 21:55:04.084274 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.084235 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597gbsb_c7de961f-a59f-4218-9760-bf8326388b72/pull/0.log" Jun 02 21:55:04.128688 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.128665 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh_b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20/extract/0.log" Jun 02 21:55:04.155964 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.155945 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh_b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20/util/0.log" Jun 02 21:55:04.181599 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.181582 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hqffh_b3a612c9-cadd-4cd0-b7d0-c5d382b5dc20/pull/0.log" Jun 02 21:55:04.222388 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.222371 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4_6b2a5bf9-131f-4c30-9636-bd54cf7f00d7/extract/0.log" Jun 02 21:55:04.253559 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.253540 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4_6b2a5bf9-131f-4c30-9636-bd54cf7f00d7/util/0.log" Jun 02 21:55:04.275441 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.275420 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nrs4_6b2a5bf9-131f-4c30-9636-bd54cf7f00d7/pull/0.log" Jun 02 21:55:04.304482 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.304425 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h_e6fbed83-b1f1-4058-b6d4-ceb896463619/extract/0.log" Jun 02 21:55:04.324018 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.323996 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h_e6fbed83-b1f1-4058-b6d4-ceb896463619/util/0.log" Jun 02 21:55:04.345756 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.345736 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184c5h_e6fbed83-b1f1-4058-b6d4-ceb896463619/pull/0.log" Jun 02 21:55:04.375233 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.375213 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6ccb9c75d8-4hxsh_d16b03ab-2224-4044-b59e-0fab5365c2fa/authorino/0.log" Jun 02 21:55:04.452696 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.452669 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-v7zxw_2e966c09-bbab-4929-82e8-6fec7ccd90eb/kuadrant-console-plugin/0.log" Jun 02 21:55:04.537542 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:04.537519 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9wzfz_ce896ea3-1194-419b-aab4-93069e515ddc/manager/0.log" Jun 02 21:55:05.871030 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:05.870997 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10f5a889-701f-4abe-856b-b7fa85e2f0bc/alertmanager/0.log" Jun 02 21:55:05.892281 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:05.892257 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10f5a889-701f-4abe-856b-b7fa85e2f0bc/config-reloader/0.log" Jun 02 21:55:05.911993 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:05.911972 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10f5a889-701f-4abe-856b-b7fa85e2f0bc/kube-rbac-proxy-web/0.log" Jun 02 21:55:05.938828 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:05.938811 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10f5a889-701f-4abe-856b-b7fa85e2f0bc/kube-rbac-proxy/0.log" Jun 02 21:55:05.959281 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:05.959265 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10f5a889-701f-4abe-856b-b7fa85e2f0bc/kube-rbac-proxy-metric/0.log" Jun 02 21:55:05.979219 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:05.979198 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10f5a889-701f-4abe-856b-b7fa85e2f0bc/prom-label-proxy/0.log" Jun 02 21:55:05.999002 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:05.998984 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10f5a889-701f-4abe-856b-b7fa85e2f0bc/init-config-reloader/0.log" Jun 02 21:55:06.058197 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.058176 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-7jdfb_09b045f2-1ce2-458d-a912-b501ea3869cd/kube-state-metrics/0.log" Jun 02 21:55:06.077553 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.077536 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-7jdfb_09b045f2-1ce2-458d-a912-b501ea3869cd/kube-rbac-proxy-main/0.log" Jun 02 21:55:06.097049 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.097027 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-7jdfb_09b045f2-1ce2-458d-a912-b501ea3869cd/kube-rbac-proxy-self/0.log" Jun 02 21:55:06.128274 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.128219 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55f7bb5849-fnpsb_4a464039-7ffe-42f9-b4af-553a5b5d536a/metrics-server/0.log" Jun 02 21:55:06.156391 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.156371 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-4prrd_0e4f7ab9-4710-4379-a2b3-1a055c052839/monitoring-plugin/0.log" Jun 02 21:55:06.268305 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.268282 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzrnn_a1caf5d5-8a8f-4132-91ce-c913b8a5f834/node-exporter/0.log" Jun 02 21:55:06.289383 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.289365 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzrnn_a1caf5d5-8a8f-4132-91ce-c913b8a5f834/kube-rbac-proxy/0.log" Jun 02 21:55:06.312658 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.312638 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzrnn_a1caf5d5-8a8f-4132-91ce-c913b8a5f834/init-textfile/0.log" Jun 02 21:55:06.441738 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.441684 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-cmznr_4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e/kube-rbac-proxy-main/0.log" Jun 02 21:55:06.462383 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.462365 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-cmznr_4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e/kube-rbac-proxy-self/0.log" Jun 02 21:55:06.484848 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.484831 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-cmznr_4d0f3fa1-1a6c-4d27-a6c1-aac86a702c7e/openshift-state-metrics/0.log" Jun 02 21:55:06.704179 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.704131 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-q4r26_a7e8215c-375d-4820-9961-595fbea3599e/prometheus-operator/0.log" Jun 02 21:55:06.722174 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.722157 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-q4r26_a7e8215c-375d-4820-9961-595fbea3599e/kube-rbac-proxy/0.log" Jun 02 21:55:06.746853 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.746837 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-q6qb6_d99c892a-a57b-4e66-bf8c-6cb5e48a0e63/prometheus-operator-admission-webhook/0.log" Jun 02 21:55:06.778196 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.778172 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-766cdd5bcb-2zr5c_224c3f50-5ee9-4c6f-908a-c4004df0028b/telemeter-client/0.log" Jun 02 21:55:06.800761 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.800738 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-766cdd5bcb-2zr5c_224c3f50-5ee9-4c6f-908a-c4004df0028b/reload/0.log" Jun 02 21:55:06.822783 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.822761 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-766cdd5bcb-2zr5c_224c3f50-5ee9-4c6f-908a-c4004df0028b/kube-rbac-proxy/0.log" Jun 02 21:55:06.864698 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.864678 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c68cbf95f-c67n8_1afa7830-f59a-49b0-a40d-ce959884ebe3/thanos-query/0.log" Jun 02 21:55:06.884686 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.884666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c68cbf95f-c67n8_1afa7830-f59a-49b0-a40d-ce959884ebe3/kube-rbac-proxy-web/0.log" Jun 02 21:55:06.903890 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.903875 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c68cbf95f-c67n8_1afa7830-f59a-49b0-a40d-ce959884ebe3/kube-rbac-proxy/0.log" Jun 02 21:55:06.923136 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.923117 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c68cbf95f-c67n8_1afa7830-f59a-49b0-a40d-ce959884ebe3/prom-label-proxy/0.log" Jun 02 21:55:06.943336 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.943309 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c68cbf95f-c67n8_1afa7830-f59a-49b0-a40d-ce959884ebe3/kube-rbac-proxy-rules/0.log" Jun 02 21:55:06.967087 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:06.967029 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c68cbf95f-c67n8_1afa7830-f59a-49b0-a40d-ce959884ebe3/kube-rbac-proxy-metrics/0.log" Jun 02 21:55:09.297748 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.297724 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d5947bd59-4j8kc_282d8a90-938d-419f-9ff4-1b06a9f5e10e/console/0.log" Jun 02 21:55:09.852756 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.852730 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n"] Jun 02 21:55:09.853798 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.853071 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b20379d-ce1f-4742-9eaf-fb330b35e149" containerName="authorino" Jun 02 21:55:09.853798 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.853081 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b20379d-ce1f-4742-9eaf-fb330b35e149" containerName="authorino" Jun 02 21:55:09.853798 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.853161 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b20379d-ce1f-4742-9eaf-fb330b35e149" containerName="authorino" Jun 02 21:55:09.854959 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.854945 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:09.857763 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.857745 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zpld4\"/\"openshift-service-ca.crt\"" Jun 02 21:55:09.859124 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.859105 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zpld4\"/\"kube-root-ca.crt\"" Jun 02 21:55:09.859265 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.859112 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zpld4\"/\"default-dockercfg-fzxl8\"" Jun 02 21:55:09.864190 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.864147 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n"] Jun 02 21:55:09.945881 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.945861 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-sys\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:09.946000 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.945893 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-podres\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:09.946000 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.945919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk6xr\" (UniqueName: \"kubernetes.io/projected/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-kube-api-access-xk6xr\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:09.946000 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.945958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-lib-modules\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:09.946000 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:09.945975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-proc\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.046902 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.046884 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-sys\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.047054 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.046916 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-podres\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.047054 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.046952 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xk6xr\" (UniqueName: \"kubernetes.io/projected/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-kube-api-access-xk6xr\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.047054 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.046979 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-lib-modules\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.047054 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.046988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-sys\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.047054 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.046998 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-proc\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.047054 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.047045 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-proc\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.047305 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.047067 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-podres\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.047305 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.047151 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-lib-modules\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.054707 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.054688 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk6xr\" (UniqueName: \"kubernetes.io/projected/7acfe749-81cc-4fd9-bdbb-aa74d7b674e3-kube-api-access-xk6xr\") pod \"perf-node-gather-daemonset-bwp5n\" (UID: \"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3\") " pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.166193 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.166144 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.294308 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.294283 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n"] Jun 02 21:55:10.295595 ip-10-0-135-204 kubenswrapper[2567]: W0602 21:55:10.295556 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7acfe749_81cc_4fd9_bdbb_aa74d7b674e3.slice/crio-1c003363b3e5952fc6c8e576073e26ec48af1e3cec08509c58f5f64d5c00dbb6 WatchSource:0}: Error finding container 1c003363b3e5952fc6c8e576073e26ec48af1e3cec08509c58f5f64d5c00dbb6: Status 404 returned error can't find the container with id 1c003363b3e5952fc6c8e576073e26ec48af1e3cec08509c58f5f64d5c00dbb6 Jun 02 21:55:10.297233 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.297220 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:55:10.766943 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.766912 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hbkmf_81acd0af-4b5e-463a-937e-1cc4f2a72bff/dns/0.log" Jun 02 21:55:10.788586 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.788564 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hbkmf_81acd0af-4b5e-463a-937e-1cc4f2a72bff/kube-rbac-proxy/0.log" Jun 02 21:55:10.940855 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.940827 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" event={"ID":"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3","Type":"ContainerStarted","Data":"ea2e4a04a9138643bb88a9af28c2df31178be57d67437cbc0d3f2831bab3f7ee"} Jun 02 21:55:10.941040 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.940862 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:10.941040 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.940873 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" event={"ID":"7acfe749-81cc-4fd9-bdbb-aa74d7b674e3","Type":"ContainerStarted","Data":"1c003363b3e5952fc6c8e576073e26ec48af1e3cec08509c58f5f64d5c00dbb6"} Jun 02 21:55:10.958415 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.958378 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" podStartSLOduration=1.9583667980000001 podStartE2EDuration="1.958366798s" podCreationTimestamp="2026-06-02 21:55:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:55:10.955200899 +0000 UTC m=+917.396648911" watchObservedRunningTime="2026-06-02 21:55:10.958366798 +0000 UTC m=+917.399814842" Jun 02 21:55:10.993519 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:10.993499 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6w7x_2347edd3-4cda-4b9f-bc0a-bd85c68d58ba/dns-node-resolver/0.log" Jun 02 21:55:11.500800 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:11.500777 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7vwsn_06cf6962-db9f-4f50-95c4-af6decb2627e/node-ca/0.log" Jun 02 21:55:12.509995 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:12.509967 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567f8cc9bf-r77zh_6402a48a-ad0a-44f2-bf4e-ea2100fd0653/kube-auth-proxy/0.log" Jun 02 21:55:12.589112 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:12.589081 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-67x6x_09f2a513-6ed9-4e76-9ad3-f400db246dd5/payload-processing/0.log" Jun 02 21:55:13.271441 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:13.271413 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lqq5k_bee16cd1-dfcd-4a65-b816-a9645607b3cf/serve-healthcheck-canary/0.log" Jun 02 21:55:13.784987 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:13.784965 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j8k66_11515cae-0b00-4afa-84de-d823e2eb6e60/kube-rbac-proxy/0.log" Jun 02 21:55:13.805279 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:13.805251 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j8k66_11515cae-0b00-4afa-84de-d823e2eb6e60/exporter/0.log" Jun 02 21:55:13.826910 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:13.826890 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j8k66_11515cae-0b00-4afa-84de-d823e2eb6e60/extractor/0.log" Jun 02 21:55:15.913480 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:15.913449 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64878c5979-bzt9s_9ce9ca26-d0de-400c-a854-deda850012ce/manager/0.log" Jun 02 21:55:16.122925 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:16.122901 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d44dd895c-wd2q2_a8f9572e-3281-4996-98c5-148a3cb0da76/manager/0.log" Jun 02 21:55:16.141304 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:16.141287 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d44dd895c-wd2q2_a8f9572e-3281-4996-98c5-148a3cb0da76/copy-manifests/0.log" Jun 02 21:55:16.961546 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:16.961519 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zpld4/perf-node-gather-daemonset-bwp5n" Jun 02 21:55:17.455699 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:17.455672 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dd5fdcbbf-kq8sc_ac56b04c-6a03-4423-8c78-b7121d9eb672/manager/0.log" Jun 02 21:55:17.478199 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:17.478175 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-s7nk2_1e15cbf3-d60a-4533-b28a-0a8e6ac81d12/openshift-lws-operator/0.log" Jun 02 21:55:23.950813 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:23.950786 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsmb4_61c49ca3-a281-4b56-8982-de471443988b/kube-multus-additional-cni-plugins/0.log" Jun 02 21:55:23.969708 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:23.969666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsmb4_61c49ca3-a281-4b56-8982-de471443988b/egress-router-binary-copy/0.log" Jun 02 21:55:23.989442 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:23.989419 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsmb4_61c49ca3-a281-4b56-8982-de471443988b/cni-plugins/0.log" Jun 02 21:55:24.009205 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:24.009185 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsmb4_61c49ca3-a281-4b56-8982-de471443988b/bond-cni-plugin/0.log" Jun 02 21:55:24.028083 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:24.028062 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsmb4_61c49ca3-a281-4b56-8982-de471443988b/routeoverride-cni/0.log" Jun 02 21:55:24.047470 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:24.047452 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsmb4_61c49ca3-a281-4b56-8982-de471443988b/whereabouts-cni-bincopy/0.log" Jun 02 21:55:24.066705 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:24.066684 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsmb4_61c49ca3-a281-4b56-8982-de471443988b/whereabouts-cni/0.log" Jun 02 21:55:24.244180 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:24.244115 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rph7j_9b117b21-c414-4951-ac1f-455c61450457/kube-multus/0.log" Jun 02 21:55:24.333267 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:24.333244 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s78vq_96f66b77-910c-4cdd-9633-18f1ff5c3cfd/network-metrics-daemon/0.log" Jun 02 21:55:24.351545 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:24.351510 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s78vq_96f66b77-910c-4cdd-9633-18f1ff5c3cfd/kube-rbac-proxy/0.log" Jun 02 21:55:25.177925 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:25.177893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qccxd_747723c7-1eef-4a2c-a61a-1b1c5cde181b/ovn-controller/0.log" Jun 02 21:55:25.201991 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:25.201967 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qccxd_747723c7-1eef-4a2c-a61a-1b1c5cde181b/ovn-acl-logging/0.log" Jun 02 21:55:25.221617 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:25.221594 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qccxd_747723c7-1eef-4a2c-a61a-1b1c5cde181b/kube-rbac-proxy-node/0.log" Jun 02 21:55:25.242017 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:25.241998 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qccxd_747723c7-1eef-4a2c-a61a-1b1c5cde181b/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 21:55:25.265752 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:25.265734 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qccxd_747723c7-1eef-4a2c-a61a-1b1c5cde181b/northd/0.log" Jun 02 21:55:25.286620 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:25.286602 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qccxd_747723c7-1eef-4a2c-a61a-1b1c5cde181b/nbdb/0.log" Jun 02 21:55:25.306998 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:25.306979 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qccxd_747723c7-1eef-4a2c-a61a-1b1c5cde181b/sbdb/0.log" Jun 02 21:55:25.411577 ip-10-0-135-204 kubenswrapper[2567]: I0602 21:55:25.411553 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qccxd_747723c7-1eef-4a2c-a61a-1b1c5cde181b/ovnkube-controller/0.log"