Jun 12 20:06:46.652175 ip-10-0-136-62 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 20:06:46.652281 ip-10-0-136-62 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 20:06:46.652345 ip-10-0-136-62 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 20:06:46.652681 ip-10-0-136-62 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 20:06:56.901858 ip-10-0-136-62 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 20:06:56.901877 ip-10-0-136-62 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 60301e5504dd42fab211c0c82df4800f -- Jun 12 20:09:29.602085 ip-10-0-136-62 systemd[1]: Starting Kubernetes Kubelet... Jun 12 20:09:29.980082 ip-10-0-136-62 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 20:09:29.980082 ip-10-0-136-62 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 20:09:29.980082 ip-10-0-136-62 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 20:09:29.980082 ip-10-0-136-62 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 20:09:29.980082 ip-10-0-136-62 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 20:09:29.981901 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.981809 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 20:09:29.987911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987895 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:29.987911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987911 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987915 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987919 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987923 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987925 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987928 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987931 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987934 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987937 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987939 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987942 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987944 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987947 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987951 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987955 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987958 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987966 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987969 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987971 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987974 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:29.987970 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987977 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987980 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987983 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987986 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987988 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987991 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987993 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987996 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.987998 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988001 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988003 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988006 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988009 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988011 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988013 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988016 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988018 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988021 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988024 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:29.988461 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988026 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988029 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988031 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988034 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988037 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988039 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988042 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988044 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988047 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988049 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988052 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988054 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988058 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988062 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988065 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988069 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988072 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988074 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988077 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:29.988948 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988080 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988082 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988086 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988088 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988091 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988094 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988096 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988099 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988102 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988104 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988107 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988110 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988112 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988115 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988117 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988120 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988122 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988126 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988128 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988131 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988133 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:29.989407 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988135 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988138 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988142 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988146 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988149 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988152 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988155 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988159 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988162 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988165 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988168 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988171 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988174 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988176 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988179 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988182 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988185 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988188 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:29.989911 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.988191 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:29.994988 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.994973 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:29.994988 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.994987 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.994990 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.994994 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.994998 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995001 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995004 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995006 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995009 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995012 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995014 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995017 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995019 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995022 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995025 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995027 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995030 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995033 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995035 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995038 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995041 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:29.995053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995044 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995046 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995048 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995051 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995054 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995056 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995059 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995062 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995065 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995068 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995070 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995073 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995075 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995078 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995081 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995084 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995086 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995089 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995091 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995094 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:29.995570 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995096 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995099 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995101 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995104 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995107 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995109 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995112 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995114 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995118 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995122 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995126 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995130 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995135 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995138 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995141 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995144 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995147 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995150 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995152 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:29.996084 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995155 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995157 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995160 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995163 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995166 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995168 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995171 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995173 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995176 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995180 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995184 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995187 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995189 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995193 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995195 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995198 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995201 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995204 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995207 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:29.996540 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995209 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995212 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995214 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995217 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995219 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995222 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995224 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995227 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995230 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995234 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995237 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995239 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995242 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995245 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995247 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995269 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995272 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995276 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995279 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995282 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:29.997118 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995641 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995646 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995650 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995652 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995655 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995658 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995661 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995664 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995666 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995669 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995672 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995675 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995677 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995680 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995682 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995685 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995687 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995690 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995693 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995696 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:29.997598 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995699 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995702 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995705 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995707 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995710 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995713 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995715 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995718 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995721 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995723 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995726 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995729 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995731 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995734 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995737 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995740 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995743 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995746 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995748 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995751 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:29.998121 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995768 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995771 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995774 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995776 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995780 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995782 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995785 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995788 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995792 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995796 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995799 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995802 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995806 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995809 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995811 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995814 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995817 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995821 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995824 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:29.998594 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995827 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995830 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995833 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995835 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995838 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995841 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995843 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995846 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995849 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995852 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995854 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995857 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995862 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995865 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995868 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995870 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995873 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995875 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995878 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:29.999064 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995880 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995883 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995885 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995888 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995890 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995896 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995902 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995904 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995907 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995910 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995912 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995915 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995917 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995920 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995922 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995925 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995928 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995930 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995932 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995935 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:29.999526 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.995938 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996013 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996023 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996034 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996049 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996053 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996056 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996061 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996065 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996068 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996071 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996074 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996078 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996081 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996084 2578 flags.go:64] FLAG: --cgroup-root="" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996087 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996090 2578 flags.go:64] FLAG: --client-ca-file="" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996094 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996098 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996102 2578 flags.go:64] FLAG: --cluster-domain="" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996105 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996108 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996111 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996115 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 20:09:30.000010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996118 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996121 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996124 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996128 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996131 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996133 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996136 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996139 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996142 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996146 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996150 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996152 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996156 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996159 2578 flags.go:64] FLAG: --enable-server="true" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996161 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996166 2578 flags.go:64] FLAG: --event-burst="100" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996169 2578 flags.go:64] FLAG: --event-qps="50" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996172 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996175 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996178 2578 flags.go:64] FLAG: --eviction-hard="" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996181 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996184 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996187 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996190 2578 flags.go:64] FLAG: --eviction-soft="" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996192 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 20:09:30.000607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996197 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996200 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996203 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996206 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996209 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996212 2578 flags.go:64] FLAG: --feature-gates="" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996216 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996219 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996222 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996225 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996228 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996231 2578 flags.go:64] FLAG: --help="false" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996234 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996237 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996240 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996243 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996246 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996250 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996253 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996256 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996260 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996262 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996265 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996268 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 20:09:30.001279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996271 2578 flags.go:64] FLAG: --kube-reserved="" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996274 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996277 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996280 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996283 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996286 2578 flags.go:64] FLAG: --lock-file="" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996288 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996291 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996295 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996301 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996304 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996307 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996309 2578 flags.go:64] FLAG: --logging-format="text" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996312 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996316 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996318 2578 flags.go:64] FLAG: --manifest-url="" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996321 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996326 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996328 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996332 2578 flags.go:64] FLAG: --max-pods="110" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996335 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996338 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996341 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996344 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996346 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 20:09:30.001945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996349 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996352 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996359 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996362 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996366 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996369 2578 flags.go:64] FLAG: --pod-cidr="" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996372 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996378 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996381 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996384 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996387 2578 flags.go:64] FLAG: --port="10250" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996390 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996393 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b33c60b8c4e847d4" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996396 2578 flags.go:64] FLAG: --qos-reserved="" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996399 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996403 2578 flags.go:64] FLAG: --register-node="true" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996406 2578 flags.go:64] FLAG: --register-with-taints="" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996409 2578 flags.go:64] FLAG: --registry-burst="10" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996412 2578 flags.go:64] FLAG: --registry-qps="5" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996415 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996418 2578 flags.go:64] FLAG: --reserved-memory="" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996422 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996425 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996428 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996430 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 20:09:30.002555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996433 2578 flags.go:64] FLAG: --runonce="false" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996436 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996439 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996442 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996445 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996447 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996450 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996453 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996456 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996459 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996462 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996464 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996474 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996477 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996480 2578 flags.go:64] FLAG: --system-cgroups="" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996483 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996488 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996491 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996494 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996497 2578 flags.go:64] FLAG: --tls-min-version="" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996500 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996503 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996507 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996510 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996513 2578 flags.go:64] FLAG: --v="2" Jun 12 20:09:30.003192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996521 2578 flags.go:64] FLAG: --version="false" Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996525 2578 flags.go:64] FLAG: --vmodule="" Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996529 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.996532 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996645 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996649 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996651 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996654 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996657 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996660 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996662 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996665 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996667 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996670 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996672 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996675 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996679 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996683 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996685 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996688 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:30.003803 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996691 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996694 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996697 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996699 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996702 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996704 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996706 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996709 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996712 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996716 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996718 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996722 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996725 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996727 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996730 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996733 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996735 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996738 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996740 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996743 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:30.004291 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996745 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996748 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996750 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996766 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996769 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996772 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996775 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996777 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996780 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996782 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996785 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996788 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996790 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996793 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996796 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996798 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996801 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996803 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996806 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996808 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:30.004827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996811 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996814 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996817 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996821 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996823 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996826 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996829 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996831 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996834 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996836 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996839 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996841 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996844 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996847 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996849 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996852 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996856 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996859 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996863 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996865 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:30.005311 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996868 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996871 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996875 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996877 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996880 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996883 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996886 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996888 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996891 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996893 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996896 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996898 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996901 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996905 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996908 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996912 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996914 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996917 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996921 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:30.005826 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996924 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996927 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996930 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:29.996933 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:29.997484 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.004557 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.004576 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.005341 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.005349 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005411 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005417 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005420 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005423 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005426 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:30.006289 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005429 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005432 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005434 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005437 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005440 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005448 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005451 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005454 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005457 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005460 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005463 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005467 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005470 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005474 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005477 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005479 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005482 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005485 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005488 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:30.006633 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005490 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005494 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005497 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005500 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005503 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005506 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005509 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005511 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005514 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005517 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005520 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005523 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005525 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005528 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005530 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005533 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005536 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005538 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005541 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005545 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:30.007179 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005548 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005550 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005553 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005556 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005558 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005561 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005563 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005566 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005569 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005571 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005574 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005576 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005579 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005582 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005584 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005587 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005590 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005594 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005596 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005599 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:30.008000 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005601 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005604 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005608 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005611 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005614 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005617 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005620 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005623 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005626 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005629 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005632 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005635 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005638 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005640 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005643 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005647 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005650 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005653 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005656 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:30.008777 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005658 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005661 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005664 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005666 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005668 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005671 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005674 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005677 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005679 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005682 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005685 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005687 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005690 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005693 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005695 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:30.009279 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005698 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.005703 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005833 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005843 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005846 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005849 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005852 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005855 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005857 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005860 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005862 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005865 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005868 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005871 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005873 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:30.009672 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005876 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005879 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005882 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005885 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005887 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005890 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005892 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005895 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005897 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005900 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005902 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005905 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005908 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005911 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005913 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005916 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005919 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005921 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005924 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:30.010075 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005926 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005929 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005931 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005935 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005937 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005939 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005942 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005944 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005947 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005950 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005953 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005957 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005960 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005963 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005966 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005969 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005972 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005974 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005977 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:30.010584 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005980 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005983 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005985 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005988 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005991 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005994 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005996 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.005999 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006002 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006006 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006009 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006011 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006014 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006017 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006020 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006022 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006025 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006027 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006030 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:30.011244 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006032 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006035 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006038 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006040 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006043 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006046 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006048 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006051 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006053 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006056 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006058 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006061 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006063 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006066 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006068 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006071 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006074 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006076 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006079 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006081 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:30.011722 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006084 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006086 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006089 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006091 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006094 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006096 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006099 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006101 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:30.006104 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.006109 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.006234 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.009529 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.010877 2578 server.go:1019] "Starting client certificate rotation" Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.010994 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 20:09:30.012324 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.011044 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 20:09:30.013377 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.013359 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 20:09:30.014532 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.014511 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 20:09:30.040236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.040215 2578 log.go:25] "Validated CRI v1 runtime API" Jun 12 20:09:30.043141 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.043118 2578 log.go:25] "Validated CRI v1 image API" Jun 12 20:09:30.043995 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.043980 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 20:09:30.046452 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.046432 2578 fs.go:135] Filesystem UUIDs: map[3f01c6f7-8ba3-4bdc-b02f-21db42a6fc70:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 93382d0a-b1f2-4c9b-860e-9e9217bba0b6:/dev/nvme0n1p3] Jun 12 20:09:30.046521 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.046451 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 20:09:30.050463 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.050446 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 20:09:30.051726 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.051610 2578 manager.go:216] Machine: {Timestamp:2026-06-12 20:09:30.050368534 +0000 UTC m=+0.337875287 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099953 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b8cebc35ab6dba767238a9410d898 SystemUUID:ec2b8ceb-c35a-b6db-a767-238a9410d898 BootID:60301e55-04dd-42fa-b211-c0c82df4800f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:ba:80:9f:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:ba:80:9f:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:c0:ba:c2:26:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 20:09:30.051726 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.051722 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 20:09:30.051865 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.051848 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 20:09:30.054924 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.054902 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 20:09:30.055059 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.054928 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 20:09:30.056175 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.056165 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 20:09:30.056213 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.056178 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 20:09:30.056213 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.056185 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 20:09:30.056213 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.056199 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 20:09:30.057502 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.057492 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 20:09:30.062022 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.062010 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 12 20:09:30.062126 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.062117 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 20:09:30.062161 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.062147 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 12 20:09:30.062161 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.062155 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 20:09:30.062214 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.062175 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 20:09:30.062214 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.062184 2578 kubelet.go:398] "Adding apiserver pod source" Jun 12 20:09:30.062214 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.062192 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 20:09:30.062712 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.062690 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 20:09:30.062842 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.062722 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 20:09:30.071545 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.071526 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 20:09:30.073732 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.073718 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 20:09:30.073824 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.073749 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 20:09:30.074418 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074407 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 20:09:30.074465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074423 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 20:09:30.074465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074429 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 20:09:30.074465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074435 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 20:09:30.074465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074444 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 20:09:30.074465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074449 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 20:09:30.074465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074457 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 20:09:30.074465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074462 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 20:09:30.074465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074469 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 20:09:30.074679 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074474 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 20:09:30.074679 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074482 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 20:09:30.074679 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.074487 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 20:09:30.075408 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.075397 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 20:09:30.075408 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.075407 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 20:09:30.075524 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.075403 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 20:09:30.075524 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.075402 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 20:09:30.077407 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.077392 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 20:09:30.078558 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.078546 2578 server.go:1268] "Started kubelet" Jun 12 20:09:30.078636 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.078604 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 20:09:30.078686 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.078628 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 20:09:30.078727 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.078690 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 20:09:30.079535 ip-10-0-136-62 systemd[1]: Started Kubernetes Kubelet. Jun 12 20:09:30.080497 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.080474 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 12 20:09:30.080696 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.080678 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 20:09:30.084960 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.084940 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 20:09:30.085063 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.084964 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 20:09:30.085063 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.085018 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:30.085181 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.085091 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 20:09:30.085538 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.085519 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 20:09:30.085610 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.085523 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 20:09:30.085610 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.085561 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 20:09:30.085802 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.085638 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 12 20:09:30.085873 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.085803 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 12 20:09:30.086090 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.086074 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 20:09:30.086090 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.086089 2578 factory.go:55] Registering systemd factory Jun 12 20:09:30.086240 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.086098 2578 factory.go:223] Registration of the systemd container factory successfully Jun 12 20:09:30.086367 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.086351 2578 factory.go:153] Registering CRI-O factory Jun 12 20:09:30.086441 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.086370 2578 factory.go:223] Registration of the crio container factory successfully Jun 12 20:09:30.086441 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.086390 2578 factory.go:103] Registering Raw factory Jun 12 20:09:30.086441 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.086400 2578 manager.go:1196] Started watching for new ooms in manager Jun 12 20:09:30.086811 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.086792 2578 manager.go:349] Starting recovery of all containers Jun 12 20:09:30.091472 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.091445 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 20:09:30.091627 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.091606 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 20:09:30.092547 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.091364 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-62.ec2.internal.18b86e566bb85f4d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-62.ec2.internal,UID:ip-10-0-136-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-62.ec2.internal,},FirstTimestamp:2026-06-12 20:09:30.078519117 +0000 UTC m=+0.366025872,LastTimestamp:2026-06-12 20:09:30.078519117 +0000 UTC m=+0.366025872,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-62.ec2.internal,}" Jun 12 20:09:30.098539 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.098515 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7kg8" Jun 12 20:09:30.099060 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.099041 2578 manager.go:354] Recovery completed Jun 12 20:09:30.104350 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.104337 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:30.106260 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.106243 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:30.106318 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.106273 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:30.106318 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.106284 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:30.106784 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.106773 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 20:09:30.106784 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.106784 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 20:09:30.106853 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.106800 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 12 20:09:30.106895 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.106786 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:30.107336 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.107321 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7kg8" Jun 12 20:09:30.107485 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.107472 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:30.107525 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.107498 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:30.107525 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.107523 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:30.109286 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.109135 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-62.ec2.internal.18b86e566d5faae7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-62.ec2.internal,UID:ip-10-0-136-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-62.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-62.ec2.internal,},FirstTimestamp:2026-06-12 20:09:30.106260199 +0000 UTC m=+0.393766954,LastTimestamp:2026-06-12 20:09:30.106260199 +0000 UTC m=+0.393766954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-62.ec2.internal,}" Jun 12 20:09:30.109286 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.109284 2578 policy_none.go:49] "None policy: Start" Jun 12 20:09:30.109402 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.109298 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 20:09:30.109402 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.109309 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 20:09:30.111362 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.111350 2578 policy_none.go:47] "Start" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.160278 2578 manager.go:337] "Starting Device Plugin manager" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.160306 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.160315 2578 server.go:87] "Starting device plugin registration server" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.160513 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.160522 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.161046 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.161564 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.161633 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.161641 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.162405 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.162460 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.162566 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.162608 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.162632 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.162670 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 20:09:30.174039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.171078 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:30.261262 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.261231 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:30.262253 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.262234 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:30.262379 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.262266 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:30.262379 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.262277 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:30.262379 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.262299 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.263467 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.263433 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal"] Jun 12 20:09:30.263514 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.263509 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:30.265121 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.265106 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:30.265205 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.265132 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:30.265205 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.265141 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:30.267171 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.267159 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:30.267305 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.267280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.267346 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.267312 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:30.268167 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.268151 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:30.268229 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.268177 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:30.268229 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.268193 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:30.268229 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.268197 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:30.268229 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.268213 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:30.268229 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.268224 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:30.270218 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.270200 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.270314 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.270224 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:30.270841 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.270823 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:30.270938 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.270847 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:30.270938 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.270859 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:30.275794 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.275773 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.275794 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.275794 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-62.ec2.internal\": node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:30.302632 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.302609 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-62.ec2.internal\" not found" node="ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.307307 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.307285 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-62.ec2.internal\" not found" node="ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.354669 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.354640 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:30.386269 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.386205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ce82f4cdd054dfef6ab427d0b9e6f26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"6ce82f4cdd054dfef6ab427d0b9e6f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.386269 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.386242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a61968010ad14695ef0572eaf12e5b41-config\") pod \"kube-apiserver-proxy-ip-10-0-136-62.ec2.internal\" (UID: \"a61968010ad14695ef0572eaf12e5b41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.386269 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.386258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ce82f4cdd054dfef6ab427d0b9e6f26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"6ce82f4cdd054dfef6ab427d0b9e6f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.455638 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.455618 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:30.487110 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.487084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ce82f4cdd054dfef6ab427d0b9e6f26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"6ce82f4cdd054dfef6ab427d0b9e6f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.487176 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.487113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ce82f4cdd054dfef6ab427d0b9e6f26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"6ce82f4cdd054dfef6ab427d0b9e6f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.487176 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.487136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a61968010ad14695ef0572eaf12e5b41-config\") pod \"kube-apiserver-proxy-ip-10-0-136-62.ec2.internal\" (UID: \"a61968010ad14695ef0572eaf12e5b41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.487236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.487186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a61968010ad14695ef0572eaf12e5b41-config\") pod \"kube-apiserver-proxy-ip-10-0-136-62.ec2.internal\" (UID: \"a61968010ad14695ef0572eaf12e5b41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.487236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.487198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ce82f4cdd054dfef6ab427d0b9e6f26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"6ce82f4cdd054dfef6ab427d0b9e6f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.487236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.487188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ce82f4cdd054dfef6ab427d0b9e6f26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"6ce82f4cdd054dfef6ab427d0b9e6f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.555861 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.555827 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:30.608434 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.608386 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.610553 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:30.610535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jun 12 20:09:30.656238 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.656168 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:30.756687 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.756651 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:30.857168 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.857135 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:30.957745 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:30.957661 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:31.011146 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.011110 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 20:09:31.011848 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.011251 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 20:09:31.058443 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:31.058412 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:31.113130 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.113088 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 20:04:30 +0000 UTC" deadline="2027-12-24 05:44:27.136389135 +0000 UTC" Jun 12 20:09:31.113130 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.113128 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13425h34m56.023266923s" Jun 12 20:09:31.148928 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.148902 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:31.159118 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:31.159095 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:31.260180 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:31.260119 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:31.263283 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.263263 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:31.264245 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.264227 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:31.264355 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.264263 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:31.264355 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.264278 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:31.300827 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:31.300797 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce82f4cdd054dfef6ab427d0b9e6f26.slice/crio-15aa4e2de69ede3a0bd8c68cf5af070c90679090f9d053972dbf3d9660c37ad4 WatchSource:0}: Error finding container 15aa4e2de69ede3a0bd8c68cf5af070c90679090f9d053972dbf3d9660c37ad4: Status 404 returned error can't find the container with id 15aa4e2de69ede3a0bd8c68cf5af070c90679090f9d053972dbf3d9660c37ad4 Jun 12 20:09:31.301563 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:31.301539 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61968010ad14695ef0572eaf12e5b41.slice/crio-559ee76cca17663df873c51a56cad8f1c9adb06abe8941f2bf01f4c80b147e51 WatchSource:0}: Error finding container 559ee76cca17663df873c51a56cad8f1c9adb06abe8941f2bf01f4c80b147e51: Status 404 returned error can't find the container with id 559ee76cca17663df873c51a56cad8f1c9adb06abe8941f2bf01f4c80b147e51 Jun 12 20:09:31.306468 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.306452 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 20:09:31.360568 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:31.360518 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:31.364005 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.363989 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:31.461096 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:31.461044 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jun 12 20:09:31.507112 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.507090 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:31.585335 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.585271 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jun 12 20:09:31.599141 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.599110 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 20:09:31.600166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.600151 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jun 12 20:09:31.610860 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:31.610842 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 20:09:32.044055 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.043979 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:32.063017 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.062991 2578 apiserver.go:52] "Watching apiserver" Jun 12 20:09:32.073232 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.073207 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 20:09:32.074380 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.074352 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dphcx","kube-system/konnectivity-agent-f42p9","kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lrzw5","openshift-image-registry/node-ca-4ck9f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-tvp87","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw","openshift-dns/node-resolver-9zvlx","openshift-multus/multus-additional-cni-plugins-jxvd5","openshift-multus/multus-r4hls","openshift-multus/network-metrics-daemon-6dh9d","openshift-network-diagnostics/network-check-target-kv4wp","openshift-network-operator/iptables-alerter-bljk9"] Jun 12 20:09:32.076509 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.076492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.078405 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.078383 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:32.078743 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.078704 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:32.079535 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.079499 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 20:09:32.079636 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.079563 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 20:09:32.080023 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.079989 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5k9bt\"" Jun 12 20:09:32.080181 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.080140 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 20:09:32.080294 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.080218 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 20:09:32.080373 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.080315 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 20:09:32.080373 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.080362 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 20:09:32.081185 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.080964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.083233 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.083213 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fkzkk\"" Jun 12 20:09:32.083411 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.083391 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.084190 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.084171 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 20:09:32.084290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.084248 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 20:09:32.084448 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.084407 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:09:32.085446 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.085424 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 20:09:32.085584 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.085565 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:09:32.085988 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.085964 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 20:09:32.086193 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.086178 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wqbp2\"" Jun 12 20:09:32.086256 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.086193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.088210 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.088188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.088588 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.088568 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 20:09:32.088651 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.088598 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 20:09:32.088817 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.088802 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 20:09:32.089005 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.088992 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6pqpm\"" Jun 12 20:09:32.090280 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.090261 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.090852 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.090807 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 20:09:32.091057 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.091040 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qkz8g\"" Jun 12 20:09:32.091317 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.091305 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 20:09:32.092632 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.092612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.092727 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.092690 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:32.093100 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.093080 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 20:09:32.093185 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.093110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5pjm\"" Jun 12 20:09:32.093282 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.093261 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 20:09:32.093481 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.093470 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 20:09:32.094384 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71b619f5-f2c4-4382-8564-6025440e82f6-ovnkube-script-lib\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.094470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-systemd\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.094470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-run\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.094470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92976364-eeba-4777-af5b-8ab3b87146e5-etc-tuned\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.094470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-sys-fs\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.094470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-kubelet\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zd8m\" (UniqueName: \"kubernetes.io/projected/a06ab72f-4ff2-488b-8035-464184734c6b-kube-api-access-7zd8m\") pod \"iptables-alerter-bljk9\" (UID: \"a06ab72f-4ff2-488b-8035-464184734c6b\") " pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-kubernetes\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-sysctl-conf\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-registration-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-cni-bin\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-cni-netd\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-modprobe-d\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0eadafd-3454-437e-ab4d-4fe2fb19e0f0-serviceca\") pod \"node-ca-4ck9f\" (UID: \"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0\") " pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.094689 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-socket-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-etc-selinux\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-run-netns\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-log-socket\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6wpk\" (UniqueName: \"kubernetes.io/projected/71b619f5-f2c4-4382-8564-6025440e82f6-kube-api-access-f6wpk\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a06ab72f-4ff2-488b-8035-464184734c6b-iptables-alerter-script\") pod \"iptables-alerter-bljk9\" (UID: \"a06ab72f-4ff2-488b-8035-464184734c6b\") " pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-lib-modules\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094906 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92976364-eeba-4777-af5b-8ab3b87146e5-tmp\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjqt6\" (UniqueName: \"kubernetes.io/projected/92976364-eeba-4777-af5b-8ab3b87146e5-kube-api-access-pjqt6\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0eadafd-3454-437e-ab4d-4fe2fb19e0f0-host\") pod \"node-ca-4ck9f\" (UID: \"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0\") " pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.094976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-slash\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-run-systemd\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-etc-openvswitch\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71b619f5-f2c4-4382-8564-6025440e82f6-ovnkube-config\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71b619f5-f2c4-4382-8564-6025440e82f6-env-overrides\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hqvj\" (UniqueName: \"kubernetes.io/projected/c0eadafd-3454-437e-ab4d-4fe2fb19e0f0-kube-api-access-6hqvj\") pod \"node-ca-4ck9f\" (UID: \"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0\") " pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.095166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71b619f5-f2c4-4382-8564-6025440e82f6-ovn-node-metrics-cert\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-sys\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-host\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-systemd-units\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-var-lib-openvswitch\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095295 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-node-log\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a06ab72f-4ff2-488b-8035-464184734c6b-host-slash\") pod \"iptables-alerter-bljk9\" (UID: \"a06ab72f-4ff2-488b-8035-464184734c6b\") " pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-sysctl-d\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-var-lib-kubelet\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnh2k\" (UniqueName: \"kubernetes.io/projected/284b1417-075a-4e7d-b664-d40e79c57e73-kube-api-access-bnh2k\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-run-openvswitch\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-run-ovn\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-sysconfig\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.095697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-device-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.096326 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.095720 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:32.097226 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.097207 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.098567 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.098548 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jxbb4\"" Jun 12 20:09:32.098662 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.098615 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 20:09:32.098849 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.098723 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 20:09:32.098969 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.098918 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 20:09:32.100854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.099581 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 20:09:32.100854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.099900 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 20:09:32.100854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.100105 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 20:09:32.100854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.100298 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6px6v\"" Jun 12 20:09:32.100854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.100492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.100854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.100637 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 20:09:32.100854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.100729 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 20:09:32.102198 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.102180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:32.102300 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.102244 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:32.102644 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.102627 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 20:09:32.102731 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.102712 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v6gb7\"" Jun 12 20:09:32.123221 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.123197 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v57bp" Jun 12 20:09:32.132741 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.132710 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v57bp" Jun 12 20:09:32.167662 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.167614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" event={"ID":"6ce82f4cdd054dfef6ab427d0b9e6f26","Type":"ContainerStarted","Data":"15aa4e2de69ede3a0bd8c68cf5af070c90679090f9d053972dbf3d9660c37ad4"} Jun 12 20:09:32.168770 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.168728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" event={"ID":"a61968010ad14695ef0572eaf12e5b41","Type":"ContainerStarted","Data":"559ee76cca17663df873c51a56cad8f1c9adb06abe8941f2bf01f4c80b147e51"} Jun 12 20:09:32.186418 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.186396 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 20:09:32.196749 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0eadafd-3454-437e-ab4d-4fe2fb19e0f0-host\") pod \"node-ca-4ck9f\" (UID: \"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0\") " pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.196886 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7crp\" (UniqueName: \"kubernetes.io/projected/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-kube-api-access-s7crp\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.196886 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71b619f5-f2c4-4382-8564-6025440e82f6-ovnkube-config\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.196886 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196823 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0eadafd-3454-437e-ab4d-4fe2fb19e0f0-host\") pod \"node-ca-4ck9f\" (UID: \"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0\") " pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.196886 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hqvj\" (UniqueName: \"kubernetes.io/projected/c0eadafd-3454-437e-ab4d-4fe2fb19e0f0-kube-api-access-6hqvj\") pod \"node-ca-4ck9f\" (UID: \"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0\") " pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.196886 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84cl7\" (UniqueName: \"kubernetes.io/projected/d46b4c0f-a6cd-4005-8456-f23a350e95e6-kube-api-access-84cl7\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eefdd8b6-744f-417c-b929-430ad6eaeefb-tmp-dir\") pod \"node-resolver-9zvlx\" (UID: \"eefdd8b6-744f-417c-b929-430ad6eaeefb\") " pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2tmj\" (UniqueName: \"kubernetes.io/projected/eefdd8b6-744f-417c-b929-430ad6eaeefb-kube-api-access-b2tmj\") pod \"node-resolver-9zvlx\" (UID: \"eefdd8b6-744f-417c-b929-430ad6eaeefb\") " pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-sys\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.196985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-host\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-system-cni-dir\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eefdd8b6-744f-417c-b929-430ad6eaeefb-hosts-file\") pod \"node-resolver-9zvlx\" (UID: \"eefdd8b6-744f-417c-b929-430ad6eaeefb\") " pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnh2k\" (UniqueName: \"kubernetes.io/projected/284b1417-075a-4e7d-b664-d40e79c57e73-kube-api-access-bnh2k\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-var-lib-cni-multus\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-run-ovn\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-run-k8s-cni-cncf-io\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31a14749-8dd1-454f-9b36-3893cc1f6f11-agent-certs\") pod \"konnectivity-agent-f42p9\" (UID: \"31a14749-8dd1-454f-9b36-3893cc1f6f11\") " pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92976364-eeba-4777-af5b-8ab3b87146e5-etc-tuned\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.197219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae075d32-600c-42cd-a2ca-69a4c4eb198c-dbus\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-kubelet\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-kubernetes\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-registration-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-cnibin\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-var-lib-cni-bin\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-etc-kubernetes\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-system-cni-dir\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-cnibin\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-modprobe-d\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-run-netns\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92976364-eeba-4777-af5b-8ab3b87146e5-tmp\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197610 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-multus-cni-dir\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-run-multus-certs\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-host\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.197805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197682 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71b619f5-f2c4-4382-8564-6025440e82f6-ovnkube-config\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-run-ovn\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-slash\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197723 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197728 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-kubernetes\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-sys\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-run-systemd\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-registration-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-modprobe-d\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-kubelet\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-run-netns\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197856 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-slash\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-etc-openvswitch\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197894 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-run-systemd\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71b619f5-f2c4-4382-8564-6025440e82f6-env-overrides\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197963 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-etc-openvswitch\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-os-release\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.197996 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 20:09:32.198595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-run-netns\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-os-release\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71b619f5-f2c4-4382-8564-6025440e82f6-ovn-node-metrics-cert\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-var-lib-kubelet\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-hostroot\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-systemd-units\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-var-lib-openvswitch\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-node-log\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a06ab72f-4ff2-488b-8035-464184734c6b-host-slash\") pod \"iptables-alerter-bljk9\" (UID: \"a06ab72f-4ff2-488b-8035-464184734c6b\") " pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-sysctl-d\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-var-lib-kubelet\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/495b33f5-6530-417f-97ca-190dae561a0b-cni-binary-copy\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-run-openvswitch\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71b619f5-f2c4-4382-8564-6025440e82f6-env-overrides\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-sysconfig\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.199503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-device-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-node-log\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/495b33f5-6530-417f-97ca-190dae561a0b-multus-daemon-config\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a06ab72f-4ff2-488b-8035-464184734c6b-host-slash\") pod \"iptables-alerter-bljk9\" (UID: \"a06ab72f-4ff2-488b-8035-464184734c6b\") " pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-sysctl-d\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae075d32-600c-42cd-a2ca-69a4c4eb198c-kubelet-config\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71b619f5-f2c4-4382-8564-6025440e82f6-ovnkube-script-lib\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-systemd\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-run\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-sys-fs\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198789 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-run-openvswitch\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-multus-socket-dir-parent\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198828 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-sysconfig\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-multus-conf-dir\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4kwz\" (UniqueName: \"kubernetes.io/projected/495b33f5-6530-417f-97ca-190dae561a0b-kube-api-access-n4kwz\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.200351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31a14749-8dd1-454f-9b36-3893cc1f6f11-konnectivity-ca\") pod \"konnectivity-agent-f42p9\" (UID: \"31a14749-8dd1-454f-9b36-3893cc1f6f11\") " pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.198998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zd8m\" (UniqueName: \"kubernetes.io/projected/a06ab72f-4ff2-488b-8035-464184734c6b-kube-api-access-7zd8m\") pod \"iptables-alerter-bljk9\" (UID: \"a06ab72f-4ff2-488b-8035-464184734c6b\") " pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-sysctl-conf\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-cni-bin\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-cni-netd\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0eadafd-3454-437e-ab4d-4fe2fb19e0f0-serviceca\") pod \"node-ca-4ck9f\" (UID: \"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0\") " pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-socket-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-systemd\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-etc-selinux\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-etc-selinux\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-log-socket\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-etc-sysctl-conf\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.201208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6wpk\" (UniqueName: \"kubernetes.io/projected/71b619f5-f2c4-4382-8564-6025440e82f6-kube-api-access-f6wpk\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a06ab72f-4ff2-488b-8035-464184734c6b-iptables-alerter-script\") pod \"iptables-alerter-bljk9\" (UID: \"a06ab72f-4ff2-488b-8035-464184734c6b\") " pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199479 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-var-lib-kubelet\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-lib-modules\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199506 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-systemd-units\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71b619f5-f2c4-4382-8564-6025440e82f6-ovnkube-script-lib\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqt6\" (UniqueName: \"kubernetes.io/projected/92976364-eeba-4777-af5b-8ab3b87146e5-kube-api-access-pjqt6\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199539 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-var-lib-openvswitch\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199579 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-device-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-sys-fs\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-log-socket\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199656 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-cni-netd\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.199234 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-run\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.200074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0eadafd-3454-437e-ab4d-4fe2fb19e0f0-serviceca\") pod \"node-ca-4ck9f\" (UID: \"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0\") " pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.200087 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/284b1417-075a-4e7d-b664-d40e79c57e73-socket-dir\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.200123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71b619f5-f2c4-4382-8564-6025440e82f6-host-cni-bin\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.200215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92976364-eeba-4777-af5b-8ab3b87146e5-lib-modules\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.200598 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a06ab72f-4ff2-488b-8035-464184734c6b-iptables-alerter-script\") pod \"iptables-alerter-bljk9\" (UID: \"a06ab72f-4ff2-488b-8035-464184734c6b\") " pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.202042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.201205 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92976364-eeba-4777-af5b-8ab3b87146e5-etc-tuned\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.202942 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.201359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71b619f5-f2c4-4382-8564-6025440e82f6-ovn-node-metrics-cert\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.202942 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.201363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92976364-eeba-4777-af5b-8ab3b87146e5-tmp\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.205406 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.205382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hqvj\" (UniqueName: \"kubernetes.io/projected/c0eadafd-3454-437e-ab4d-4fe2fb19e0f0-kube-api-access-6hqvj\") pod \"node-ca-4ck9f\" (UID: \"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0\") " pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.205813 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.205659 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnh2k\" (UniqueName: \"kubernetes.io/projected/284b1417-075a-4e7d-b664-d40e79c57e73-kube-api-access-bnh2k\") pod \"aws-ebs-csi-driver-node-62zcw\" (UID: \"284b1417-075a-4e7d-b664-d40e79c57e73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.205909 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.205883 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:32.205909 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.205906 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:32.205994 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.205920 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xtgdt for pod openshift-network-diagnostics/network-check-target-kv4wp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:32.205994 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.205990 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt podName:616b548c-fb6d-43aa-b75b-0250ffd73f19 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:32.705958878 +0000 UTC m=+2.993465623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xtgdt" (UniqueName: "kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt") pod "network-check-target-kv4wp" (UID: "616b548c-fb6d-43aa-b75b-0250ffd73f19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:32.207964 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.207942 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjqt6\" (UniqueName: \"kubernetes.io/projected/92976364-eeba-4777-af5b-8ab3b87146e5-kube-api-access-pjqt6\") pod \"tuned-lrzw5\" (UID: \"92976364-eeba-4777-af5b-8ab3b87146e5\") " pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.208515 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.208495 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6wpk\" (UniqueName: \"kubernetes.io/projected/71b619f5-f2c4-4382-8564-6025440e82f6-kube-api-access-f6wpk\") pod \"ovnkube-node-tvp87\" (UID: \"71b619f5-f2c4-4382-8564-6025440e82f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.209869 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.209850 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zd8m\" (UniqueName: \"kubernetes.io/projected/a06ab72f-4ff2-488b-8035-464184734c6b-kube-api-access-7zd8m\") pod \"iptables-alerter-bljk9\" (UID: \"a06ab72f-4ff2-488b-8035-464184734c6b\") " pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.300665 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:32.300665 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.300665 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7crp\" (UniqueName: \"kubernetes.io/projected/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-kube-api-access-s7crp\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84cl7\" (UniqueName: \"kubernetes.io/projected/d46b4c0f-a6cd-4005-8456-f23a350e95e6-kube-api-access-84cl7\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eefdd8b6-744f-417c-b929-430ad6eaeefb-tmp-dir\") pod \"node-resolver-9zvlx\" (UID: \"eefdd8b6-744f-417c-b929-430ad6eaeefb\") " pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tmj\" (UniqueName: \"kubernetes.io/projected/eefdd8b6-744f-417c-b929-430ad6eaeefb-kube-api-access-b2tmj\") pod \"node-resolver-9zvlx\" (UID: \"eefdd8b6-744f-417c-b929-430ad6eaeefb\") " pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-system-cni-dir\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eefdd8b6-744f-417c-b929-430ad6eaeefb-hosts-file\") pod \"node-resolver-9zvlx\" (UID: \"eefdd8b6-744f-417c-b929-430ad6eaeefb\") " pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-var-lib-cni-multus\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-run-k8s-cni-cncf-io\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eefdd8b6-744f-417c-b929-430ad6eaeefb-hosts-file\") pod \"node-resolver-9zvlx\" (UID: \"eefdd8b6-744f-417c-b929-430ad6eaeefb\") " pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31a14749-8dd1-454f-9b36-3893cc1f6f11-agent-certs\") pod \"konnectivity-agent-f42p9\" (UID: \"31a14749-8dd1-454f-9b36-3893cc1f6f11\") " pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-system-cni-dir\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.300951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae075d32-600c-42cd-a2ca-69a4c4eb198c-dbus\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-var-lib-cni-multus\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-cnibin\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300978 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-run-k8s-cni-cncf-io\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.300994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-var-lib-cni-bin\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-etc-kubernetes\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301031 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-cnibin\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-system-cni-dir\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-cnibin\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-etc-kubernetes\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-var-lib-cni-bin\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eefdd8b6-744f-417c-b929-430ad6eaeefb-tmp-dir\") pod \"node-resolver-9zvlx\" (UID: \"eefdd8b6-744f-417c-b929-430ad6eaeefb\") " pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-system-cni-dir\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301139 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae075d32-600c-42cd-a2ca-69a4c4eb198c-dbus\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-cnibin\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-multus-cni-dir\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.301461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-run-multus-certs\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.301204 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-os-release\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-run-netns\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-multus-cni-dir\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.301273 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs podName:d46b4c0f-a6cd-4005-8456-f23a350e95e6 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:32.801254133 +0000 UTC m=+3.088760887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs") pod "network-metrics-daemon-6dh9d" (UID: "d46b4c0f-a6cd-4005-8456-f23a350e95e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-run-netns\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301296 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-run-multus-certs\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-os-release\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301322 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-os-release\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-var-lib-kubelet\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301372 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-os-release\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-hostroot\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301408 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-hostroot\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301411 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-host-var-lib-kubelet\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/495b33f5-6530-417f-97ca-190dae561a0b-cni-binary-copy\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/495b33f5-6530-417f-97ca-190dae561a0b-multus-daemon-config\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae075d32-600c-42cd-a2ca-69a4c4eb198c-kubelet-config\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae075d32-600c-42cd-a2ca-69a4c4eb198c-kubelet-config\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-multus-socket-dir-parent\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-multus-conf-dir\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4kwz\" (UniqueName: \"kubernetes.io/projected/495b33f5-6530-417f-97ca-190dae561a0b-kube-api-access-n4kwz\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-multus-conf-dir\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31a14749-8dd1-454f-9b36-3893cc1f6f11-konnectivity-ca\") pod \"konnectivity-agent-f42p9\" (UID: \"31a14749-8dd1-454f-9b36-3893cc1f6f11\") " pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301779 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/495b33f5-6530-417f-97ca-190dae561a0b-multus-socket-dir-parent\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.301855 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.301901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret podName:ae075d32-600c-42cd-a2ca-69a4c4eb198c nodeName:}" failed. No retries permitted until 2026-06-12 20:09:32.801885774 +0000 UTC m=+3.089392531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret") pod "global-pull-secret-syncer-dphcx" (UID: "ae075d32-600c-42cd-a2ca-69a4c4eb198c") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301973 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/495b33f5-6530-417f-97ca-190dae561a0b-cni-binary-copy\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.301995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/495b33f5-6530-417f-97ca-190dae561a0b-multus-daemon-config\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.302196 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.302892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.302325 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31a14749-8dd1-454f-9b36-3893cc1f6f11-konnectivity-ca\") pod \"konnectivity-agent-f42p9\" (UID: \"31a14749-8dd1-454f-9b36-3893cc1f6f11\") " pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:32.303360 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.303256 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31a14749-8dd1-454f-9b36-3893cc1f6f11-agent-certs\") pod \"konnectivity-agent-f42p9\" (UID: \"31a14749-8dd1-454f-9b36-3893cc1f6f11\") " pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:32.313015 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.312987 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84cl7\" (UniqueName: \"kubernetes.io/projected/d46b4c0f-a6cd-4005-8456-f23a350e95e6-kube-api-access-84cl7\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:32.314109 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.314086 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2tmj\" (UniqueName: \"kubernetes.io/projected/eefdd8b6-744f-417c-b929-430ad6eaeefb-kube-api-access-b2tmj\") pod \"node-resolver-9zvlx\" (UID: \"eefdd8b6-744f-417c-b929-430ad6eaeefb\") " pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.314257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.314241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7crp\" (UniqueName: \"kubernetes.io/projected/5f51744e-d49e-49d3-99b9-33a4dc47ff7f-kube-api-access-s7crp\") pod \"multus-additional-cni-plugins-jxvd5\" (UID: \"5f51744e-d49e-49d3-99b9-33a4dc47ff7f\") " pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.314423 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.314404 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4kwz\" (UniqueName: \"kubernetes.io/projected/495b33f5-6530-417f-97ca-190dae561a0b-kube-api-access-n4kwz\") pod \"multus-r4hls\" (UID: \"495b33f5-6530-417f-97ca-190dae561a0b\") " pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.387865 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.387830 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:32.398204 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.398171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bljk9" Jun 12 20:09:32.399574 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:32.399549 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b619f5_f2c4_4382_8564_6025440e82f6.slice/crio-9f7c85d3f0df0908460456bb8a6f3db9ed11e476e3c6a0ae351bf48db1fd0464 WatchSource:0}: Error finding container 9f7c85d3f0df0908460456bb8a6f3db9ed11e476e3c6a0ae351bf48db1fd0464: Status 404 returned error can't find the container with id 9f7c85d3f0df0908460456bb8a6f3db9ed11e476e3c6a0ae351bf48db1fd0464 Jun 12 20:09:32.408231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.408213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" Jun 12 20:09:32.413927 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.413899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ck9f" Jun 12 20:09:32.417998 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:32.417957 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92976364_eeba_4777_af5b_8ab3b87146e5.slice/crio-03bcd305a1206284726d31fdac2425ddb55504e04b1c02e043af6f796bc53056 WatchSource:0}: Error finding container 03bcd305a1206284726d31fdac2425ddb55504e04b1c02e043af6f796bc53056: Status 404 returned error can't find the container with id 03bcd305a1206284726d31fdac2425ddb55504e04b1c02e043af6f796bc53056 Jun 12 20:09:32.419879 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.419858 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" Jun 12 20:09:32.424575 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:32.424548 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0eadafd_3454_437e_ab4d_4fe2fb19e0f0.slice/crio-427bc661b78e1801caab793fcb72425d1d94eeef525100ea83019e5201a6b130 WatchSource:0}: Error finding container 427bc661b78e1801caab793fcb72425d1d94eeef525100ea83019e5201a6b130: Status 404 returned error can't find the container with id 427bc661b78e1801caab793fcb72425d1d94eeef525100ea83019e5201a6b130 Jun 12 20:09:32.426647 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.426630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9zvlx" Jun 12 20:09:32.432042 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:32.432014 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284b1417_075a_4e7d_b664_d40e79c57e73.slice/crio-814aa23229eec8af74a62b62862f1c2cdd6f8f0a45f388d29a6b569ab214662b WatchSource:0}: Error finding container 814aa23229eec8af74a62b62862f1c2cdd6f8f0a45f388d29a6b569ab214662b: Status 404 returned error can't find the container with id 814aa23229eec8af74a62b62862f1c2cdd6f8f0a45f388d29a6b569ab214662b Jun 12 20:09:32.434467 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.434277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:32.438227 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:32.438201 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefdd8b6_744f_417c_b929_430ad6eaeefb.slice/crio-4acbfd0a73e653598f70c66654145bc6062332c0caab1f62657b5afb4047dd07 WatchSource:0}: Error finding container 4acbfd0a73e653598f70c66654145bc6062332c0caab1f62657b5afb4047dd07: Status 404 returned error can't find the container with id 4acbfd0a73e653598f70c66654145bc6062332c0caab1f62657b5afb4047dd07 Jun 12 20:09:32.443179 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.443160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" Jun 12 20:09:32.444491 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:32.444472 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a14749_8dd1_454f_9b36_3893cc1f6f11.slice/crio-7e87717397b6cd0296bb5754fb113baa08a174196da99e690e985fb0da3cd52a WatchSource:0}: Error finding container 7e87717397b6cd0296bb5754fb113baa08a174196da99e690e985fb0da3cd52a: Status 404 returned error can't find the container with id 7e87717397b6cd0296bb5754fb113baa08a174196da99e690e985fb0da3cd52a Jun 12 20:09:32.451097 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.450927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r4hls" Jun 12 20:09:32.453394 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:32.453369 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f51744e_d49e_49d3_99b9_33a4dc47ff7f.slice/crio-88f0e5f503442124448b4427300bbe8868c335fb45d2a1ace9a954719e3bc435 WatchSource:0}: Error finding container 88f0e5f503442124448b4427300bbe8868c335fb45d2a1ace9a954719e3bc435: Status 404 returned error can't find the container with id 88f0e5f503442124448b4427300bbe8868c335fb45d2a1ace9a954719e3bc435 Jun 12 20:09:32.459684 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:09:32.459663 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495b33f5_6530_417f_97ca_190dae561a0b.slice/crio-a8e6037110e97b0cf0051922a8fec79158144aa66eac599df671e032562f4cbd WatchSource:0}: Error finding container a8e6037110e97b0cf0051922a8fec79158144aa66eac599df671e032562f4cbd: Status 404 returned error can't find the container with id a8e6037110e97b0cf0051922a8fec79158144aa66eac599df671e032562f4cbd Jun 12 20:09:32.804100 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.804072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:32.804256 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.804115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:32.804256 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:32.804136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:32.804256 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.804250 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:32.804378 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.804275 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:32.804378 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.804297 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:32.804378 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.804310 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xtgdt for pod openshift-network-diagnostics/network-check-target-kv4wp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:32.804378 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.804298 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs podName:d46b4c0f-a6cd-4005-8456-f23a350e95e6 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:33.804284944 +0000 UTC m=+4.091791684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs") pod "network-metrics-daemon-6dh9d" (UID: "d46b4c0f-a6cd-4005-8456-f23a350e95e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:32.804378 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.804371 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt podName:616b548c-fb6d-43aa-b75b-0250ffd73f19 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:33.804354004 +0000 UTC m=+4.091860749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtgdt" (UniqueName: "kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt") pod "network-check-target-kv4wp" (UID: "616b548c-fb6d-43aa-b75b-0250ffd73f19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:32.804647 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.804436 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:32.804647 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:32.804464 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret podName:ae075d32-600c-42cd-a2ca-69a4c4eb198c nodeName:}" failed. No retries permitted until 2026-06-12 20:09:33.804456781 +0000 UTC m=+4.091963521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret") pod "global-pull-secret-syncer-dphcx" (UID: "ae075d32-600c-42cd-a2ca-69a4c4eb198c") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:33.137169 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.137078 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 20:04:32 +0000 UTC" deadline="2028-03-03 17:17:27.006164358 +0000 UTC" Jun 12 20:09:33.137169 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.137116 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15117h7m53.869053291s" Jun 12 20:09:33.172127 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.172094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r4hls" event={"ID":"495b33f5-6530-417f-97ca-190dae561a0b","Type":"ContainerStarted","Data":"a8e6037110e97b0cf0051922a8fec79158144aa66eac599df671e032562f4cbd"} Jun 12 20:09:33.173864 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.173827 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f42p9" event={"ID":"31a14749-8dd1-454f-9b36-3893cc1f6f11","Type":"ContainerStarted","Data":"7e87717397b6cd0296bb5754fb113baa08a174196da99e690e985fb0da3cd52a"} Jun 12 20:09:33.174997 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.174968 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ck9f" event={"ID":"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0","Type":"ContainerStarted","Data":"427bc661b78e1801caab793fcb72425d1d94eeef525100ea83019e5201a6b130"} Jun 12 20:09:33.176676 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.176627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bljk9" event={"ID":"a06ab72f-4ff2-488b-8035-464184734c6b","Type":"ContainerStarted","Data":"897c17018772707d5abd302e726af4b288280fe6081f6eab017c9a07b7719654"} Jun 12 20:09:33.177797 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.177773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" event={"ID":"5f51744e-d49e-49d3-99b9-33a4dc47ff7f","Type":"ContainerStarted","Data":"88f0e5f503442124448b4427300bbe8868c335fb45d2a1ace9a954719e3bc435"} Jun 12 20:09:33.179290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.179266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9zvlx" event={"ID":"eefdd8b6-744f-417c-b929-430ad6eaeefb","Type":"ContainerStarted","Data":"4acbfd0a73e653598f70c66654145bc6062332c0caab1f62657b5afb4047dd07"} Jun 12 20:09:33.180391 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.180369 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" event={"ID":"284b1417-075a-4e7d-b664-d40e79c57e73","Type":"ContainerStarted","Data":"814aa23229eec8af74a62b62862f1c2cdd6f8f0a45f388d29a6b569ab214662b"} Jun 12 20:09:33.182282 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.182261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" event={"ID":"92976364-eeba-4777-af5b-8ab3b87146e5","Type":"ContainerStarted","Data":"03bcd305a1206284726d31fdac2425ddb55504e04b1c02e043af6f796bc53056"} Jun 12 20:09:33.183535 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.183470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerStarted","Data":"9f7c85d3f0df0908460456bb8a6f3db9ed11e476e3c6a0ae351bf48db1fd0464"} Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.811626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.811677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:33.811710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:33.811886 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:33.811945 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs podName:d46b4c0f-a6cd-4005-8456-f23a350e95e6 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:35.811927803 +0000 UTC m=+6.099434547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs") pod "network-metrics-daemon-6dh9d" (UID: "d46b4c0f-a6cd-4005-8456-f23a350e95e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:33.812320 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:33.812339 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:33.812352 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xtgdt for pod openshift-network-diagnostics/network-check-target-kv4wp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:33.812400 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt podName:616b548c-fb6d-43aa-b75b-0250ffd73f19 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:35.812383831 +0000 UTC m=+6.099890574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtgdt" (UniqueName: "kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt") pod "network-check-target-kv4wp" (UID: "616b548c-fb6d-43aa-b75b-0250ffd73f19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:33.812462 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:33.812554 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:33.812498 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret podName:ae075d32-600c-42cd-a2ca-69a4c4eb198c nodeName:}" failed. No retries permitted until 2026-06-12 20:09:35.812486778 +0000 UTC m=+6.099993519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret") pod "global-pull-secret-syncer-dphcx" (UID: "ae075d32-600c-42cd-a2ca-69a4c4eb198c") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:34.138082 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:34.137920 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 20:04:32 +0000 UTC" deadline="2028-02-22 12:24:12.70104563 +0000 UTC" Jun 12 20:09:34.138082 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:34.137979 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14872h14m38.563070807s" Jun 12 20:09:34.166079 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:34.165587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:34.166079 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:34.165712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:34.166079 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:34.165729 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:34.166079 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:34.165819 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:34.166079 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:34.165881 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:34.166079 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:34.165956 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:34.196380 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:34.196340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" event={"ID":"a61968010ad14695ef0572eaf12e5b41","Type":"ContainerStarted","Data":"f2dc8a4a38524d089adb19f77f1521829d3dc9838649f500deb47afdca878ad8"} Jun 12 20:09:34.213247 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:34.213190 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" podStartSLOduration=3.213169006 podStartE2EDuration="3.213169006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:34.212162707 +0000 UTC m=+4.499669474" watchObservedRunningTime="2026-06-12 20:09:34.213169006 +0000 UTC m=+4.500675769" Jun 12 20:09:35.202621 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:35.202582 2578 generic.go:356] "Generic (PLEG): container finished" podID="6ce82f4cdd054dfef6ab427d0b9e6f26" containerID="5ddf91267fec2c87e33903aa65453b93253011ff30fce30105bb620db6144423" exitCode=0 Jun 12 20:09:35.203580 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:35.203549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" event={"ID":"6ce82f4cdd054dfef6ab427d0b9e6f26","Type":"ContainerDied","Data":"5ddf91267fec2c87e33903aa65453b93253011ff30fce30105bb620db6144423"} Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:35.828548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:35.828600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:35.828631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:35.828798 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:35.828858 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs podName:d46b4c0f-a6cd-4005-8456-f23a350e95e6 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:39.828837784 +0000 UTC m=+10.116344529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs") pod "network-metrics-daemon-6dh9d" (UID: "d46b4c0f-a6cd-4005-8456-f23a350e95e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:35.829256 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:35.829275 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:35.829288 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xtgdt for pod openshift-network-diagnostics/network-check-target-kv4wp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:35.829337 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt podName:616b548c-fb6d-43aa-b75b-0250ffd73f19 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:39.829319808 +0000 UTC m=+10.116826551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtgdt" (UniqueName: "kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt") pod "network-check-target-kv4wp" (UID: "616b548c-fb6d-43aa-b75b-0250ffd73f19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:35.829394 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:35.829471 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:35.829425 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret podName:ae075d32-600c-42cd-a2ca-69a4c4eb198c nodeName:}" failed. No retries permitted until 2026-06-12 20:09:39.829415231 +0000 UTC m=+10.116921977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret") pod "global-pull-secret-syncer-dphcx" (UID: "ae075d32-600c-42cd-a2ca-69a4c4eb198c") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:36.164375 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:36.163853 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:36.164375 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:36.163869 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:36.164375 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:36.163892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:36.164375 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:36.163986 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:36.164375 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:36.164129 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:36.164375 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:36.164228 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:38.163914 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:38.163878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:38.164328 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:38.164016 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:38.164431 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:38.164411 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:38.164544 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:38.164522 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:38.164702 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:38.164688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:38.164817 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:38.164785 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:39.864691 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:39.864650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:39.865153 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:39.864712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:39.865153 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:39.864743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:39.865153 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:39.864895 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:39.865153 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:39.864952 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs podName:d46b4c0f-a6cd-4005-8456-f23a350e95e6 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:47.864937918 +0000 UTC m=+18.152444658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs") pod "network-metrics-daemon-6dh9d" (UID: "d46b4c0f-a6cd-4005-8456-f23a350e95e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:39.865377 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:39.865343 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:39.865377 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:39.865365 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:39.865377 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:39.865377 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xtgdt for pod openshift-network-diagnostics/network-check-target-kv4wp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:39.865518 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:39.865422 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt podName:616b548c-fb6d-43aa-b75b-0250ffd73f19 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:47.865408161 +0000 UTC m=+18.152914903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtgdt" (UniqueName: "kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt") pod "network-check-target-kv4wp" (UID: "616b548c-fb6d-43aa-b75b-0250ffd73f19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:39.865518 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:39.865476 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:39.865518 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:39.865502 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret podName:ae075d32-600c-42cd-a2ca-69a4c4eb198c nodeName:}" failed. No retries permitted until 2026-06-12 20:09:47.865494027 +0000 UTC m=+18.153000767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret") pod "global-pull-secret-syncer-dphcx" (UID: "ae075d32-600c-42cd-a2ca-69a4c4eb198c") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:40.169448 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:40.168882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:40.169448 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:40.169007 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:40.169448 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:40.168886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:40.169448 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:40.168882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:40.169448 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:40.169128 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:40.169448 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:40.169205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:42.165523 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:42.164888 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:42.165523 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:42.164909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:42.165523 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:42.165023 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:42.165523 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:42.165028 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:42.165523 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:42.165135 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:42.165523 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:42.165223 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:44.163039 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:44.163003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:44.163452 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:44.163003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:44.163452 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:44.163122 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:44.163452 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:44.163008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:44.163452 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:44.163208 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:44.163452 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:44.163320 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:46.162914 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:46.162874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:46.163337 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:46.162874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:46.163337 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:46.162996 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:46.163337 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:46.163097 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:46.163337 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:46.162894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:46.163337 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:46.163202 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:47.929775 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:47.929730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:47.929775 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:47.929777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:47.930264 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:47.929797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:47.930264 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:47.929900 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:47.930264 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:47.929902 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:47.930264 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:47.929927 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:47.930264 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:47.929932 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:47.930264 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:47.929937 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xtgdt for pod openshift-network-diagnostics/network-check-target-kv4wp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:47.930264 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:47.929961 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs podName:d46b4c0f-a6cd-4005-8456-f23a350e95e6 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:03.929942054 +0000 UTC m=+34.217448812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs") pod "network-metrics-daemon-6dh9d" (UID: "d46b4c0f-a6cd-4005-8456-f23a350e95e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:47.930264 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:47.929989 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret podName:ae075d32-600c-42cd-a2ca-69a4c4eb198c nodeName:}" failed. No retries permitted until 2026-06-12 20:10:03.929969831 +0000 UTC m=+34.217476577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret") pod "global-pull-secret-syncer-dphcx" (UID: "ae075d32-600c-42cd-a2ca-69a4c4eb198c") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:47.930264 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:47.930009 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt podName:616b548c-fb6d-43aa-b75b-0250ffd73f19 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:03.929998509 +0000 UTC m=+34.217505255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtgdt" (UniqueName: "kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt") pod "network-check-target-kv4wp" (UID: "616b548c-fb6d-43aa-b75b-0250ffd73f19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:48.163651 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:48.163623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:48.163860 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:48.163623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:48.163860 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:48.163749 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:48.163860 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:48.163842 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:48.164029 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:48.163899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:48.164029 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:48.163983 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:50.163798 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:50.163638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:50.163798 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:50.163741 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:50.164304 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:50.163738 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:50.164304 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:50.163866 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:50.164304 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:50.163888 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:50.164304 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:50.164012 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:52.163577 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.163551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:52.164230 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.163550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:52.164230 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.163728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:52.164230 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:52.163742 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:52.164230 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:52.163827 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:52.164230 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:52.163897 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:52.238244 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.238039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" event={"ID":"5f51744e-d49e-49d3-99b9-33a4dc47ff7f","Type":"ContainerStarted","Data":"8d38ac7118457fbc114e8e1939e77932617382b6f6ca7764925b6ea4ee821b77"} Jun 12 20:09:52.239390 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.239362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9zvlx" event={"ID":"eefdd8b6-744f-417c-b929-430ad6eaeefb","Type":"ContainerStarted","Data":"7848f829b8f2a3de6fce21a06878083366055a16096ec6044c8e211447f70026"} Jun 12 20:09:52.240725 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.240701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" event={"ID":"284b1417-075a-4e7d-b664-d40e79c57e73","Type":"ContainerStarted","Data":"20988136cd490be4dd4248874950055bd07e369d873134fbb5277ad6b132b303"} Jun 12 20:09:52.242203 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.242181 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" event={"ID":"92976364-eeba-4777-af5b-8ab3b87146e5","Type":"ContainerStarted","Data":"5a7c7c9be3d0c1c1ecb8b48ededfb668f7b5392f467ef960d06e859d456dc401"} Jun 12 20:09:52.247181 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.247153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerStarted","Data":"aa14312f95e02d5a3bd67649f77b771c16e3a929adfb1218f243f9c1a45fe45b"} Jun 12 20:09:52.249351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.249327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" event={"ID":"6ce82f4cdd054dfef6ab427d0b9e6f26","Type":"ContainerStarted","Data":"196194279a5ff0ed2f4087387c36ad9d27272821a5d5b8b3d6fb7921b12e592f"} Jun 12 20:09:52.250711 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.250687 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r4hls" event={"ID":"495b33f5-6530-417f-97ca-190dae561a0b","Type":"ContainerStarted","Data":"79602ccb809a7511d8c11589011d0cac1be8b2f174bac47aaa72d45303637020"} Jun 12 20:09:52.251978 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.251959 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f42p9" event={"ID":"31a14749-8dd1-454f-9b36-3893cc1f6f11","Type":"ContainerStarted","Data":"2a474e1a6243f338f2d57f5a5e9fbdbb03afde8961afbd10b304eb1bdd12cd0c"} Jun 12 20:09:52.253233 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.253211 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ck9f" event={"ID":"c0eadafd-3454-437e-ab4d-4fe2fb19e0f0","Type":"ContainerStarted","Data":"d1c68ef437b7b1baac0b7ecd767b235d24764fde72ccef1e69df23b0c4a80851"} Jun 12 20:09:52.272031 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.271995 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f42p9" podStartSLOduration=11.469762106 podStartE2EDuration="22.271981612s" totalImagesPullingTime="10.802219506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:52.271942989 +0000 UTC m=+22.559449751" watchObservedRunningTime="2026-06-12 20:09:52.271981612 +0000 UTC m=+22.559488406" Jun 12 20:09:52.291180 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.291135 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r4hls" podStartSLOduration=2.838317117 podStartE2EDuration="22.29111888s" totalImagesPullingTime="19.452801763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:52.290778125 +0000 UTC m=+22.578284900" watchObservedRunningTime="2026-06-12 20:09:52.29111888 +0000 UTC m=+22.578625642" Jun 12 20:09:52.304460 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.304414 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" podStartSLOduration=21.304397445 podStartE2EDuration="21.304397445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:52.303695468 +0000 UTC m=+22.591202241" watchObservedRunningTime="2026-06-12 20:09:52.304397445 +0000 UTC m=+22.591904210" Jun 12 20:09:52.320227 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.320154 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lrzw5" podStartSLOduration=2.883065238 podStartE2EDuration="22.320134615s" totalImagesPullingTime="19.437069377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:52.32006383 +0000 UTC m=+22.607570595" watchObservedRunningTime="2026-06-12 20:09:52.320134615 +0000 UTC m=+22.607641379" Jun 12 20:09:52.332496 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.332452 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4ck9f" podStartSLOduration=2.904844357 podStartE2EDuration="22.332437847s" totalImagesPullingTime="19.42759349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:52.332199952 +0000 UTC m=+22.619706726" watchObservedRunningTime="2026-06-12 20:09:52.332437847 +0000 UTC m=+22.619944608" Jun 12 20:09:52.374410 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:52.374273 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9zvlx" podStartSLOduration=2.9597993540000003 podStartE2EDuration="22.374250029s" totalImagesPullingTime="19.414450675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:52.369234926 +0000 UTC m=+22.656741708" watchObservedRunningTime="2026-06-12 20:09:52.374250029 +0000 UTC m=+22.661756877" Jun 12 20:09:53.259264 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.259170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bljk9" event={"ID":"a06ab72f-4ff2-488b-8035-464184734c6b","Type":"ContainerStarted","Data":"d8a148a528b432b4e5d575e550da60eabe80a9087061ea4fe8632352973071cb"} Jun 12 20:09:53.260635 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.260607 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f51744e-d49e-49d3-99b9-33a4dc47ff7f" containerID="8d38ac7118457fbc114e8e1939e77932617382b6f6ca7764925b6ea4ee821b77" exitCode=0 Jun 12 20:09:53.260781 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.260692 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" event={"ID":"5f51744e-d49e-49d3-99b9-33a4dc47ff7f","Type":"ContainerDied","Data":"8d38ac7118457fbc114e8e1939e77932617382b6f6ca7764925b6ea4ee821b77"} Jun 12 20:09:53.263620 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.263602 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:09:53.264006 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.263983 2578 generic.go:356] "Generic (PLEG): container finished" podID="71b619f5-f2c4-4382-8564-6025440e82f6" containerID="de8a97cbfbab5d84d390e64c4e73c21780d8cac727f251896b7214f3d9b9ee24" exitCode=1 Jun 12 20:09:53.264076 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.264024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerStarted","Data":"30c21ab803bc4339f926e6cfe320f952f7654827e868a904555ade5d78504031"} Jun 12 20:09:53.264113 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.264094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerStarted","Data":"8c7a931384d9b9063c4b537560d97ac20709cfdb2328e474e3ef206fb2eb743b"} Jun 12 20:09:53.264166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.264153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerStarted","Data":"a1f09840c614a8ee2aa9542309a8a8147ed79533930f60ce8bfe113fe1d36ca5"} Jun 12 20:09:53.264218 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.264205 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerStarted","Data":"e8f4753cce4ada534fa8a9b56b3eb6e5932db2bf753bb0ff23c4e38e97e8608a"} Jun 12 20:09:53.264267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.264256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerDied","Data":"de8a97cbfbab5d84d390e64c4e73c21780d8cac727f251896b7214f3d9b9ee24"} Jun 12 20:09:53.272711 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:53.272671 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bljk9" podStartSLOduration=3.832828683 podStartE2EDuration="23.272656737s" totalImagesPullingTime="19.439828054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:53.272234189 +0000 UTC m=+23.559740951" watchObservedRunningTime="2026-06-12 20:09:53.272656737 +0000 UTC m=+23.560163498" Jun 12 20:09:54.060467 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:54.060441 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 20:09:54.163866 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:54.163833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:54.164049 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:54.163833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:54.164049 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:54.163969 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:54.164049 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:54.163832 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:54.164206 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:54.164054 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:54.164206 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:54.164133 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:54.176971 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:54.176887 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T20:09:54.060462624Z","UUID":"51802f69-52e7-4a15-a7a1-7e6a519d1ee0","Handler":null,"Name":"","Endpoint":""} Jun 12 20:09:54.178453 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:54.178432 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 20:09:54.178619 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:54.178473 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 20:09:54.268838 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:54.268739 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" event={"ID":"284b1417-075a-4e7d-b664-d40e79c57e73","Type":"ContainerStarted","Data":"a88b7815806c0b4eccb47dd62fa1897da02af79111e0ede712137e7133fa1e58"} Jun 12 20:09:55.274540 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:55.274517 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:09:55.275069 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:55.274909 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerStarted","Data":"6148533e0f62f9ebb5143d423bcee85a574f4ec91eb07e578f250e8658ce320d"} Jun 12 20:09:56.163719 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:56.163688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:56.163719 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:56.163703 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:56.163935 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:56.163810 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:56.163935 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:56.163857 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:56.163935 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:56.163904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:56.164026 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:56.163972 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:56.278969 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:56.278932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" event={"ID":"284b1417-075a-4e7d-b664-d40e79c57e73","Type":"ContainerStarted","Data":"da8de83c96153dc1a3c79f7950cd766614f4d8c6581d6a3cc6921355650c0829"} Jun 12 20:09:56.295904 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:56.295861 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62zcw" podStartSLOduration=3.884994714 podStartE2EDuration="26.295848651s" totalImagesPullingTime="22.410853937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:56.295622375 +0000 UTC m=+26.583129163" watchObservedRunningTime="2026-06-12 20:09:56.295848651 +0000 UTC m=+26.583355446" Jun 12 20:09:56.625648 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:56.625613 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:56.626261 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:56.626239 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:57.284364 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:57.284109 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:09:57.284954 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:57.284592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerStarted","Data":"a89e95f9849b9ea369f04fcfa56f2b974207ae491afd239d01a466b8177da11d"} Jun 12 20:09:57.285161 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:57.285107 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:57.285326 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:57.285302 2578 scope.go:117] "RemoveContainer" containerID="de8a97cbfbab5d84d390e64c4e73c21780d8cac727f251896b7214f3d9b9ee24" Jun 12 20:09:57.285326 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:57.285314 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f42p9" Jun 12 20:09:58.164724 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.163936 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:58.164724 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:58.164071 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:58.164724 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.164468 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:58.164724 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:58.164555 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:58.164724 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.164607 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:58.164724 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:58.164685 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:09:58.291492 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.291454 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:09:58.292020 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.291870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" event={"ID":"71b619f5-f2c4-4382-8564-6025440e82f6","Type":"ContainerStarted","Data":"7f33b7fa5a3b7c8fec6c3c3c99ac4b2b575384c1ba9fdb2368c3c1551693a169"} Jun 12 20:09:58.292644 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.292488 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:58.292644 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.292561 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:58.292644 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.292607 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:58.309660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.309632 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:58.309915 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.309896 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:09:58.318880 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:58.318840 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" podStartSLOduration=8.650201173 podStartE2EDuration="28.318826713s" totalImagesPullingTime="19.66862554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:58.316972411 +0000 UTC m=+28.604479177" watchObservedRunningTime="2026-06-12 20:09:58.318826713 +0000 UTC m=+28.606333476" Jun 12 20:09:59.143237 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:59.143191 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dphcx"] Jun 12 20:09:59.143402 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:59.143330 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:09:59.143460 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:59.143432 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:09:59.145738 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:59.145708 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kv4wp"] Jun 12 20:09:59.145894 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:59.145825 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:09:59.145943 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:59.145898 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:09:59.158533 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:59.158506 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6dh9d"] Jun 12 20:09:59.158660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:09:59.158602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:09:59.158776 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:09:59.158702 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:10:00.298492 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:00.298316 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f51744e-d49e-49d3-99b9-33a4dc47ff7f" containerID="0237f62d0664fa0befc67de1c8c8f495ae72030da0e05c7d751bf4e16649e49e" exitCode=0 Jun 12 20:10:00.298854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:00.298391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" event={"ID":"5f51744e-d49e-49d3-99b9-33a4dc47ff7f","Type":"ContainerDied","Data":"0237f62d0664fa0befc67de1c8c8f495ae72030da0e05c7d751bf4e16649e49e"} Jun 12 20:10:01.163610 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:01.163580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:10:01.163812 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:01.163580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:10:01.163812 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:01.163690 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:10:01.163812 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:01.163788 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:10:01.163812 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:01.163580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:10:01.164032 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:01.163877 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:10:02.306071 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:02.306037 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f51744e-d49e-49d3-99b9-33a4dc47ff7f" containerID="707b8d2dd1f4ee6d164c34569574adc5832c7f827f47a231f1ecd13237e4a949" exitCode=0 Jun 12 20:10:02.306835 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:02.306087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" event={"ID":"5f51744e-d49e-49d3-99b9-33a4dc47ff7f","Type":"ContainerDied","Data":"707b8d2dd1f4ee6d164c34569574adc5832c7f827f47a231f1ecd13237e4a949"} Jun 12 20:10:03.163508 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:03.163473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:10:03.163714 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:03.163545 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:10:03.163714 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:03.163640 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:10:03.163714 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.163657 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:10:03.163893 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.163736 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:10:03.163893 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.163814 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:10:03.310524 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:03.310492 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f51744e-d49e-49d3-99b9-33a4dc47ff7f" containerID="3b59e6ed74d120dfaea979310ae103b32e07d0fb566cda6a4f59edceba4a42e8" exitCode=0 Jun 12 20:10:03.311081 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:03.310554 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" event={"ID":"5f51744e-d49e-49d3-99b9-33a4dc47ff7f","Type":"ContainerDied","Data":"3b59e6ed74d120dfaea979310ae103b32e07d0fb566cda6a4f59edceba4a42e8"} Jun 12 20:10:03.959511 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:03.959424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:10:03.959511 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:03.959463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:10:03.959511 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:03.959481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:10:03.959718 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.959569 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:10:03.959718 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.959580 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:10:03.959718 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.959586 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:10:03.959718 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.959608 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:10:03.959718 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.959619 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xtgdt for pod openshift-network-diagnostics/network-check-target-kv4wp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:10:03.959718 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.959626 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs podName:d46b4c0f-a6cd-4005-8456-f23a350e95e6 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:35.959610155 +0000 UTC m=+66.247116899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs") pod "network-metrics-daemon-6dh9d" (UID: "d46b4c0f-a6cd-4005-8456-f23a350e95e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:10:03.959718 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.959640 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret podName:ae075d32-600c-42cd-a2ca-69a4c4eb198c nodeName:}" failed. No retries permitted until 2026-06-12 20:10:35.959634422 +0000 UTC m=+66.247141162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret") pod "global-pull-secret-syncer-dphcx" (UID: "ae075d32-600c-42cd-a2ca-69a4c4eb198c") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:10:03.959718 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:03.959657 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt podName:616b548c-fb6d-43aa-b75b-0250ffd73f19 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:35.959646145 +0000 UTC m=+66.247152885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtgdt" (UniqueName: "kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt") pod "network-check-target-kv4wp" (UID: "616b548c-fb6d-43aa-b75b-0250ffd73f19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:10:05.162909 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:05.162831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:10:05.162909 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:05.162831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:10:05.163855 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:05.162982 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dphcx" podUID="ae075d32-600c-42cd-a2ca-69a4c4eb198c" Jun 12 20:10:05.163855 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:05.162831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:10:05.163855 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:05.163052 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:10:05.163855 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:05.163090 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kv4wp" podUID="616b548c-fb6d-43aa-b75b-0250ffd73f19" Jun 12 20:10:06.018420 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.018350 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeReady" Jun 12 20:10:06.018569 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.018490 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 20:10:06.052800 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.052751 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-579654b649-nh9mp"] Jun 12 20:10:06.067900 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.067864 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-926pk"] Jun 12 20:10:06.068056 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.067995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.071202 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.071042 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 20:10:06.071653 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.071637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5mqvq\"" Jun 12 20:10:06.071850 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.071824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 20:10:06.071924 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.071888 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 20:10:06.081681 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.081658 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 20:10:06.087948 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.087926 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-579654b649-nh9mp"] Jun 12 20:10:06.088052 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.087956 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6khsh"] Jun 12 20:10:06.088121 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.088075 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.091030 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.091006 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rxxkq\"" Jun 12 20:10:06.091140 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.091081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 20:10:06.091255 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.091242 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 20:10:06.104293 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.104270 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-926pk"] Jun 12 20:10:06.104396 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.104260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6khsh" Jun 12 20:10:06.104451 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.104368 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6khsh"] Jun 12 20:10:06.106597 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.106530 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 20:10:06.106597 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.106540 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 20:10:06.106597 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.106546 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hjr59\"" Jun 12 20:10:06.106597 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.106530 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 20:10:06.178351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.178318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/743f04db-f64f-43f0-97d9-6c2b8fa82b59-ca-trust-extracted\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.178700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.178371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-installation-pull-secrets\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.178700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.178421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-bound-sa-token\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.178700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.178466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr8bz\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-kube-api-access-kr8bz\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.178700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.178486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-trusted-ca\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.178700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.178506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-image-registry-private-configuration\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.178700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.178527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-certificates\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.178700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.178564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279353 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/743f04db-f64f-43f0-97d9-6c2b8fa82b59-ca-trust-extracted\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279353 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.279551 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-installation-pull-secrets\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279551 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-bound-sa-token\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279551 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18259a15-c027-4dfc-8ad3-75f944b62ed2-cert\") pod \"ingress-canary-6khsh\" (UID: \"18259a15-c027-4dfc-8ad3-75f944b62ed2\") " pod="openshift-ingress-canary/ingress-canary-6khsh" Jun 12 20:10:06.279551 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr8bz\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-kube-api-access-kr8bz\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279551 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a86c9aa6-de6b-4296-bb91-dee632048c30-config-volume\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.279551 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-trusted-ca\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279551 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t789n\" (UniqueName: \"kubernetes.io/projected/a86c9aa6-de6b-4296-bb91-dee632048c30-kube-api-access-t789n\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.279985 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-image-registry-private-configuration\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279985 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-certificates\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279985 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a86c9aa6-de6b-4296-bb91-dee632048c30-tmp-dir\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.279985 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/743f04db-f64f-43f0-97d9-6c2b8fa82b59-ca-trust-extracted\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279985 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.279985 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.279806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkn54\" (UniqueName: \"kubernetes.io/projected/18259a15-c027-4dfc-8ad3-75f944b62ed2-kube-api-access-zkn54\") pod \"ingress-canary-6khsh\" (UID: \"18259a15-c027-4dfc-8ad3-75f944b62ed2\") " pod="openshift-ingress-canary/ingress-canary-6khsh" Jun 12 20:10:06.279985 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.279857 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:10:06.279985 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.279876 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579654b649-nh9mp: secret "image-registry-tls" not found Jun 12 20:10:06.279985 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.279945 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls podName:743f04db-f64f-43f0-97d9-6c2b8fa82b59 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:06.779924289 +0000 UTC m=+37.067431051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls") pod "image-registry-579654b649-nh9mp" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59") : secret "image-registry-tls" not found Jun 12 20:10:06.280526 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.280362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-certificates\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.280919 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.280899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-trusted-ca\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.283765 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.283736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-image-registry-private-configuration\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.283812 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.283778 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-installation-pull-secrets\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.288481 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.288449 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-bound-sa-token\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.288589 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.288542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr8bz\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-kube-api-access-kr8bz\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.380775 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.380723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.380939 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.380851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18259a15-c027-4dfc-8ad3-75f944b62ed2-cert\") pod \"ingress-canary-6khsh\" (UID: \"18259a15-c027-4dfc-8ad3-75f944b62ed2\") " pod="openshift-ingress-canary/ingress-canary-6khsh" Jun 12 20:10:06.380939 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.380886 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:06.380939 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.380898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a86c9aa6-de6b-4296-bb91-dee632048c30-config-volume\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.380939 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.380928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t789n\" (UniqueName: \"kubernetes.io/projected/a86c9aa6-de6b-4296-bb91-dee632048c30-kube-api-access-t789n\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.381155 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.380958 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls podName:a86c9aa6-de6b-4296-bb91-dee632048c30 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:06.88093764 +0000 UTC m=+37.168444383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls") pod "dns-default-926pk" (UID: "a86c9aa6-de6b-4296-bb91-dee632048c30") : secret "dns-default-metrics-tls" not found Jun 12 20:10:06.381155 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.380994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a86c9aa6-de6b-4296-bb91-dee632048c30-tmp-dir\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.381155 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.381037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkn54\" (UniqueName: \"kubernetes.io/projected/18259a15-c027-4dfc-8ad3-75f944b62ed2-kube-api-access-zkn54\") pod \"ingress-canary-6khsh\" (UID: \"18259a15-c027-4dfc-8ad3-75f944b62ed2\") " pod="openshift-ingress-canary/ingress-canary-6khsh" Jun 12 20:10:06.381387 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.381356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a86c9aa6-de6b-4296-bb91-dee632048c30-tmp-dir\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.383698 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.383677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18259a15-c027-4dfc-8ad3-75f944b62ed2-cert\") pod \"ingress-canary-6khsh\" (UID: \"18259a15-c027-4dfc-8ad3-75f944b62ed2\") " pod="openshift-ingress-canary/ingress-canary-6khsh" Jun 12 20:10:06.393353 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.393328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t789n\" (UniqueName: \"kubernetes.io/projected/a86c9aa6-de6b-4296-bb91-dee632048c30-kube-api-access-t789n\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.393938 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.393903 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkn54\" (UniqueName: \"kubernetes.io/projected/18259a15-c027-4dfc-8ad3-75f944b62ed2-kube-api-access-zkn54\") pod \"ingress-canary-6khsh\" (UID: \"18259a15-c027-4dfc-8ad3-75f944b62ed2\") " pod="openshift-ingress-canary/ingress-canary-6khsh" Jun 12 20:10:06.398997 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.398976 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a86c9aa6-de6b-4296-bb91-dee632048c30-config-volume\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.414700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.414675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6khsh" Jun 12 20:10:06.619317 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.619278 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6khsh"] Jun 12 20:10:06.624122 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:10:06.624095 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18259a15_c027_4dfc_8ad3_75f944b62ed2.slice/crio-50fad623d4077e6fe97ea8cd70be4c66716877806ebb0cccf6bee5df870b5a7a WatchSource:0}: Error finding container 50fad623d4077e6fe97ea8cd70be4c66716877806ebb0cccf6bee5df870b5a7a: Status 404 returned error can't find the container with id 50fad623d4077e6fe97ea8cd70be4c66716877806ebb0cccf6bee5df870b5a7a Jun 12 20:10:06.784193 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.784105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:06.784365 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.784258 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:10:06.784365 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.784280 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579654b649-nh9mp: secret "image-registry-tls" not found Jun 12 20:10:06.784365 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.784336 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls podName:743f04db-f64f-43f0-97d9-6c2b8fa82b59 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:07.784319129 +0000 UTC m=+38.071825868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls") pod "image-registry-579654b649-nh9mp" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59") : secret "image-registry-tls" not found Jun 12 20:10:06.885613 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:06.885566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:06.885812 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.885671 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:06.885812 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:06.885745 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls podName:a86c9aa6-de6b-4296-bb91-dee632048c30 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:07.885729253 +0000 UTC m=+38.173235992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls") pod "dns-default-926pk" (UID: "a86c9aa6-de6b-4296-bb91-dee632048c30") : secret "dns-default-metrics-tls" not found Jun 12 20:10:07.163242 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.163201 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:10:07.163242 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.163223 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:10:07.163457 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.163376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:10:07.167533 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.167356 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 20:10:07.167533 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.167370 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 20:10:07.167533 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.167410 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nl7nn\"" Jun 12 20:10:07.167533 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.167418 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 20:10:07.167533 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.167408 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gl8lm\"" Jun 12 20:10:07.167533 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.167428 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 20:10:07.321378 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.321310 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6khsh" event={"ID":"18259a15-c027-4dfc-8ad3-75f944b62ed2","Type":"ContainerStarted","Data":"50fad623d4077e6fe97ea8cd70be4c66716877806ebb0cccf6bee5df870b5a7a"} Jun 12 20:10:07.792082 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.791999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:07.792236 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:07.792149 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:10:07.792236 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:07.792173 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579654b649-nh9mp: secret "image-registry-tls" not found Jun 12 20:10:07.792329 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:07.792251 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls podName:743f04db-f64f-43f0-97d9-6c2b8fa82b59 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:09.792229935 +0000 UTC m=+40.079736677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls") pod "image-registry-579654b649-nh9mp" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59") : secret "image-registry-tls" not found Jun 12 20:10:07.893207 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:07.893168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:07.893376 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:07.893358 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:07.893421 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:07.893418 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls podName:a86c9aa6-de6b-4296-bb91-dee632048c30 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:09.89340401 +0000 UTC m=+40.180910750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls") pod "dns-default-926pk" (UID: "a86c9aa6-de6b-4296-bb91-dee632048c30") : secret "dns-default-metrics-tls" not found Jun 12 20:10:09.329971 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:09.329934 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f51744e-d49e-49d3-99b9-33a4dc47ff7f" containerID="8d6f1d8c0056d2aad3f90aa5e255c6f54b3c48f84cdd8efc3b983933fcfe95e0" exitCode=0 Jun 12 20:10:09.330453 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:09.330003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" event={"ID":"5f51744e-d49e-49d3-99b9-33a4dc47ff7f","Type":"ContainerDied","Data":"8d6f1d8c0056d2aad3f90aa5e255c6f54b3c48f84cdd8efc3b983933fcfe95e0"} Jun 12 20:10:09.808283 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:09.808194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:09.808440 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:09.808344 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:10:09.808440 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:09.808359 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579654b649-nh9mp: secret "image-registry-tls" not found Jun 12 20:10:09.808440 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:09.808427 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls podName:743f04db-f64f-43f0-97d9-6c2b8fa82b59 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:13.808407797 +0000 UTC m=+44.095914544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls") pod "image-registry-579654b649-nh9mp" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59") : secret "image-registry-tls" not found Jun 12 20:10:09.909106 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:09.909067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:09.909282 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:09.909210 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:09.909282 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:09.909273 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls podName:a86c9aa6-de6b-4296-bb91-dee632048c30 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:13.909257797 +0000 UTC m=+44.196764536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls") pod "dns-default-926pk" (UID: "a86c9aa6-de6b-4296-bb91-dee632048c30") : secret "dns-default-metrics-tls" not found Jun 12 20:10:10.335739 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:10.335698 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f51744e-d49e-49d3-99b9-33a4dc47ff7f" containerID="367aa4f1d9038f6d97c7e1112a950821232048ef250d2498b2ab30bfd89844de" exitCode=0 Jun 12 20:10:10.336355 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:10.335793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" event={"ID":"5f51744e-d49e-49d3-99b9-33a4dc47ff7f","Type":"ContainerDied","Data":"367aa4f1d9038f6d97c7e1112a950821232048ef250d2498b2ab30bfd89844de"} Jun 12 20:10:10.456195 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:10.456155 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:10.537947 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:10.537909 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:11.339354 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:11.339322 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6khsh" event={"ID":"18259a15-c027-4dfc-8ad3-75f944b62ed2","Type":"ContainerStarted","Data":"a0ab7f09b69467f4d63c3fa1c76aebbe7a7505108fd93909e63abe0e6ac8dec8"} Jun 12 20:10:11.342561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:11.342533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" event={"ID":"5f51744e-d49e-49d3-99b9-33a4dc47ff7f","Type":"ContainerStarted","Data":"fb09138ae897c149f88ffaf053b6b8e1845bb388f9f6218202ffbd37f2a4586e"} Jun 12 20:10:11.355117 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:11.355074 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6khsh" podStartSLOduration=0.923045455 podStartE2EDuration="5.355060542s" totalImagesPullingTime="4.432015087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:11.353939925 +0000 UTC m=+41.641446698" watchObservedRunningTime="2026-06-12 20:10:11.355060542 +0000 UTC m=+41.642567303" Jun 12 20:10:11.377722 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:11.377672 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jxvd5" podStartSLOduration=8.611003499 podStartE2EDuration="41.377658545s" totalImagesPullingTime="32.766655046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:11.376564959 +0000 UTC m=+41.664071741" watchObservedRunningTime="2026-06-12 20:10:11.377658545 +0000 UTC m=+41.665165307" Jun 12 20:10:11.498606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:11.498564 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:11.601057 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:11.600979 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:13.832971 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:13.832933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:13.833370 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:13.833087 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:10:13.833370 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:13.833115 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579654b649-nh9mp: secret "image-registry-tls" not found Jun 12 20:10:13.833370 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:13.833169 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls podName:743f04db-f64f-43f0-97d9-6c2b8fa82b59 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:21.833154711 +0000 UTC m=+52.120661452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls") pod "image-registry-579654b649-nh9mp" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59") : secret "image-registry-tls" not found Jun 12 20:10:13.933503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:13.933467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:13.933698 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:13.933579 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:13.933698 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:13.933628 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls podName:a86c9aa6-de6b-4296-bb91-dee632048c30 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:21.933615703 +0000 UTC m=+52.221122444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls") pod "dns-default-926pk" (UID: "a86c9aa6-de6b-4296-bb91-dee632048c30") : secret "dns-default-metrics-tls" not found Jun 12 20:10:18.514656 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:18.514616 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:18.572165 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:18.572126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:18.888148 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:18.888111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:18.987005 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:18.986974 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:19.443871 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:19.443838 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:19.512646 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:19.512616 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:19.856846 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:19.856810 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:19.921184 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:19.921154 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:21.885444 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:21.885402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:21.885938 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:21.885554 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:10:21.885938 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:21.885576 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579654b649-nh9mp: secret "image-registry-tls" not found Jun 12 20:10:21.885938 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:21.885644 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls podName:743f04db-f64f-43f0-97d9-6c2b8fa82b59 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:37.885628217 +0000 UTC m=+68.173134957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls") pod "image-registry-579654b649-nh9mp" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59") : secret "image-registry-tls" not found Jun 12 20:10:21.986543 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:21.986508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:21.986696 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:21.986619 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:21.986696 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:21.986671 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls podName:a86c9aa6-de6b-4296-bb91-dee632048c30 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:37.986656674 +0000 UTC m=+68.274163414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls") pod "dns-default-926pk" (UID: "a86c9aa6-de6b-4296-bb91-dee632048c30") : secret "dns-default-metrics-tls" not found Jun 12 20:10:30.309656 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:30.309623 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvp87" Jun 12 20:10:30.456886 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:30.456849 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:30.559797 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:30.559689 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:31.490347 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:31.490289 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:31.592034 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:31.591996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:35.986077 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:35.986033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:10:35.986529 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:35.986090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:10:35.986529 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:35.986194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:10:35.988676 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:35.988652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 20:10:35.988798 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:35.988655 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 20:10:35.988798 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:35.988752 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 20:10:35.996733 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:35.996708 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 20:10:35.996870 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:35.996811 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs podName:d46b4c0f-a6cd-4005-8456-f23a350e95e6 nodeName:}" failed. No retries permitted until 2026-06-12 20:11:39.996793608 +0000 UTC m=+130.284300348 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs") pod "network-metrics-daemon-6dh9d" (UID: "d46b4c0f-a6cd-4005-8456-f23a350e95e6") : secret "metrics-daemon-secret" not found Jun 12 20:10:35.998633 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:35.998615 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 20:10:35.999999 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:35.999978 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae075d32-600c-42cd-a2ca-69a4c4eb198c-original-pull-secret\") pod \"global-pull-secret-syncer-dphcx\" (UID: \"ae075d32-600c-42cd-a2ca-69a4c4eb198c\") " pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:10:36.009817 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:36.009798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtgdt\" (UniqueName: \"kubernetes.io/projected/616b548c-fb6d-43aa-b75b-0250ffd73f19-kube-api-access-xtgdt\") pod \"network-check-target-kv4wp\" (UID: \"616b548c-fb6d-43aa-b75b-0250ffd73f19\") " pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:10:36.281248 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:36.281132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dphcx" Jun 12 20:10:36.288875 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:36.288854 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nl7nn\"" Jun 12 20:10:36.296706 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:36.296681 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:10:36.408017 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:36.407979 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dphcx"] Jun 12 20:10:36.411233 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:10:36.411204 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae075d32_600c_42cd_a2ca_69a4c4eb198c.slice/crio-c5f213fb58caa72e5367ff392eeb5f87757ad6fd9d20544a01dee00392090062 WatchSource:0}: Error finding container c5f213fb58caa72e5367ff392eeb5f87757ad6fd9d20544a01dee00392090062: Status 404 returned error can't find the container with id c5f213fb58caa72e5367ff392eeb5f87757ad6fd9d20544a01dee00392090062 Jun 12 20:10:36.423606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:36.423583 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kv4wp"] Jun 12 20:10:36.426294 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:10:36.426267 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616b548c_fb6d_43aa_b75b_0250ffd73f19.slice/crio-87342439dae609ea1233ddfe51e1c0f510f15b069f45e9aaebc4b386945a00c3 WatchSource:0}: Error finding container 87342439dae609ea1233ddfe51e1c0f510f15b069f45e9aaebc4b386945a00c3: Status 404 returned error can't find the container with id 87342439dae609ea1233ddfe51e1c0f510f15b069f45e9aaebc4b386945a00c3 Jun 12 20:10:37.404654 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:37.404608 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kv4wp" event={"ID":"616b548c-fb6d-43aa-b75b-0250ffd73f19","Type":"ContainerStarted","Data":"87342439dae609ea1233ddfe51e1c0f510f15b069f45e9aaebc4b386945a00c3"} Jun 12 20:10:37.405811 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:37.405784 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dphcx" event={"ID":"ae075d32-600c-42cd-a2ca-69a4c4eb198c","Type":"ContainerStarted","Data":"c5f213fb58caa72e5367ff392eeb5f87757ad6fd9d20544a01dee00392090062"} Jun 12 20:10:37.900352 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:37.900312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:10:37.900523 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:37.900467 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:10:37.900523 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:37.900488 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579654b649-nh9mp: secret "image-registry-tls" not found Jun 12 20:10:37.900603 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:37.900545 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls podName:743f04db-f64f-43f0-97d9-6c2b8fa82b59 nodeName:}" failed. No retries permitted until 2026-06-12 20:11:09.900528196 +0000 UTC m=+100.188034937 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls") pod "image-registry-579654b649-nh9mp" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59") : secret "image-registry-tls" not found Jun 12 20:10:38.001525 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:38.001486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:10:38.001690 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:38.001633 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:38.001740 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:10:38.001693 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls podName:a86c9aa6-de6b-4296-bb91-dee632048c30 nodeName:}" failed. No retries permitted until 2026-06-12 20:11:10.001679781 +0000 UTC m=+100.289186520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls") pod "dns-default-926pk" (UID: "a86c9aa6-de6b-4296-bb91-dee632048c30") : secret "dns-default-metrics-tls" not found Jun 12 20:10:39.827483 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:39.827447 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:39.884425 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:39.884384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:42.420305 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:42.420268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kv4wp" event={"ID":"616b548c-fb6d-43aa-b75b-0250ffd73f19","Type":"ContainerStarted","Data":"9dc6cafb238035ae15e21e3a79d8d78644905899f1039b518bedc5fa4e36c38a"} Jun 12 20:10:42.420741 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:42.420385 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:10:42.421657 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:42.421634 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dphcx" event={"ID":"ae075d32-600c-42cd-a2ca-69a4c4eb198c","Type":"ContainerStarted","Data":"21d90b9d09f4526bfb253a75681b792f0cd2bca8b8fa00864b62d02328ca20fb"} Jun 12 20:10:42.435645 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:42.435610 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kv4wp" podStartSLOduration=66.847053552 podStartE2EDuration="1m12.435599782s" totalImagesPullingTime="5.58854623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:42.435288863 +0000 UTC m=+72.722795625" watchObservedRunningTime="2026-06-12 20:10:42.435599782 +0000 UTC m=+72.723106545" Jun 12 20:10:42.450393 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:42.450351 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dphcx" podStartSLOduration=66.835684817 podStartE2EDuration="1m12.450336915s" totalImagesPullingTime="5.614652098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:42.450012148 +0000 UTC m=+72.737518909" watchObservedRunningTime="2026-06-12 20:10:42.450336915 +0000 UTC m=+72.737843710" Jun 12 20:10:45.853185 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:45.853146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:45.912253 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:45.912215 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:45.965653 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:45.965618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:10:46.225503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:10:46.225403 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:11:09.935043 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:11:09.935011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:11:09.935420 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:11:09.935161 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:11:09.935420 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:11:09.935180 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579654b649-nh9mp: secret "image-registry-tls" not found Jun 12 20:11:09.935420 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:11:09.935248 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls podName:743f04db-f64f-43f0-97d9-6c2b8fa82b59 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:13.935229639 +0000 UTC m=+164.222736383 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls") pod "image-registry-579654b649-nh9mp" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59") : secret "image-registry-tls" not found Jun 12 20:11:10.035630 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:11:10.035578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:11:10.035830 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:11:10.035722 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:11:10.035830 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:11:10.035819 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls podName:a86c9aa6-de6b-4296-bb91-dee632048c30 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:14.035802663 +0000 UTC m=+164.323309404 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls") pod "dns-default-926pk" (UID: "a86c9aa6-de6b-4296-bb91-dee632048c30") : secret "dns-default-metrics-tls" not found Jun 12 20:11:13.427218 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:11:13.427185 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kv4wp" Jun 12 20:11:40.047054 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:11:40.047005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:11:40.047459 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:11:40.047150 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 20:11:40.047459 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:11:40.047221 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs podName:d46b4c0f-a6cd-4005-8456-f23a350e95e6 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:42.047204385 +0000 UTC m=+252.334711144 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs") pod "network-metrics-daemon-6dh9d" (UID: "d46b4c0f-a6cd-4005-8456-f23a350e95e6") : secret "metrics-daemon-secret" not found Jun 12 20:12:09.087137 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:09.087094 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-579654b649-nh9mp" podUID="743f04db-f64f-43f0-97d9-6c2b8fa82b59" Jun 12 20:12:09.099275 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:09.099231 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-926pk" podUID="a86c9aa6-de6b-4296-bb91-dee632048c30" Jun 12 20:12:09.620463 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:09.620435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-926pk" Jun 12 20:12:09.620623 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:09.620434 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:12:10.174451 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:10.174416 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6dh9d" podUID="d46b4c0f-a6cd-4005-8456-f23a350e95e6" Jun 12 20:12:13.972513 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:13.972473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:12:13.973119 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:13.972655 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:12:13.973119 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:13.972681 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579654b649-nh9mp: secret "image-registry-tls" not found Jun 12 20:12:13.973119 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:13.972788 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls podName:743f04db-f64f-43f0-97d9-6c2b8fa82b59 nodeName:}" failed. No retries permitted until 2026-06-12 20:14:15.972741529 +0000 UTC m=+286.260248274 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls") pod "image-registry-579654b649-nh9mp" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59") : secret "image-registry-tls" not found Jun 12 20:12:14.072999 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:14.072956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:12:14.073163 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:14.073104 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:12:14.073208 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:14.073165 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls podName:a86c9aa6-de6b-4296-bb91-dee632048c30 nodeName:}" failed. No retries permitted until 2026-06-12 20:14:16.073149278 +0000 UTC m=+286.360656019 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls") pod "dns-default-926pk" (UID: "a86c9aa6-de6b-4296-bb91-dee632048c30") : secret "dns-default-metrics-tls" not found Jun 12 20:12:21.163522 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:21.163431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:12:53.018182 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:53.018148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:12:55.629279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.629242 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-55qkf"] Jun 12 20:12:55.631220 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.631199 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz"] Jun 12 20:12:55.631364 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.631312 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:12:55.632860 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.632840 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb"] Jun 12 20:12:55.632991 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.632938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz" Jun 12 20:12:55.634034 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.634010 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 12 20:12:55.634192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.634063 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rjs6f\"" Jun 12 20:12:55.634271 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.634209 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 12 20:12:55.634826 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.634808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:55.634973 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.634947 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c794b8896-9ksmt"] Jun 12 20:12:55.635086 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.635020 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:12:55.635357 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.635340 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8sk8m\"" Jun 12 20:12:55.635642 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.635628 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 12 20:12:55.636933 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.636914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.639249 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.639232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 12 20:12:55.639943 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.639922 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 12 20:12:55.640035 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.639985 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 20:12:55.640374 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.640351 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 12 20:12:55.640449 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.640391 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 12 20:12:55.640518 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.640487 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f952b\"" Jun 12 20:12:55.641697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.641678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 12 20:12:55.641803 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.641725 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 20:12:55.641914 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.641901 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 20:12:55.646339 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.646323 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 20:12:55.646455 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.646440 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 12 20:12:55.646455 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.646449 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pwhjj\"" Jun 12 20:12:55.653364 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.653344 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-55qkf"] Jun 12 20:12:55.660484 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.660462 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb"] Jun 12 20:12:55.661247 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.661229 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c794b8896-9ksmt"] Jun 12 20:12:55.665871 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.665848 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz"] Jun 12 20:12:55.723591 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.723546 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb"] Jun 12 20:12:55.725782 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.725750 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.728293 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.728272 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-n2z5v\"" Jun 12 20:12:55.728511 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.728495 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:12:55.728667 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.728649 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 12 20:12:55.728726 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.728705 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 12 20:12:55.728794 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.728783 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 12 20:12:55.735424 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.735405 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr"] Jun 12 20:12:55.737125 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.737111 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-fvp5c"] Jun 12 20:12:55.737232 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.737217 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:12:55.739011 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.738991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.740253 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.740235 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4ggq6\"" Jun 12 20:12:55.740335 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.740301 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb"] Jun 12 20:12:55.741235 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.741163 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:12:55.741523 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.741509 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 12 20:12:55.741574 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.741539 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 12 20:12:55.741663 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.741646 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 12 20:12:55.747920 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.747453 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-krvrs\"" Jun 12 20:12:55.747920 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.747695 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:12:55.749249 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.748269 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 12 20:12:55.749393 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.749324 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 12 20:12:55.752783 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.752742 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 12 20:12:55.758886 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.758865 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr"] Jun 12 20:12:55.759709 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.759689 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-fvp5c"] Jun 12 20:12:55.771698 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.771675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:12:55.771825 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.771704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g25fr\" (UniqueName: \"kubernetes.io/projected/151621a4-fce8-4f46-8f41-9abc14e9a492-kube-api-access-g25fr\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.771825 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.771728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wnb5\" (UniqueName: \"kubernetes.io/projected/9936d2f3-3d75-4896-b2c4-46bd9565e31e-kube-api-access-2wnb5\") pod \"volume-data-source-validator-bd4ccd799-zl7zz\" (UID: \"9936d2f3-3d75-4896-b2c4-46bd9565e31e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz" Jun 12 20:12:55.771825 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.771817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-default-certificate\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.771969 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.771858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/755a0d15-7a20-48ab-9a45-806c3e3f5249-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:55.771969 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.771879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:55.771969 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.771898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/93e94b98-02b4-40a6-8f99-7fbea15426d3-nginx-conf\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:12:55.771969 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.771943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t9dj\" (UniqueName: \"kubernetes.io/projected/755a0d15-7a20-48ab-9a45-806c3e3f5249-kube-api-access-6t9dj\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:55.772090 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.771976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.772090 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.772005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-stats-auth\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.772090 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.772025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.794025 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.793996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:12:55.827906 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.827873 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd"] Jun 12 20:12:55.829974 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.829958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd" Jun 12 20:12:55.832850 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.832830 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-z62nb\"" Jun 12 20:12:55.851595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.851561 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd"] Jun 12 20:12:55.872884 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.872848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99327431-e243-4443-a09e-6a8f120dfb6e-serving-cert\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.872884 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.872886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g25fr\" (UniqueName: \"kubernetes.io/projected/151621a4-fce8-4f46-8f41-9abc14e9a492-kube-api-access-g25fr\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.873066 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.872905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:12:55.873066 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.872924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9q9v\" (UniqueName: \"kubernetes.io/projected/99327431-e243-4443-a09e-6a8f120dfb6e-kube-api-access-z9q9v\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.873066 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.872988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wnb5\" (UniqueName: \"kubernetes.io/projected/9936d2f3-3d75-4896-b2c4-46bd9565e31e-kube-api-access-2wnb5\") pod \"volume-data-source-validator-bd4ccd799-zl7zz\" (UID: \"9936d2f3-3d75-4896-b2c4-46bd9565e31e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz" Jun 12 20:12:55.873157 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-default-certificate\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.873157 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:55.873150 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 20:12:55.873222 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/93e94b98-02b4-40a6-8f99-7fbea15426d3-nginx-conf\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:12:55.873222 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:55.873206 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert podName:93e94b98-02b4-40a6-8f99-7fbea15426d3 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:56.373188488 +0000 UTC m=+206.660695229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-55qkf" (UID: "93e94b98-02b4-40a6-8f99-7fbea15426d3") : secret "networking-console-plugin-cert" not found Jun 12 20:12:55.873301 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.873301 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t9dj\" (UniqueName: \"kubernetes.io/projected/755a0d15-7a20-48ab-9a45-806c3e3f5249-kube-api-access-6t9dj\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:55.873405 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvn2v\" (UniqueName: \"kubernetes.io/projected/f934a081-0bea-492f-a2fa-212e4ae413f1-kube-api-access-pvn2v\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:12:55.873405 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-stats-auth\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.873405 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:12:55.873558 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:55.873439 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:56.373388544 +0000 UTC m=+206.660895301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : configmap references non-existent config key: service-ca.crt Jun 12 20:12:55.873558 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r69sh\" (UniqueName: \"kubernetes.io/projected/2354ab88-1000-43e7-ae40-a9340a77d2b2-kube-api-access-r69sh\") pod \"kube-storage-version-migrator-operator-7c578b78fc-gdmxb\" (UID: \"2354ab88-1000-43e7-ae40-a9340a77d2b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.873660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.873660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/755a0d15-7a20-48ab-9a45-806c3e3f5249-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:55.873776 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:55.873776 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2354ab88-1000-43e7-ae40-a9340a77d2b2-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-gdmxb\" (UID: \"2354ab88-1000-43e7-ae40-a9340a77d2b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.873776 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99327431-e243-4443-a09e-6a8f120dfb6e-trusted-ca\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.873940 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:55.873785 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 20:12:55.873940 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99327431-e243-4443-a09e-6a8f120dfb6e-config\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.873940 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:55.873812 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 20:12:55.873940 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:55.873864 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:56.373834161 +0000 UTC m=+206.661340905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : secret "router-metrics-certs-default" not found Jun 12 20:12:55.873940 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.873923 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/93e94b98-02b4-40a6-8f99-7fbea15426d3-nginx-conf\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:12:55.874189 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:55.874027 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls podName:755a0d15-7a20-48ab-9a45-806c3e3f5249 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:56.373941723 +0000 UTC m=+206.661448465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q5fcb" (UID: "755a0d15-7a20-48ab-9a45-806c3e3f5249") : secret "cluster-monitoring-operator-tls" not found Jun 12 20:12:55.874189 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.874059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2354ab88-1000-43e7-ae40-a9340a77d2b2-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-gdmxb\" (UID: \"2354ab88-1000-43e7-ae40-a9340a77d2b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.874416 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.874393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/755a0d15-7a20-48ab-9a45-806c3e3f5249-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:55.875768 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.875729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-stats-auth\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.875867 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.875801 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-default-certificate\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.891722 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.891662 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g25fr\" (UniqueName: \"kubernetes.io/projected/151621a4-fce8-4f46-8f41-9abc14e9a492-kube-api-access-g25fr\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:55.898669 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.898640 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wnb5\" (UniqueName: \"kubernetes.io/projected/9936d2f3-3d75-4896-b2c4-46bd9565e31e-kube-api-access-2wnb5\") pod \"volume-data-source-validator-bd4ccd799-zl7zz\" (UID: \"9936d2f3-3d75-4896-b2c4-46bd9565e31e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz" Jun 12 20:12:55.899008 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.898992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t9dj\" (UniqueName: \"kubernetes.io/projected/755a0d15-7a20-48ab-9a45-806c3e3f5249-kube-api-access-6t9dj\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:55.948244 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.948208 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz" Jun 12 20:12:55.974958 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.974929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:12:55.975086 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.974963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r69sh\" (UniqueName: \"kubernetes.io/projected/2354ab88-1000-43e7-ae40-a9340a77d2b2-kube-api-access-r69sh\") pod \"kube-storage-version-migrator-operator-7c578b78fc-gdmxb\" (UID: \"2354ab88-1000-43e7-ae40-a9340a77d2b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.975086 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2354ab88-1000-43e7-ae40-a9340a77d2b2-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-gdmxb\" (UID: \"2354ab88-1000-43e7-ae40-a9340a77d2b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.975086 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99327431-e243-4443-a09e-6a8f120dfb6e-trusted-ca\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.975086 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99327431-e243-4443-a09e-6a8f120dfb6e-config\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.975086 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:55.975070 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 20:12:55.975317 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2354ab88-1000-43e7-ae40-a9340a77d2b2-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-gdmxb\" (UID: \"2354ab88-1000-43e7-ae40-a9340a77d2b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.975317 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:55.975157 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls podName:f934a081-0bea-492f-a2fa-212e4ae413f1 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:56.475133932 +0000 UTC m=+206.762640683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-j7pgr" (UID: "f934a081-0bea-492f-a2fa-212e4ae413f1") : secret "samples-operator-tls" not found Jun 12 20:12:55.975317 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99327431-e243-4443-a09e-6a8f120dfb6e-serving-cert\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.975317 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9q9v\" (UniqueName: \"kubernetes.io/projected/99327431-e243-4443-a09e-6a8f120dfb6e-kube-api-access-z9q9v\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.975317 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xngrh\" (UniqueName: \"kubernetes.io/projected/79c851d6-d940-4d8e-9cd9-97c69b1d52a1-kube-api-access-xngrh\") pod \"network-check-source-6947749cfc-p6tgd\" (UID: \"79c851d6-d940-4d8e-9cd9-97c69b1d52a1\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd" Jun 12 20:12:55.975569 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvn2v\" (UniqueName: \"kubernetes.io/projected/f934a081-0bea-492f-a2fa-212e4ae413f1-kube-api-access-pvn2v\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:12:55.975658 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2354ab88-1000-43e7-ae40-a9340a77d2b2-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-gdmxb\" (UID: \"2354ab88-1000-43e7-ae40-a9340a77d2b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.975880 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.975861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99327431-e243-4443-a09e-6a8f120dfb6e-config\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.976024 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.976005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99327431-e243-4443-a09e-6a8f120dfb6e-trusted-ca\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.977771 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.977741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2354ab88-1000-43e7-ae40-a9340a77d2b2-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-gdmxb\" (UID: \"2354ab88-1000-43e7-ae40-a9340a77d2b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.978202 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.978187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99327431-e243-4443-a09e-6a8f120dfb6e-serving-cert\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:55.994073 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.993955 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r69sh\" (UniqueName: \"kubernetes.io/projected/2354ab88-1000-43e7-ae40-a9340a77d2b2-kube-api-access-r69sh\") pod \"kube-storage-version-migrator-operator-7c578b78fc-gdmxb\" (UID: \"2354ab88-1000-43e7-ae40-a9340a77d2b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:55.995158 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.995121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvn2v\" (UniqueName: \"kubernetes.io/projected/f934a081-0bea-492f-a2fa-212e4ae413f1-kube-api-access-pvn2v\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:12:55.996424 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:55.996399 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9q9v\" (UniqueName: \"kubernetes.io/projected/99327431-e243-4443-a09e-6a8f120dfb6e-kube-api-access-z9q9v\") pod \"console-operator-5dbbb5d744-fvp5c\" (UID: \"99327431-e243-4443-a09e-6a8f120dfb6e\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:56.034070 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.034043 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" Jun 12 20:12:56.056861 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.056821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:12:56.057940 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.057916 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:12:56.072890 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.072823 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz"] Jun 12 20:12:56.076000 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.075974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xngrh\" (UniqueName: \"kubernetes.io/projected/79c851d6-d940-4d8e-9cd9-97c69b1d52a1-kube-api-access-xngrh\") pod \"network-check-source-6947749cfc-p6tgd\" (UID: \"79c851d6-d940-4d8e-9cd9-97c69b1d52a1\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd" Jun 12 20:12:56.076708 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:12:56.076687 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9936d2f3_3d75_4896_b2c4_46bd9565e31e.slice/crio-91ee65dbbae221cb461053a61c9dd5ba5ee575fa1f71b6c3729ecfe63bf59622 WatchSource:0}: Error finding container 91ee65dbbae221cb461053a61c9dd5ba5ee575fa1f71b6c3729ecfe63bf59622: Status 404 returned error can't find the container with id 91ee65dbbae221cb461053a61c9dd5ba5ee575fa1f71b6c3729ecfe63bf59622 Jun 12 20:12:56.086340 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.086065 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xngrh\" (UniqueName: \"kubernetes.io/projected/79c851d6-d940-4d8e-9cd9-97c69b1d52a1-kube-api-access-xngrh\") pod \"network-check-source-6947749cfc-p6tgd\" (UID: \"79c851d6-d940-4d8e-9cd9-97c69b1d52a1\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd" Jun 12 20:12:56.137917 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.137869 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd" Jun 12 20:12:56.159619 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.159586 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:12:56.180062 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.180033 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb"] Jun 12 20:12:56.183788 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:12:56.183738 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2354ab88_1000_43e7_ae40_a9340a77d2b2.slice/crio-521dadf281bf431e092fb382e3cdd457ad08d19807c46c6fa363abbe2900d780 WatchSource:0}: Error finding container 521dadf281bf431e092fb382e3cdd457ad08d19807c46c6fa363abbe2900d780: Status 404 returned error can't find the container with id 521dadf281bf431e092fb382e3cdd457ad08d19807c46c6fa363abbe2900d780 Jun 12 20:12:56.194531 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.194070 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-fvp5c"] Jun 12 20:12:56.198403 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:12:56.198380 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99327431_e243_4443_a09e_6a8f120dfb6e.slice/crio-2b8d43aa1da119f8f82193f93e6fa38fa771299daa6e1ddd8cf4d8190880e8f1 WatchSource:0}: Error finding container 2b8d43aa1da119f8f82193f93e6fa38fa771299daa6e1ddd8cf4d8190880e8f1: Status 404 returned error can't find the container with id 2b8d43aa1da119f8f82193f93e6fa38fa771299daa6e1ddd8cf4d8190880e8f1 Jun 12 20:12:56.271841 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.271806 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd"] Jun 12 20:12:56.275301 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:12:56.275271 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c851d6_d940_4d8e_9cd9_97c69b1d52a1.slice/crio-d3b6c9aeffa2f3f1cbfea98ffbfcbb27eb417af66dfbe64509dc4535dcf222e4 WatchSource:0}: Error finding container d3b6c9aeffa2f3f1cbfea98ffbfcbb27eb417af66dfbe64509dc4535dcf222e4: Status 404 returned error can't find the container with id d3b6c9aeffa2f3f1cbfea98ffbfcbb27eb417af66dfbe64509dc4535dcf222e4 Jun 12 20:12:56.378497 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.378460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:56.378667 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.378538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:56.378667 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.378566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:56.378667 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.378601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:12:56.378667 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:56.378641 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 20:12:56.378667 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:56.378661 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:57.378641006 +0000 UTC m=+207.666147756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : configmap references non-existent config key: service-ca.crt Jun 12 20:12:56.378872 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:56.378690 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:57.378679715 +0000 UTC m=+207.666186460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : secret "router-metrics-certs-default" not found Jun 12 20:12:56.378872 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:56.378704 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 20:12:56.378872 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:56.378767 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls podName:755a0d15-7a20-48ab-9a45-806c3e3f5249 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:57.378741494 +0000 UTC m=+207.666248234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q5fcb" (UID: "755a0d15-7a20-48ab-9a45-806c3e3f5249") : secret "cluster-monitoring-operator-tls" not found Jun 12 20:12:56.378872 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:56.378704 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 20:12:56.378872 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:56.378814 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert podName:93e94b98-02b4-40a6-8f99-7fbea15426d3 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:57.378803196 +0000 UTC m=+207.666309936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-55qkf" (UID: "93e94b98-02b4-40a6-8f99-7fbea15426d3") : secret "networking-console-plugin-cert" not found Jun 12 20:12:56.479214 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.479121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:12:56.479355 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:56.479247 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 20:12:56.479355 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:56.479297 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls podName:f934a081-0bea-492f-a2fa-212e4ae413f1 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:57.479283391 +0000 UTC m=+207.766790131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-j7pgr" (UID: "f934a081-0bea-492f-a2fa-212e4ae413f1") : secret "samples-operator-tls" not found Jun 12 20:12:56.729066 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.729018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd" event={"ID":"79c851d6-d940-4d8e-9cd9-97c69b1d52a1","Type":"ContainerStarted","Data":"d9af2545f92133e7f0f9a2a2858eba8206b8d5b34c896be420de052ecb715d74"} Jun 12 20:12:56.729625 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.729085 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd" event={"ID":"79c851d6-d940-4d8e-9cd9-97c69b1d52a1","Type":"ContainerStarted","Data":"d3b6c9aeffa2f3f1cbfea98ffbfcbb27eb417af66dfbe64509dc4535dcf222e4"} Jun 12 20:12:56.730099 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.730049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" event={"ID":"99327431-e243-4443-a09e-6a8f120dfb6e","Type":"ContainerStarted","Data":"2b8d43aa1da119f8f82193f93e6fa38fa771299daa6e1ddd8cf4d8190880e8f1"} Jun 12 20:12:56.731486 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.731448 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" event={"ID":"2354ab88-1000-43e7-ae40-a9340a77d2b2","Type":"ContainerStarted","Data":"521dadf281bf431e092fb382e3cdd457ad08d19807c46c6fa363abbe2900d780"} Jun 12 20:12:56.732536 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.732512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz" event={"ID":"9936d2f3-3d75-4896-b2c4-46bd9565e31e","Type":"ContainerStarted","Data":"91ee65dbbae221cb461053a61c9dd5ba5ee575fa1f71b6c3729ecfe63bf59622"} Jun 12 20:12:56.750978 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:56.750912 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p6tgd" podStartSLOduration=1.7508925899999999 podStartE2EDuration="1.75089259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:12:56.747986501 +0000 UTC m=+207.035493287" watchObservedRunningTime="2026-06-12 20:12:56.75089259 +0000 UTC m=+207.038399349" Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:57.387910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:57.387999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:57.388099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:57.388130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:57.388262 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:57.388323 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls podName:755a0d15-7a20-48ab-9a45-806c3e3f5249 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:59.388303744 +0000 UTC m=+209.675810494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q5fcb" (UID: "755a0d15-7a20-48ab-9a45-806c3e3f5249") : secret "cluster-monitoring-operator-tls" not found Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:57.388448 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:59.388424738 +0000 UTC m=+209.675931497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : configmap references non-existent config key: service-ca.crt Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:57.388515 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:57.388547 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert podName:93e94b98-02b4-40a6-8f99-7fbea15426d3 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:59.388537175 +0000 UTC m=+209.676043915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-55qkf" (UID: "93e94b98-02b4-40a6-8f99-7fbea15426d3") : secret "networking-console-plugin-cert" not found Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:57.388594 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 20:12:57.388660 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:57.388625 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:59.388615623 +0000 UTC m=+209.676122367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : secret "router-metrics-certs-default" not found Jun 12 20:12:57.488888 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:57.488700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:12:57.488888 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:57.488820 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 20:12:57.488888 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:57.488890 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls podName:f934a081-0bea-492f-a2fa-212e4ae413f1 nodeName:}" failed. No retries permitted until 2026-06-12 20:12:59.488872084 +0000 UTC m=+209.776378824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-j7pgr" (UID: "f934a081-0bea-492f-a2fa-212e4ae413f1") : secret "samples-operator-tls" not found Jun 12 20:12:57.740050 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:57.740016 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz" event={"ID":"9936d2f3-3d75-4896-b2c4-46bd9565e31e","Type":"ContainerStarted","Data":"be87a76d872bb70e746c62e5f8ff64f92a63094e23d63ee2de95751fbd422904"} Jun 12 20:12:57.768300 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:57.768249 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zl7zz" podStartSLOduration=1.586861661 podStartE2EDuration="2.768234634s" totalImagesPullingTime="1.181372973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:12:57.76698161 +0000 UTC m=+208.054488394" watchObservedRunningTime="2026-06-12 20:12:57.768234634 +0000 UTC m=+208.055741398" Jun 12 20:12:57.862789 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:57.862738 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:12:59.376106 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.376068 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m45wk"] Jun 12 20:12:59.378177 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.378161 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.381591 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.381570 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 20:12:59.383155 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.383021 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 20:12:59.383155 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.383031 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 20:12:59.383155 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.383047 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8fjk8\"" Jun 12 20:12:59.383363 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.383290 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 20:12:59.400464 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.400434 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m45wk"] Jun 12 20:12:59.405044 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.405020 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:12:59.405147 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.405076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:59.405193 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.405169 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 20:12:59.405239 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.405202 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.40518993 +0000 UTC m=+213.692696670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : configmap references non-existent config key: service-ca.crt Jun 12 20:12:59.405239 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.405222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:12:59.405345 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.405259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:12:59.405345 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.405268 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert podName:93e94b98-02b4-40a6-8f99-7fbea15426d3 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.405252049 +0000 UTC m=+213.692758790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-55qkf" (UID: "93e94b98-02b4-40a6-8f99-7fbea15426d3") : secret "networking-console-plugin-cert" not found Jun 12 20:12:59.405345 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.405302 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 20:12:59.405345 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.405314 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 20:12:59.405345 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.405336 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls podName:755a0d15-7a20-48ab-9a45-806c3e3f5249 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.405318046 +0000 UTC m=+213.692824788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q5fcb" (UID: "755a0d15-7a20-48ab-9a45-806c3e3f5249") : secret "cluster-monitoring-operator-tls" not found Jun 12 20:12:59.405521 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.405364 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.405349241 +0000 UTC m=+213.692855999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : secret "router-metrics-certs-default" not found Jun 12 20:12:59.432718 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.432697 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:12:59.492283 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.492250 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:12:59.506371 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.506338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-data-volume\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.506606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.506394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.506606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.506426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-crio-socket\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.506606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.506494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.506606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.506560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dldgn\" (UniqueName: \"kubernetes.io/projected/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-api-access-dldgn\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.506606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.506598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:12:59.506839 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.506744 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 20:12:59.506839 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.506826 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls podName:f934a081-0bea-492f-a2fa-212e4ae413f1 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.506806569 +0000 UTC m=+213.794313311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-j7pgr" (UID: "f934a081-0bea-492f-a2fa-212e4ae413f1") : secret "samples-operator-tls" not found Jun 12 20:12:59.607805 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.607749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-data-volume\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.607931 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.607861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.607931 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.607887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-crio-socket\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.608052 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.607934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.608052 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.607989 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-crio-socket\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.608052 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.608000 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dldgn\" (UniqueName: \"kubernetes.io/projected/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-api-access-dldgn\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.608184 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.607988 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:12:59.608184 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.608112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-data-volume\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.608184 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.608132 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:00.108116146 +0000 UTC m=+210.395622889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : configmap "kube-rbac-proxy" not found Jun 12 20:12:59.608184 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.608133 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:12:59.608304 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:12:59.608191 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:00.108175553 +0000 UTC m=+210.395682298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : secret "insights-runtime-extractor-tls" not found Jun 12 20:12:59.619093 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.619064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dldgn\" (UniqueName: \"kubernetes.io/projected/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-api-access-dldgn\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:12:59.748577 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.748505 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/0.log" Jun 12 20:12:59.748577 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.748544 2578 generic.go:356] "Generic (PLEG): container finished" podID="99327431-e243-4443-a09e-6a8f120dfb6e" containerID="7e190d39e3a0bdcea13b093317e38420f5ccf33695358655d65000a7aafecd01" exitCode=255 Jun 12 20:12:59.748809 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.748575 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" event={"ID":"99327431-e243-4443-a09e-6a8f120dfb6e","Type":"ContainerDied","Data":"7e190d39e3a0bdcea13b093317e38420f5ccf33695358655d65000a7aafecd01"} Jun 12 20:12:59.748902 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.748885 2578 scope.go:117] "RemoveContainer" containerID="7e190d39e3a0bdcea13b093317e38420f5ccf33695358655d65000a7aafecd01" Jun 12 20:12:59.750210 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.750188 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" event={"ID":"2354ab88-1000-43e7-ae40-a9340a77d2b2","Type":"ContainerStarted","Data":"bcf349a23cd2ba88cba4350df6b4d020d6c67f22c7fb4eca10fd8bfec5c39b5d"} Jun 12 20:12:59.781045 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:12:59.780998 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" podStartSLOduration=2.027316337 podStartE2EDuration="4.780980782s" totalImagesPullingTime="2.753664445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:12:59.780451698 +0000 UTC m=+210.067958459" watchObservedRunningTime="2026-06-12 20:12:59.780980782 +0000 UTC m=+210.068487545" Jun 12 20:13:00.113030 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.112996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:00.113173 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.113118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:00.113233 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:00.113165 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:00.113233 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:00.113198 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:13:00.113291 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:00.113245 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:01.113232535 +0000 UTC m=+211.400739274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : configmap "kube-rbac-proxy" not found Jun 12 20:13:00.113291 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:00.113258 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:01.113252596 +0000 UTC m=+211.400759335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:00.694917 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.694880 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:00.754249 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.754221 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:13:00.754623 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.754606 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/0.log" Jun 12 20:13:00.754681 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.754642 2578 generic.go:356] "Generic (PLEG): container finished" podID="99327431-e243-4443-a09e-6a8f120dfb6e" containerID="729a328d54f41e10ce982b04d49054bc00328e6d69191a390936132aa56c4137" exitCode=255 Jun 12 20:13:00.754732 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.754718 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" event={"ID":"99327431-e243-4443-a09e-6a8f120dfb6e","Type":"ContainerDied","Data":"729a328d54f41e10ce982b04d49054bc00328e6d69191a390936132aa56c4137"} Jun 12 20:13:00.754822 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.754811 2578 scope.go:117] "RemoveContainer" containerID="7e190d39e3a0bdcea13b093317e38420f5ccf33695358655d65000a7aafecd01" Jun 12 20:13:00.755109 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.755089 2578 scope.go:117] "RemoveContainer" containerID="729a328d54f41e10ce982b04d49054bc00328e6d69191a390936132aa56c4137" Jun 12 20:13:00.755293 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:00.755268 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-fvp5c_openshift-console-operator(99327431-e243-4443-a09e-6a8f120dfb6e)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" podUID="99327431-e243-4443-a09e-6a8f120dfb6e" Jun 12 20:13:00.773932 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.773905 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:00.830842 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:00.830816 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:01.123421 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:01.123390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:01.123613 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:01.123446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:01.123613 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:01.123524 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:13:01.123613 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:01.123533 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:01.123613 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:01.123589 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.123576146 +0000 UTC m=+213.411082886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:01.123813 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:01.123672 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.123656583 +0000 UTC m=+213.411163324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : configmap "kube-rbac-proxy" not found Jun 12 20:13:01.167718 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:01.167691 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9zvlx_eefdd8b6-744f-417c-b929-430ad6eaeefb/dns-node-resolver/0.log" Jun 12 20:13:01.169733 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:01.169710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:01.229057 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:01.229029 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:01.427003 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:01.426923 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:01.528094 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:01.528065 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:01.759374 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:01.759298 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:13:01.759725 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:01.759623 2578 scope.go:117] "RemoveContainer" containerID="729a328d54f41e10ce982b04d49054bc00328e6d69191a390936132aa56c4137" Jun 12 20:13:01.759797 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:01.759781 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-fvp5c_openshift-console-operator(99327431-e243-4443-a09e-6a8f120dfb6e)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" podUID="99327431-e243-4443-a09e-6a8f120dfb6e" Jun 12 20:13:02.167459 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:02.167430 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ck9f_c0eadafd-3454-437e-ab4d-4fe2fb19e0f0/node-ca/0.log" Jun 12 20:13:02.967555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:02.967528 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6khsh_18259a15-c027-4dfc-8ad3-75f944b62ed2/serve-healthcheck-canary/0.log" Jun 12 20:13:03.025670 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.025637 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-tv272"] Jun 12 20:13:03.028170 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.028155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.030626 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.030605 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7xkxp\"" Jun 12 20:13:03.030730 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.030629 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 12 20:13:03.030730 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.030687 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 12 20:13:03.031458 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.031442 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 12 20:13:03.031556 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.031468 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 12 20:13:03.038802 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.038781 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-tv272"] Jun 12 20:13:03.071741 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.071703 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:03.141847 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.141815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:03.141945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.141872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/56cef241-901d-481f-a7ad-b1982ab55f16-signing-cabundle\") pod \"service-ca-7b994bc59-tv272\" (UID: \"56cef241-901d-481f-a7ad-b1982ab55f16\") " pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.141945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.141905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm8k9\" (UniqueName: \"kubernetes.io/projected/56cef241-901d-481f-a7ad-b1982ab55f16-kube-api-access-rm8k9\") pod \"service-ca-7b994bc59-tv272\" (UID: \"56cef241-901d-481f-a7ad-b1982ab55f16\") " pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.142016 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.141965 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:03.142046 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.142014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/56cef241-901d-481f-a7ad-b1982ab55f16-signing-key\") pod \"service-ca-7b994bc59-tv272\" (UID: \"56cef241-901d-481f-a7ad-b1982ab55f16\") " pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.142046 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.142040 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:07.142020343 +0000 UTC m=+217.429527083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:03.142132 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.142118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:03.142201 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.142191 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:13:03.142235 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.142225 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:07.142215888 +0000 UTC m=+217.429722627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : configmap "kube-rbac-proxy" not found Jun 12 20:13:03.171593 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.171568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:03.242539 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.242467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm8k9\" (UniqueName: \"kubernetes.io/projected/56cef241-901d-481f-a7ad-b1982ab55f16-kube-api-access-rm8k9\") pod \"service-ca-7b994bc59-tv272\" (UID: \"56cef241-901d-481f-a7ad-b1982ab55f16\") " pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.242539 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.242516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/56cef241-901d-481f-a7ad-b1982ab55f16-signing-key\") pod \"service-ca-7b994bc59-tv272\" (UID: \"56cef241-901d-481f-a7ad-b1982ab55f16\") " pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.242702 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.242687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/56cef241-901d-481f-a7ad-b1982ab55f16-signing-cabundle\") pod \"service-ca-7b994bc59-tv272\" (UID: \"56cef241-901d-481f-a7ad-b1982ab55f16\") " pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.243332 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.243264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/56cef241-901d-481f-a7ad-b1982ab55f16-signing-cabundle\") pod \"service-ca-7b994bc59-tv272\" (UID: \"56cef241-901d-481f-a7ad-b1982ab55f16\") " pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.245034 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.245014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/56cef241-901d-481f-a7ad-b1982ab55f16-signing-key\") pod \"service-ca-7b994bc59-tv272\" (UID: \"56cef241-901d-481f-a7ad-b1982ab55f16\") " pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.249985 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.249959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm8k9\" (UniqueName: \"kubernetes.io/projected/56cef241-901d-481f-a7ad-b1982ab55f16-kube-api-access-rm8k9\") pod \"service-ca-7b994bc59-tv272\" (UID: \"56cef241-901d-481f-a7ad-b1982ab55f16\") " pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.311410 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.311376 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:03.336569 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.336538 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-tv272" Jun 12 20:13:03.363883 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.363856 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:03.445125 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.445096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:13:03.445275 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.445159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:03.445275 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.445211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:03.445275 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.445229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:13:03.445431 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.445314 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 20:13:03.445431 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.445311 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 20:13:03.445431 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.445313 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 20:13:03.445431 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.445354 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:11.445334111 +0000 UTC m=+221.732840869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : configmap references non-existent config key: service-ca.crt Jun 12 20:13:03.445431 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.445374 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:11.445365674 +0000 UTC m=+221.732872415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : secret "router-metrics-certs-default" not found Jun 12 20:13:03.445431 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.445400 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls podName:755a0d15-7a20-48ab-9a45-806c3e3f5249 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:11.445381253 +0000 UTC m=+221.732887993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q5fcb" (UID: "755a0d15-7a20-48ab-9a45-806c3e3f5249") : secret "cluster-monitoring-operator-tls" not found Jun 12 20:13:03.445431 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.445410 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert podName:93e94b98-02b4-40a6-8f99-7fbea15426d3 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:11.445405353 +0000 UTC m=+221.732912093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-55qkf" (UID: "93e94b98-02b4-40a6-8f99-7fbea15426d3") : secret "networking-console-plugin-cert" not found Jun 12 20:13:03.458096 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.458072 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-tv272"] Jun 12 20:13:03.462053 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:13:03.462033 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cef241_901d_481f_a7ad_b1982ab55f16.slice/crio-41f504eabad5bc20e241f46215ca6147fa0c2081683b0599998b89021846d764 WatchSource:0}: Error finding container 41f504eabad5bc20e241f46215ca6147fa0c2081683b0599998b89021846d764: Status 404 returned error can't find the container with id 41f504eabad5bc20e241f46215ca6147fa0c2081683b0599998b89021846d764 Jun 12 20:13:03.546029 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.545925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:13:03.546175 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.546076 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 20:13:03.546175 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:03.546140 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls podName:f934a081-0bea-492f-a2fa-212e4ae413f1 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:11.546126051 +0000 UTC m=+221.833632791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-j7pgr" (UID: "f934a081-0bea-492f-a2fa-212e4ae413f1") : secret "samples-operator-tls" not found Jun 12 20:13:03.765344 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.765306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-tv272" event={"ID":"56cef241-901d-481f-a7ad-b1982ab55f16","Type":"ContainerStarted","Data":"41f504eabad5bc20e241f46215ca6147fa0c2081683b0599998b89021846d764"} Jun 12 20:13:03.920653 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:03.920611 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:05.772645 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:05.772612 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-tv272" event={"ID":"56cef241-901d-481f-a7ad-b1982ab55f16","Type":"ContainerStarted","Data":"d0f06065dd7429f467430c0715f48b750a128cb9aceacea179bc9cc932e1060f"} Jun 12 20:13:05.789072 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:05.789024 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-tv272" podStartSLOduration=0.640162526 podStartE2EDuration="2.789009286s" totalImagesPullingTime="2.14884676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:05.788203622 +0000 UTC m=+216.075710394" watchObservedRunningTime="2026-06-12 20:13:05.789009286 +0000 UTC m=+216.076516048" Jun 12 20:13:06.057023 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:06.056936 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:13:06.057023 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:06.057005 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:13:06.057445 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:06.057431 2578 scope.go:117] "RemoveContainer" containerID="729a328d54f41e10ce982b04d49054bc00328e6d69191a390936132aa56c4137" Jun 12 20:13:06.057636 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:06.057614 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-fvp5c_openshift-console-operator(99327431-e243-4443-a09e-6a8f120dfb6e)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" podUID="99327431-e243-4443-a09e-6a8f120dfb6e" Jun 12 20:13:06.579840 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:06.579803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:06.727202 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:06.727163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:06.834140 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:06.834050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:06.928492 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:06.928458 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:07.040406 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:07.040358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:07.147748 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:07.147652 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:07.178197 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:07.178160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:07.178364 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:07.178240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:07.178364 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:07.178277 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:13:07.178364 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:07.178348 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:15.178327817 +0000 UTC m=+225.465834574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : configmap "kube-rbac-proxy" not found Jun 12 20:13:07.178364 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:07.178345 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:07.178544 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:07.178402 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:15.17838641 +0000 UTC m=+225.465893151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:07.288121 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:07.288077 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:08.064178 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:08.064146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:08.709051 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:08.708998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:08.869139 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:08.869091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:09.077170 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:09.077137 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:10.095251 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:10.095205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:10.267169 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:10.267122 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:10.367989 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:10.367894 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:10.468507 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:10.468469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:10.572528 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:10.572493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:10.680882 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:10.680749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:10.869580 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:10.869545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:11.065028 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.064993 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:11.326250 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.326167 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:11.513363 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.513326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:11.513609 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.513419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:11.513609 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.513445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:13:11.513609 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.513485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:13:11.513609 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:11.513500 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle podName:151621a4-fce8-4f46-8f41-9abc14e9a492 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:27.513482975 +0000 UTC m=+237.800989715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle") pod "router-default-7c794b8896-9ksmt" (UID: "151621a4-fce8-4f46-8f41-9abc14e9a492") : configmap references non-existent config key: service-ca.crt Jun 12 20:13:11.513609 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:11.513574 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 20:13:11.513609 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:11.513576 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 20:13:11.513867 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:11.513629 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert podName:93e94b98-02b4-40a6-8f99-7fbea15426d3 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:27.513614374 +0000 UTC m=+237.801121134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-55qkf" (UID: "93e94b98-02b4-40a6-8f99-7fbea15426d3") : secret "networking-console-plugin-cert" not found Jun 12 20:13:11.513867 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:11.513644 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls podName:755a0d15-7a20-48ab-9a45-806c3e3f5249 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:27.51363632 +0000 UTC m=+237.801143060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q5fcb" (UID: "755a0d15-7a20-48ab-9a45-806c3e3f5249") : secret "cluster-monitoring-operator-tls" not found Jun 12 20:13:11.516030 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.516014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/151621a4-fce8-4f46-8f41-9abc14e9a492-metrics-certs\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:11.614126 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.614019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:13:11.616476 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.616454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f934a081-0bea-492f-a2fa-212e4ae413f1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-j7pgr\" (UID: \"f934a081-0bea-492f-a2fa-212e4ae413f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:13:11.651906 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.651878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" Jun 12 20:13:11.775602 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:11.775481 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr"] Jun 12 20:13:12.468777 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:12.468725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:12.570825 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:12.570793 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:12.670455 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:12.670424 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:12.797803 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:12.797696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" event={"ID":"f934a081-0bea-492f-a2fa-212e4ae413f1","Type":"ContainerStarted","Data":"f42f8421a8b30c2946f2156df98c0327d2bb4d955137a7592e880e0be4ffaab2"} Jun 12 20:13:12.872272 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:12.872200 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:13.066738 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:13.066693 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:13.115678 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:13.115647 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:13.264051 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:13.263976 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:13.807618 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:13.807591 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" event={"ID":"f934a081-0bea-492f-a2fa-212e4ae413f1","Type":"ContainerStarted","Data":"c01feef22eab622db6379ffde262d0050579922c7e374cee002cf7050136c495"} Jun 12 20:13:14.268118 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:14.268080 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:14.464255 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:14.464222 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:14.812710 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:14.812676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" event={"ID":"f934a081-0bea-492f-a2fa-212e4ae413f1","Type":"ContainerStarted","Data":"76f90ece46e7688d7ed7339240dbafb386dada6fe70d335338aac173739ccf4f"} Jun 12 20:13:14.829279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:14.829228 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-j7pgr" podStartSLOduration=17.90604368 podStartE2EDuration="19.829212494s" totalImagesPullingTime="1.923168814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:14.828171474 +0000 UTC m=+225.115678249" watchObservedRunningTime="2026-06-12 20:13:14.829212494 +0000 UTC m=+225.116719255" Jun 12 20:13:14.873367 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:14.873308 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:15.095644 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:15.095556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:15.248331 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:15.248302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:15.248485 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:15.248358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:15.248485 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:15.248478 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:15.248571 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:15.248530 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls podName:74f18f5a-f287-4a27-93a0-bb78bd1a3a90 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:31.248516726 +0000 UTC m=+241.536023465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m45wk" (UID: "74f18f5a-f287-4a27-93a0-bb78bd1a3a90") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:15.248821 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:15.248803 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:15.466629 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:15.466543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:16.264990 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:16.264955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:16.663745 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:16.663713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:16.869210 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:16.869178 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:17.066259 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:17.066228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:17.269136 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:17.269106 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:19.453543 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:19.453510 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:19.511891 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:19.511862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:21.163939 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:21.163908 2578 scope.go:117] "RemoveContainer" containerID="729a328d54f41e10ce982b04d49054bc00328e6d69191a390936132aa56c4137" Jun 12 20:13:21.691992 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:21.691961 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:21.780237 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:21.780203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:21.834468 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:21.834444 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:13:21.834624 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:21.834536 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" event={"ID":"99327431-e243-4443-a09e-6a8f120dfb6e","Type":"ContainerStarted","Data":"3fc8ea963ea269e6cdafca136cee3fba2dc8f1160136f922f4654291da9c7f40"} Jun 12 20:13:21.834873 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:21.834842 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:13:21.854961 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:21.854898 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" podStartSLOduration=24.117245999 podStartE2EDuration="26.85488063s" totalImagesPullingTime="2.737634631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:21.854213972 +0000 UTC m=+232.141720735" watchObservedRunningTime="2026-06-12 20:13:21.85488063 +0000 UTC m=+232.142387394" Jun 12 20:13:21.901374 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:21.901342 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-fvp5c" Jun 12 20:13:22.069165 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.069133 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-l8gvn"] Jun 12 20:13:22.072115 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.072094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-l8gvn" Jun 12 20:13:22.074586 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.074564 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-b82bp\"" Jun 12 20:13:22.074686 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.074626 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 20:13:22.074876 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.074861 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 20:13:22.085472 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.085451 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-l8gvn"] Jun 12 20:13:22.093828 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.093806 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:22.098702 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.098678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgvkv\" (UniqueName: \"kubernetes.io/projected/bea2f805-a6ec-4145-8574-11261b03c8c3-kube-api-access-pgvkv\") pod \"downloads-694c955b9-l8gvn\" (UID: \"bea2f805-a6ec-4145-8574-11261b03c8c3\") " pod="openshift-console/downloads-694c955b9-l8gvn" Jun 12 20:13:22.194466 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.194431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:22.199592 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.199573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvkv\" (UniqueName: \"kubernetes.io/projected/bea2f805-a6ec-4145-8574-11261b03c8c3-kube-api-access-pgvkv\") pod \"downloads-694c955b9-l8gvn\" (UID: \"bea2f805-a6ec-4145-8574-11261b03c8c3\") " pod="openshift-console/downloads-694c955b9-l8gvn" Jun 12 20:13:22.208623 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.208600 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgvkv\" (UniqueName: \"kubernetes.io/projected/bea2f805-a6ec-4145-8574-11261b03c8c3-kube-api-access-pgvkv\") pod \"downloads-694c955b9-l8gvn\" (UID: \"bea2f805-a6ec-4145-8574-11261b03c8c3\") " pod="openshift-console/downloads-694c955b9-l8gvn" Jun 12 20:13:22.294110 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.294073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:22.380698 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.380605 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-l8gvn" Jun 12 20:13:22.394948 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.394915 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:22.510486 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.510456 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-l8gvn"] Jun 12 20:13:22.513312 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:13:22.513288 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea2f805_a6ec_4145_8574_11261b03c8c3.slice/crio-2d1795b8943d28877720207ab7411aecb3d2050f2b535e44e55f49405150db78 WatchSource:0}: Error finding container 2d1795b8943d28877720207ab7411aecb3d2050f2b535e44e55f49405150db78: Status 404 returned error can't find the container with id 2d1795b8943d28877720207ab7411aecb3d2050f2b535e44e55f49405150db78 Jun 12 20:13:22.761487 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.761408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:22.818480 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.818452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:22.838973 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.838941 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-l8gvn" event={"ID":"bea2f805-a6ec-4145-8574-11261b03c8c3","Type":"ContainerStarted","Data":"2d1795b8943d28877720207ab7411aecb3d2050f2b535e44e55f49405150db78"} Jun 12 20:13:22.959327 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:22.959298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:23.014610 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:23.014528 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:23.162311 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:23.162263 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:23.571460 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:23.571425 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:23.772725 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:23.772685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:23.968475 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:23.968384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:24.166458 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:24.166425 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:24.787560 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:24.787517 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:27.549270 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.549236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:13:27.549694 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.549294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:13:27.549694 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.549380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:27.550161 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.550102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151621a4-fce8-4f46-8f41-9abc14e9a492-service-ca-bundle\") pod \"router-default-7c794b8896-9ksmt\" (UID: \"151621a4-fce8-4f46-8f41-9abc14e9a492\") " pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:27.552183 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.552157 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e94b98-02b4-40a6-8f99-7fbea15426d3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-55qkf\" (UID: \"93e94b98-02b4-40a6-8f99-7fbea15426d3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:13:27.552389 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.552362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/755a0d15-7a20-48ab-9a45-806c3e3f5249-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q5fcb\" (UID: \"755a0d15-7a20-48ab-9a45-806c3e3f5249\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:13:27.742527 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.742491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" Jun 12 20:13:27.753882 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.753855 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" Jun 12 20:13:27.759292 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.759194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:27.940293 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:27.940256 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-55qkf"] Jun 12 20:13:27.944881 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:13:27.944836 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e94b98_02b4_40a6_8f99_7fbea15426d3.slice/crio-c7c726971c0526bac17809f7de0fbb6083a01ea53858d0c03488498e0d0728e3 WatchSource:0}: Error finding container c7c726971c0526bac17809f7de0fbb6083a01ea53858d0c03488498e0d0728e3: Status 404 returned error can't find the container with id c7c726971c0526bac17809f7de0fbb6083a01ea53858d0c03488498e0d0728e3 Jun 12 20:13:28.167779 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:28.167734 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c794b8896-9ksmt"] Jun 12 20:13:28.169624 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:28.169600 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb"] Jun 12 20:13:28.169828 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:13:28.169802 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151621a4_fce8_4f46_8f41_9abc14e9a492.slice/crio-b959d2d7949b339836d34b8d1bd6a9dc8f90cbc2c6f0008098f98a164322613b WatchSource:0}: Error finding container b959d2d7949b339836d34b8d1bd6a9dc8f90cbc2c6f0008098f98a164322613b: Status 404 returned error can't find the container with id b959d2d7949b339836d34b8d1bd6a9dc8f90cbc2c6f0008098f98a164322613b Jun 12 20:13:28.172957 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:13:28.172916 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755a0d15_7a20_48ab_9a45_806c3e3f5249.slice/crio-8a1f1df0f06dfb107c9cdfeefe535a24cb9c3d37dfe9c2a3242931a01da4ce90 WatchSource:0}: Error finding container 8a1f1df0f06dfb107c9cdfeefe535a24cb9c3d37dfe9c2a3242931a01da4ce90: Status 404 returned error can't find the container with id 8a1f1df0f06dfb107c9cdfeefe535a24cb9c3d37dfe9c2a3242931a01da4ce90 Jun 12 20:13:28.866436 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:28.866381 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c794b8896-9ksmt" event={"ID":"151621a4-fce8-4f46-8f41-9abc14e9a492","Type":"ContainerStarted","Data":"e4c4bc481fbb1d24f856e5d913676d10b1ee37ea89be2025cb02959256e144c5"} Jun 12 20:13:28.866952 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:28.866444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c794b8896-9ksmt" event={"ID":"151621a4-fce8-4f46-8f41-9abc14e9a492","Type":"ContainerStarted","Data":"b959d2d7949b339836d34b8d1bd6a9dc8f90cbc2c6f0008098f98a164322613b"} Jun 12 20:13:28.869079 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:28.869046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" event={"ID":"93e94b98-02b4-40a6-8f99-7fbea15426d3","Type":"ContainerStarted","Data":"c7c726971c0526bac17809f7de0fbb6083a01ea53858d0c03488498e0d0728e3"} Jun 12 20:13:28.870771 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:28.870724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" event={"ID":"755a0d15-7a20-48ab-9a45-806c3e3f5249","Type":"ContainerStarted","Data":"8a1f1df0f06dfb107c9cdfeefe535a24cb9c3d37dfe9c2a3242931a01da4ce90"} Jun 12 20:13:28.888027 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:28.887579 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c794b8896-9ksmt" podStartSLOduration=33.887559395 podStartE2EDuration="33.887559395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:28.887204079 +0000 UTC m=+239.174710844" watchObservedRunningTime="2026-06-12 20:13:28.887559395 +0000 UTC m=+239.175066159" Jun 12 20:13:29.759718 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:29.759670 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:29.762672 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:29.762623 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:29.877904 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:29.877857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" event={"ID":"93e94b98-02b4-40a6-8f99-7fbea15426d3","Type":"ContainerStarted","Data":"3c8fde4b942efea11cb3fe16d7e1cdda1421f806e9c1bb2df5a5d0dff526079a"} Jun 12 20:13:29.878434 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:29.878212 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:29.879578 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:29.879553 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c794b8896-9ksmt" Jun 12 20:13:29.893091 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:29.892961 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-55qkf" podStartSLOduration=33.666708335 podStartE2EDuration="34.892941796s" totalImagesPullingTime="1.226233461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:29.892449111 +0000 UTC m=+240.179955874" watchObservedRunningTime="2026-06-12 20:13:29.892941796 +0000 UTC m=+240.180448560" Jun 12 20:13:29.989606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:29.989559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:30.049981 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.049896 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:30.675388 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.675297 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:30.774082 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.774029 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:30.830686 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.830497 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6"] Jun 12 20:13:30.834158 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.834132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" Jun 12 20:13:30.835362 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.835336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:30.836492 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.836472 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 12 20:13:30.836576 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.836563 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-l55xr\"" Jun 12 20:13:30.841049 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.841024 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6"] Jun 12 20:13:30.878651 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.878536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/419b3646-32a9-45c8-956b-a37898211d10-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2s4j6\" (UID: \"419b3646-32a9-45c8-956b-a37898211d10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" Jun 12 20:13:30.884446 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.884366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" event={"ID":"755a0d15-7a20-48ab-9a45-806c3e3f5249","Type":"ContainerStarted","Data":"dcab4f707e3ecb87c3518a02df1b275f770fb1fda693a3e0d53f177de95336ab"} Jun 12 20:13:30.901307 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.901255 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q5fcb" podStartSLOduration=33.742478046 podStartE2EDuration="35.901236436s" totalImagesPullingTime="2.15875839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:30.899684236 +0000 UTC m=+241.187191021" watchObservedRunningTime="2026-06-12 20:13:30.901236436 +0000 UTC m=+241.188743199" Jun 12 20:13:30.980669 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:30.979732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/419b3646-32a9-45c8-956b-a37898211d10-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2s4j6\" (UID: \"419b3646-32a9-45c8-956b-a37898211d10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" Jun 12 20:13:30.980669 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:30.980253 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 12 20:13:30.980669 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:30.980312 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419b3646-32a9-45c8-956b-a37898211d10-tls-certificates podName:419b3646-32a9-45c8-956b-a37898211d10 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:31.480292618 +0000 UTC m=+241.767799365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/419b3646-32a9-45c8-956b-a37898211d10-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-2s4j6" (UID: "419b3646-32a9-45c8-956b-a37898211d10") : secret "prometheus-operator-admission-webhook-tls" not found Jun 12 20:13:31.055279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.055243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:31.282316 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.282235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:31.285006 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.284978 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74f18f5a-f287-4a27-93a0-bb78bd1a3a90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m45wk\" (UID: \"74f18f5a-f287-4a27-93a0-bb78bd1a3a90\") " pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:31.483780 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.483726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/419b3646-32a9-45c8-956b-a37898211d10-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2s4j6\" (UID: \"419b3646-32a9-45c8-956b-a37898211d10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" Jun 12 20:13:31.486705 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.486682 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/419b3646-32a9-45c8-956b-a37898211d10-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2s4j6\" (UID: \"419b3646-32a9-45c8-956b-a37898211d10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" Jun 12 20:13:31.489368 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.489335 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8fjk8\"" Jun 12 20:13:31.497065 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.497048 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m45wk" Jun 12 20:13:31.638621 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.638589 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m45wk"] Jun 12 20:13:31.641811 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:13:31.641782 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f18f5a_f287_4a27_93a0_bb78bd1a3a90.slice/crio-7e87c0de9916da74958717bc9972f0700d721b64ae18f86578abd536f3944b3a WatchSource:0}: Error finding container 7e87c0de9916da74958717bc9972f0700d721b64ae18f86578abd536f3944b3a: Status 404 returned error can't find the container with id 7e87c0de9916da74958717bc9972f0700d721b64ae18f86578abd536f3944b3a Jun 12 20:13:31.748353 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.748321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" Jun 12 20:13:31.889205 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.889171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m45wk" event={"ID":"74f18f5a-f287-4a27-93a0-bb78bd1a3a90","Type":"ContainerStarted","Data":"7e87c0de9916da74958717bc9972f0700d721b64ae18f86578abd536f3944b3a"} Jun 12 20:13:31.893969 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:31.893840 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6"] Jun 12 20:13:31.896746 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:13:31.896721 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419b3646_32a9_45c8_956b_a37898211d10.slice/crio-0fdacbe7daf3a7cb4c2e2d856fae468ebbf56b72be94ef2661563de518e98c6a WatchSource:0}: Error finding container 0fdacbe7daf3a7cb4c2e2d856fae468ebbf56b72be94ef2661563de518e98c6a: Status 404 returned error can't find the container with id 0fdacbe7daf3a7cb4c2e2d856fae468ebbf56b72be94ef2661563de518e98c6a Jun 12 20:13:32.895747 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:32.895674 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" event={"ID":"419b3646-32a9-45c8-956b-a37898211d10","Type":"ContainerStarted","Data":"0fdacbe7daf3a7cb4c2e2d856fae468ebbf56b72be94ef2661563de518e98c6a"} Jun 12 20:13:36.597259 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:36.597226 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:36.698278 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:36.698232 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:42.075886 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.075860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:13:42.078342 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.078319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d46b4c0f-a6cd-4005-8456-f23a350e95e6-metrics-certs\") pod \"network-metrics-daemon-6dh9d\" (UID: \"d46b4c0f-a6cd-4005-8456-f23a350e95e6\") " pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:13:42.167196 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.167165 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gl8lm\"" Jun 12 20:13:42.175798 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.175745 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dh9d" Jun 12 20:13:42.304565 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.304476 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6dh9d"] Jun 12 20:13:42.308043 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:13:42.308010 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46b4c0f_a6cd_4005_8456_f23a350e95e6.slice/crio-c250da9e2027cfbc94fa8dc00db7900c49f2f16fdc12d64d3b028237150912ec WatchSource:0}: Error finding container c250da9e2027cfbc94fa8dc00db7900c49f2f16fdc12d64d3b028237150912ec: Status 404 returned error can't find the container with id c250da9e2027cfbc94fa8dc00db7900c49f2f16fdc12d64d3b028237150912ec Jun 12 20:13:42.938377 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.938280 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" event={"ID":"419b3646-32a9-45c8-956b-a37898211d10","Type":"ContainerStarted","Data":"717a3f68088a215232fc7d9cc6e9db35dd47734d83e9c2a88577ece7a1beb789"} Jun 12 20:13:42.938377 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.938357 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" Jun 12 20:13:42.942294 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.942249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-l8gvn" event={"ID":"bea2f805-a6ec-4145-8574-11261b03c8c3","Type":"ContainerStarted","Data":"ae44dc4e3495350ffbf6234419658dedc5d213bea749917ba75d0ab736eb3ad3"} Jun 12 20:13:42.942951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.942928 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-l8gvn" Jun 12 20:13:42.945178 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.945133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m45wk" event={"ID":"74f18f5a-f287-4a27-93a0-bb78bd1a3a90","Type":"ContainerStarted","Data":"09b38d26064f08076b51adaf5c01a08df540e0605d11ab61a8de870e1e185041"} Jun 12 20:13:42.945298 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.945230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m45wk" event={"ID":"74f18f5a-f287-4a27-93a0-bb78bd1a3a90","Type":"ContainerStarted","Data":"4c8984887af2b271abf1b64b12bb853494cbeca580f680eaef5b2fa88c0a26b7"} Jun 12 20:13:42.945862 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.945600 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" Jun 12 20:13:42.946503 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.946452 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dh9d" event={"ID":"d46b4c0f-a6cd-4005-8456-f23a350e95e6","Type":"ContainerStarted","Data":"c250da9e2027cfbc94fa8dc00db7900c49f2f16fdc12d64d3b028237150912ec"} Jun 12 20:13:42.952137 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.952107 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-l8gvn" Jun 12 20:13:42.954469 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.954409 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2s4j6" podStartSLOduration=2.8212303 podStartE2EDuration="12.954395507s" totalImagesPullingTime="10.133165207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:42.953807495 +0000 UTC m=+253.241314256" watchObservedRunningTime="2026-06-12 20:13:42.954395507 +0000 UTC m=+253.241902269" Jun 12 20:13:42.991070 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:42.990493 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-l8gvn" podStartSLOduration=1.473805708 podStartE2EDuration="20.990466832s" totalImagesPullingTime="19.516661124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:42.970916346 +0000 UTC m=+253.258423107" watchObservedRunningTime="2026-06-12 20:13:42.990466832 +0000 UTC m=+253.277973595" Jun 12 20:13:43.857068 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:43.856995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:43.927148 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:43.927078 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:44.081156 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:44.081111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:45.835469 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:45.835429 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:45.960827 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:45.960787 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m45wk" event={"ID":"74f18f5a-f287-4a27-93a0-bb78bd1a3a90","Type":"ContainerStarted","Data":"53b145e1c955cf6bbcc32ee0cb188c3b989839850be23adc588bcfc092b34934"} Jun 12 20:13:45.963123 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:45.963092 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dh9d" event={"ID":"d46b4c0f-a6cd-4005-8456-f23a350e95e6","Type":"ContainerStarted","Data":"d96019deca1dbc6e3c90a9113a441e35ff6a90542c8727c097aecd4eb00b8be9"} Jun 12 20:13:45.963322 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:45.963304 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dh9d" event={"ID":"d46b4c0f-a6cd-4005-8456-f23a350e95e6","Type":"ContainerStarted","Data":"e94e2785b13e7018c6bc41d75c17d472d386b7214718e29963e9bf13f876a808"} Jun 12 20:13:45.996709 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:45.996651 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m45wk" podStartSLOduration=33.377154685 podStartE2EDuration="46.99663043s" totalImagesPullingTime="13.619475745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:12:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:45.995526388 +0000 UTC m=+256.283033159" watchObservedRunningTime="2026-06-12 20:13:45.99663043 +0000 UTC m=+256.284137193" Jun 12 20:13:46.018786 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:46.018723 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6dh9d" podStartSLOduration=253.343311713 podStartE2EDuration="4m16.018709044s" totalImagesPullingTime="2.675397331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:46.016526894 +0000 UTC m=+256.304033690" watchObservedRunningTime="2026-06-12 20:13:46.018709044 +0000 UTC m=+256.306215806" Jun 12 20:13:46.030900 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:46.030866 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:46.094079 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:46.094000 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:46.150479 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:46.150443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:46.208987 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:46.208949 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:48.005313 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.005216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:48.219645 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.219613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:48.324014 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.323978 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lhs9q"] Jun 12 20:13:48.334876 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.334845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:48.348387 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.348361 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.353398 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.353265 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 20:13:48.354241 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.354209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 20:13:48.354544 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.354526 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-47zqg\"" Jun 12 20:13:48.354711 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.354690 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 20:13:48.354801 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.354696 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 20:13:48.436020 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.435982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd69d700-ec30-40f8-b865-5ba80feecbf1-root\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.436263 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.436242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rmkp\" (UniqueName: \"kubernetes.io/projected/cd69d700-ec30-40f8-b865-5ba80feecbf1-kube-api-access-6rmkp\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.436357 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.436276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd69d700-ec30-40f8-b865-5ba80feecbf1-sys\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.436357 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.436302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-textfile\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.436357 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.436336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-tls\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.436512 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.436400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-wtmp\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.436512 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.436438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd69d700-ec30-40f8-b865-5ba80feecbf1-metrics-client-ca\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.436512 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.436466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-accelerators-collector-config\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.436653 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.436569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.452572 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.452534 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:48.538033 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.537995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rmkp\" (UniqueName: \"kubernetes.io/projected/cd69d700-ec30-40f8-b865-5ba80feecbf1-kube-api-access-6rmkp\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.538954 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.538927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd69d700-ec30-40f8-b865-5ba80feecbf1-sys\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.539196 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.539173 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-textfile\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.539332 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.539316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-tls\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.539511 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.539486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-wtmp\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.539630 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:48.539519 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 20:13:48.539630 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.539535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd69d700-ec30-40f8-b865-5ba80feecbf1-metrics-client-ca\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.539630 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.539567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-accelerators-collector-config\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.539630 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.539574 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-textfile\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.539630 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:48.539585 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-tls podName:cd69d700-ec30-40f8-b865-5ba80feecbf1 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:49.039566664 +0000 UTC m=+259.327073420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-tls") pod "node-exporter-lhs9q" (UID: "cd69d700-ec30-40f8-b865-5ba80feecbf1") : secret "node-exporter-tls" not found Jun 12 20:13:48.539630 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.539130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd69d700-ec30-40f8-b865-5ba80feecbf1-sys\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.539956 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.539710 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-wtmp\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.540143 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.540116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-accelerators-collector-config\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.540236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.540212 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd69d700-ec30-40f8-b865-5ba80feecbf1-metrics-client-ca\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.540395 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.540377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.540473 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.540442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd69d700-ec30-40f8-b865-5ba80feecbf1-root\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.540529 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.540514 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd69d700-ec30-40f8-b865-5ba80feecbf1-root\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.543441 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.543412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.546816 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.546792 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rmkp\" (UniqueName: \"kubernetes.io/projected/cd69d700-ec30-40f8-b865-5ba80feecbf1-kube-api-access-6rmkp\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:48.687056 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.686961 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:48.745258 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.745208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:48.885438 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:48.885402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:49.045723 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.045635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-tls\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:49.048634 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.048606 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd69d700-ec30-40f8-b865-5ba80feecbf1-node-exporter-tls\") pod \"node-exporter-lhs9q\" (UID: \"cd69d700-ec30-40f8-b865-5ba80feecbf1\") " pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:49.080602 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.080559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:49.256824 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.256788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:49.262230 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.262209 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lhs9q" Jun 12 20:13:49.358303 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.358266 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 20:13:49.359971 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.359865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:49.384872 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.384842 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 20:13:49.385040 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.385026 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.387888 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.387865 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 20:13:49.388278 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.388255 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 20:13:49.388493 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.388473 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 20:13:49.388606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.388573 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 20:13:49.388826 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.388590 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 20:13:49.388826 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.388679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 20:13:49.388826 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.388736 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 20:13:49.388826 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.388680 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 20:13:49.389093 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.388919 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kzgvv\"" Jun 12 20:13:49.389093 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.389013 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 20:13:49.469133 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.469095 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:49.550706 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.550615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.550706 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.550669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.550706 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.550693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.550992 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.550713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.550992 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.550845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-config-out\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.550992 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.550884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-web-config\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.550992 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.550923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.550992 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.550980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.551241 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.551013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.551241 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.551077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.551241 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.551116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.551241 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.551199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.551428 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.551227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lpw9\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-kube-api-access-7lpw9\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652072 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lpw9\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-kube-api-access-7lpw9\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652512 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:49.652268 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 12 20:13:49.652512 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:13:49.652341 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-main-tls podName:c8e63956-3421-42e3-aa17-1977beeccf40 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:50.152320389 +0000 UTC m=+260.439827150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40") : secret "alertmanager-main-tls" not found Jun 12 20:13:49.652670 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652670 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652670 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652845 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-config-out\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652845 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-web-config\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.652980 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.652860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.654231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.653629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.654231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.653588 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.654231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.653362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.654231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.654056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.657917 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.656292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.657917 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.656403 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.657917 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.657121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.657917 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.657559 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.657917 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.657912 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-config-out\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.658463 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.658313 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.658726 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.658702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-web-config\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.659128 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.659006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.661546 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.661520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lpw9\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-kube-api-access-7lpw9\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:49.985776 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:49.984822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lhs9q" event={"ID":"cd69d700-ec30-40f8-b865-5ba80feecbf1","Type":"ContainerStarted","Data":"55241c161d188a0eda8a37a6b5a1d419e320c004dc371d6c11812262d1242566"} Jun 12 20:13:50.158293 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:50.158250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:50.161394 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:50.161363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:50.200248 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:50.200215 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:50.300124 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:50.300036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:13:50.707548 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:50.704395 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 20:13:50.991046 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:50.991012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerStarted","Data":"b5d94201a3e8a26667f5c65a0f563e88eb6b08de28472af38f409b8755d8049e"} Jun 12 20:13:51.203078 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.203041 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:51.254971 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.254893 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-756ddf58f8-lz5rr"] Jun 12 20:13:51.272440 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.272412 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-756ddf58f8-lz5rr"] Jun 12 20:13:51.272681 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.272658 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.273383 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.273346 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:51.275290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.275268 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 12 20:13:51.275660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.275640 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-81ghqiijn45s\"" Jun 12 20:13:51.275941 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.275915 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dzh9v\"" Jun 12 20:13:51.276065 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.275724 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 12 20:13:51.276382 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.276332 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 12 20:13:51.276506 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.275677 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 12 20:13:51.277951 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.276709 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 12 20:13:51.372306 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.372274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnnhw\" (UniqueName: \"kubernetes.io/projected/4183387d-c0c6-4d36-bd86-52834bc36c57-kube-api-access-nnnhw\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.372472 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.372336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.372472 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.372368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.372472 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.372425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.372472 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.372452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-tls\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.372672 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.372484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4183387d-c0c6-4d36-bd86-52834bc36c57-metrics-client-ca\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.372672 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.372601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-grpc-tls\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.372672 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.372643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.394850 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.394823 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:51.473929 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.473894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.474112 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.473952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnnhw\" (UniqueName: \"kubernetes.io/projected/4183387d-c0c6-4d36-bd86-52834bc36c57-kube-api-access-nnnhw\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.474112 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.473993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.474112 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.474019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.474254 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.474115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.474254 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.474154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-tls\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.474254 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.474187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4183387d-c0c6-4d36-bd86-52834bc36c57-metrics-client-ca\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.474254 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.474248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-grpc-tls\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.475403 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.475369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4183387d-c0c6-4d36-bd86-52834bc36c57-metrics-client-ca\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.476993 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.476959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.477302 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.477278 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.478071 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.478021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.478071 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.478024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-tls\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.479342 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.479321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.479641 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.479599 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4183387d-c0c6-4d36-bd86-52834bc36c57-secret-grpc-tls\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.482200 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.482181 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnnhw\" (UniqueName: \"kubernetes.io/projected/4183387d-c0c6-4d36-bd86-52834bc36c57-kube-api-access-nnnhw\") pod \"thanos-querier-756ddf58f8-lz5rr\" (UID: \"4183387d-c0c6-4d36-bd86-52834bc36c57\") " pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.630602 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.630568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:51.646541 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.646509 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:51.805125 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.805100 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-756ddf58f8-lz5rr"] Jun 12 20:13:51.807459 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:13:51.807432 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4183387d_c0c6_4d36_bd86_52834bc36c57.slice/crio-db7241aeb645ad90430e1d7f2b1f3aa5e0344faa6b8278db1b05e4b259e03542 WatchSource:0}: Error finding container db7241aeb645ad90430e1d7f2b1f3aa5e0344faa6b8278db1b05e4b259e03542: Status 404 returned error can't find the container with id db7241aeb645ad90430e1d7f2b1f3aa5e0344faa6b8278db1b05e4b259e03542 Jun 12 20:13:51.995550 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.995454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" event={"ID":"4183387d-c0c6-4d36-bd86-52834bc36c57","Type":"ContainerStarted","Data":"db7241aeb645ad90430e1d7f2b1f3aa5e0344faa6b8278db1b05e4b259e03542"} Jun 12 20:13:51.997077 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.997053 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd69d700-ec30-40f8-b865-5ba80feecbf1" containerID="9ac3523c2c36a651de70da24ae19c9fc885fdbf1fffd2e39c38980628e399143" exitCode=0 Jun 12 20:13:51.997200 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:51.997099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lhs9q" event={"ID":"cd69d700-ec30-40f8-b865-5ba80feecbf1","Type":"ContainerDied","Data":"9ac3523c2c36a651de70da24ae19c9fc885fdbf1fffd2e39c38980628e399143"} Jun 12 20:13:52.493083 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:52.493056 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:52.590983 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:52.590932 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:53.004337 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:53.004187 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8e63956-3421-42e3-aa17-1977beeccf40" containerID="e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8" exitCode=0 Jun 12 20:13:53.004337 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:53.004304 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerDied","Data":"e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8"} Jun 12 20:13:53.011802 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:53.011158 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lhs9q" event={"ID":"cd69d700-ec30-40f8-b865-5ba80feecbf1","Type":"ContainerStarted","Data":"25856ebc583390b440be5782f998dc7ca682c037a850974568109051c319ea80"} Jun 12 20:13:53.011802 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:53.011217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lhs9q" event={"ID":"cd69d700-ec30-40f8-b865-5ba80feecbf1","Type":"ContainerStarted","Data":"72a583b6a26036937025ea85d3911b460ce6f34ce7e8886fe3b82dd446fc50b3"} Jun 12 20:13:53.065187 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:53.065155 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:53.069468 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:53.069414 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lhs9q" podStartSLOduration=3.24706094 podStartE2EDuration="5.069393924s" totalImagesPullingTime="1.680964876s" totalInitContainerRuntime="141.368108ms" isStatefulPod=true podCreationTimestamp="2026-06-12 20:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:53.069135144 +0000 UTC m=+263.356641930" watchObservedRunningTime="2026-06-12 20:13:53.069393924 +0000 UTC m=+263.356900687" Jun 12 20:13:53.140855 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:53.140805 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:53.464783 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:53.464684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:53.962557 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:53.962519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:54.518556 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:54.518521 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:55.540120 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:55.540097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:55.595697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:55.595671 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:56.030328 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:56.030297 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerStarted","Data":"361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195"} Jun 12 20:13:56.030430 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:56.030383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerStarted","Data":"e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436"} Jun 12 20:13:56.030490 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:56.030428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerStarted","Data":"7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce"} Jun 12 20:13:56.030490 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:56.030467 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerStarted","Data":"3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14"} Jun 12 20:13:56.032682 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:56.032652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" event={"ID":"4183387d-c0c6-4d36-bd86-52834bc36c57","Type":"ContainerStarted","Data":"fb80ef6802c3d13f509164b109dac42a8b7a575a880c15c3df2cb344f35a53f2"} Jun 12 20:13:56.032792 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:56.032732 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" event={"ID":"4183387d-c0c6-4d36-bd86-52834bc36c57","Type":"ContainerStarted","Data":"559a296cceb31f6d1416bdb73726ff9f9993572152a9d569c9ec902ca17e7b2e"} Jun 12 20:13:56.032838 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:56.032809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" event={"ID":"4183387d-c0c6-4d36-bd86-52834bc36c57","Type":"ContainerStarted","Data":"4294d642ba5a19353f8757288a73077bae0401c3ebe761691b5de4d35c212b37"} Jun 12 20:13:57.039903 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:57.039865 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerStarted","Data":"9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd"} Jun 12 20:13:58.046791 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:58.046693 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerStarted","Data":"4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc"} Jun 12 20:13:58.049707 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:58.049664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" event={"ID":"4183387d-c0c6-4d36-bd86-52834bc36c57","Type":"ContainerStarted","Data":"94a3bd5e34ac25ba3f30544fbcb2d6d9740188a4e795aaf1f2889423a06b6baa"} Jun 12 20:13:58.049856 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:58.049721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" event={"ID":"4183387d-c0c6-4d36-bd86-52834bc36c57","Type":"ContainerStarted","Data":"bfb3fd934fd22e364a4b12cc3bad04f537cdc2e74cbe20d22fd5371125d5b5f1"} Jun 12 20:13:58.049856 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:58.049777 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:13:58.049856 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:58.049803 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" event={"ID":"4183387d-c0c6-4d36-bd86-52834bc36c57","Type":"ContainerStarted","Data":"c98cec92d0f483539932e62c1b463d0958bf0c40904f75c6ea3651dc60559813"} Jun 12 20:13:58.071826 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:58.071745 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.351065744 podStartE2EDuration="9.071731479s" totalImagesPullingTime="5.711169887s" totalInitContainerRuntime="9.495848ms" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:58.071150549 +0000 UTC m=+268.358657343" watchObservedRunningTime="2026-06-12 20:13:58.071731479 +0000 UTC m=+268.359238232" Jun 12 20:13:58.093202 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:58.093153 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" podStartSLOduration=1.8820139230000001 podStartE2EDuration="7.093138109s" totalImagesPullingTime="5.211124186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:58.091974154 +0000 UTC m=+268.379480918" watchObservedRunningTime="2026-06-12 20:13:58.093138109 +0000 UTC m=+268.380644872" Jun 12 20:13:58.900736 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:58.900704 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:58.951470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:58.951439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:59.116198 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:59.116164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:13:59.169506 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:13:59.169411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:04.061369 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:04.061330 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-756ddf58f8-lz5rr" Jun 12 20:14:08.443787 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:08.443741 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:08.546441 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:08.546407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:10.095906 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:10.095873 2578 generic.go:356] "Generic (PLEG): container finished" podID="2354ab88-1000-43e7-ae40-a9340a77d2b2" containerID="bcf349a23cd2ba88cba4350df6b4d020d6c67f22c7fb4eca10fd8bfec5c39b5d" exitCode=0 Jun 12 20:14:10.096260 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:10.095952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" event={"ID":"2354ab88-1000-43e7-ae40-a9340a77d2b2","Type":"ContainerDied","Data":"bcf349a23cd2ba88cba4350df6b4d020d6c67f22c7fb4eca10fd8bfec5c39b5d"} Jun 12 20:14:10.096303 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:10.096292 2578 scope.go:117] "RemoveContainer" containerID="bcf349a23cd2ba88cba4350df6b4d020d6c67f22c7fb4eca10fd8bfec5c39b5d" Jun 12 20:14:11.101236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:11.101203 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-gdmxb" event={"ID":"2354ab88-1000-43e7-ae40-a9340a77d2b2","Type":"ContainerStarted","Data":"7fbb489cb66e85ff4a8108b81b3532b1970c85396abc33a25b73e4caed3ce1cc"} Jun 12 20:14:12.621091 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:14:12.621050 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-926pk" podUID="a86c9aa6-de6b-4296-bb91-dee632048c30" Jun 12 20:14:12.621091 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:14:12.621059 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-579654b649-nh9mp" podUID="743f04db-f64f-43f0-97d9-6c2b8fa82b59" Jun 12 20:14:13.108340 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:13.108314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:14:13.108517 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:13.108314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-926pk" Jun 12 20:14:13.139040 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:13.139013 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:13.194627 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:13.194593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:15.993045 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:15.993009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:14:15.995507 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:15.995481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"image-registry-579654b649-nh9mp\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:14:16.093946 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:16.093906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:14:16.096307 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:16.096291 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a86c9aa6-de6b-4296-bb91-dee632048c30-metrics-tls\") pod \"dns-default-926pk\" (UID: \"a86c9aa6-de6b-4296-bb91-dee632048c30\") " pod="openshift-dns/dns-default-926pk" Jun 12 20:14:16.112459 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:16.112430 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rxxkq\"" Jun 12 20:14:16.112459 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:16.112449 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5mqvq\"" Jun 12 20:14:16.119861 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:16.119828 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:14:16.119861 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:16.119855 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-926pk" Jun 12 20:14:16.307121 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:16.307088 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-579654b649-nh9mp"] Jun 12 20:14:16.309211 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:14:16.309182 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743f04db_f64f_43f0_97d9_6c2b8fa82b59.slice/crio-fce781fe4b58dfc5becbf0b2b58ab0d44cadf79b6bcbc0e1f332030af98acdbc WatchSource:0}: Error finding container fce781fe4b58dfc5becbf0b2b58ab0d44cadf79b6bcbc0e1f332030af98acdbc: Status 404 returned error can't find the container with id fce781fe4b58dfc5becbf0b2b58ab0d44cadf79b6bcbc0e1f332030af98acdbc Jun 12 20:14:16.321319 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:16.321299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-926pk"] Jun 12 20:14:16.323373 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:14:16.323349 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86c9aa6_de6b_4296_bb91_dee632048c30.slice/crio-fa2c654fb76d6d90bdb2b01c6147a81bcd3c9fcb20557b8a971e1665ce86e63d WatchSource:0}: Error finding container fa2c654fb76d6d90bdb2b01c6147a81bcd3c9fcb20557b8a971e1665ce86e63d: Status 404 returned error can't find the container with id fa2c654fb76d6d90bdb2b01c6147a81bcd3c9fcb20557b8a971e1665ce86e63d Jun 12 20:14:17.129043 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:17.129005 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579654b649-nh9mp" event={"ID":"743f04db-f64f-43f0-97d9-6c2b8fa82b59","Type":"ContainerStarted","Data":"71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8"} Jun 12 20:14:17.129541 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:17.129060 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579654b649-nh9mp" event={"ID":"743f04db-f64f-43f0-97d9-6c2b8fa82b59","Type":"ContainerStarted","Data":"fce781fe4b58dfc5becbf0b2b58ab0d44cadf79b6bcbc0e1f332030af98acdbc"} Jun 12 20:14:17.129541 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:17.129110 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:14:17.130478 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:17.130449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-926pk" event={"ID":"a86c9aa6-de6b-4296-bb91-dee632048c30","Type":"ContainerStarted","Data":"fa2c654fb76d6d90bdb2b01c6147a81bcd3c9fcb20557b8a971e1665ce86e63d"} Jun 12 20:14:17.152909 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:17.152746 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-579654b649-nh9mp" podStartSLOduration=287.152718749 podStartE2EDuration="4m47.152718749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:14:17.150126546 +0000 UTC m=+287.437633309" watchObservedRunningTime="2026-06-12 20:14:17.152718749 +0000 UTC m=+287.440225512" Jun 12 20:14:18.060633 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:18.060569 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:18.162058 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:18.162023 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:19.140728 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:19.140692 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-926pk" event={"ID":"a86c9aa6-de6b-4296-bb91-dee632048c30","Type":"ContainerStarted","Data":"c1993a3f6f3746e3d624878504da52b1888f5ca6e4e6104bc56782a8792e57af"} Jun 12 20:14:19.140920 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:19.140748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-926pk" event={"ID":"a86c9aa6-de6b-4296-bb91-dee632048c30","Type":"ContainerStarted","Data":"9fac961994f2bb43b424f89466d50a380b33492c20bf76ad77db9a97fbb1123a"} Jun 12 20:14:19.140920 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:19.140825 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-926pk" Jun 12 20:14:19.156891 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:19.156847 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-926pk" podStartSLOduration=250.705365703 podStartE2EDuration="4m13.156827023s" totalImagesPullingTime="2.45146132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:14:19.156244085 +0000 UTC m=+289.443750859" watchObservedRunningTime="2026-06-12 20:14:19.156827023 +0000 UTC m=+289.444333785" Jun 12 20:14:19.439111 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:19.439031 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:19.495678 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:19.495649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:27.546828 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:27.546791 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:27.597885 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:27.597850 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:29.147053 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:29.147023 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-926pk" Jun 12 20:14:30.102180 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:30.102148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:14:30.102475 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:30.102452 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:14:30.111235 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:30.111205 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:14:30.111678 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:30.111664 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:14:30.114571 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:30.114551 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 20:14:32.473522 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:32.473490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8e63956-3421-42e3-aa17-1977beeccf40/init-config-reloader/0.log" Jun 12 20:14:32.673666 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:32.673637 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8e63956-3421-42e3-aa17-1977beeccf40/alertmanager/0.log" Jun 12 20:14:32.873124 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:32.873091 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8e63956-3421-42e3-aa17-1977beeccf40/config-reloader/0.log" Jun 12 20:14:33.073183 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:33.073150 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8e63956-3421-42e3-aa17-1977beeccf40/kube-rbac-proxy-web/0.log" Jun 12 20:14:33.274044 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:33.273973 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8e63956-3421-42e3-aa17-1977beeccf40/kube-rbac-proxy/0.log" Jun 12 20:14:33.473642 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:33.473615 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8e63956-3421-42e3-aa17-1977beeccf40/kube-rbac-proxy-metric/0.log" Jun 12 20:14:33.673176 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:33.673151 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8e63956-3421-42e3-aa17-1977beeccf40/prom-label-proxy/0.log" Jun 12 20:14:33.875684 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:33.875651 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-q5fcb_755a0d15-7a20-48ab-9a45-806c3e3f5249/cluster-monitoring-operator/0.log" Jun 12 20:14:36.124166 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:36.124130 2578 patch_prober.go:28] interesting pod/image-registry-579654b649-nh9mp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 20:14:36.124524 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:36.124183 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-579654b649-nh9mp" podUID="743f04db-f64f-43f0-97d9-6c2b8fa82b59" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 20:14:36.273639 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:36.273610 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lhs9q_cd69d700-ec30-40f8-b865-5ba80feecbf1/init-textfile/0.log" Jun 12 20:14:36.473983 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:36.473908 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lhs9q_cd69d700-ec30-40f8-b865-5ba80feecbf1/node-exporter/0.log" Jun 12 20:14:36.673960 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:36.673925 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lhs9q_cd69d700-ec30-40f8-b865-5ba80feecbf1/kube-rbac-proxy/0.log" Jun 12 20:14:37.142081 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:37.142045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:37.218161 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:37.218126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:38.139821 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:38.139793 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:14:38.264302 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:38.264267 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:38.362527 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:38.362479 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:38.421963 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:38.421867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:38.476097 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:38.476069 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:39.273418 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:39.273374 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-2s4j6_419b3646-32a9-45c8-956b-a37898211d10/prometheus-operator-admission-webhook/0.log" Jun 12 20:14:39.474243 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:39.474213 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/thanos-query/0.log" Jun 12 20:14:39.673957 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:39.673928 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/kube-rbac-proxy-web/0.log" Jun 12 20:14:39.874209 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:39.874180 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/kube-rbac-proxy/0.log" Jun 12 20:14:40.073748 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:40.073722 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/prom-label-proxy/0.log" Jun 12 20:14:40.275145 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:40.275111 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/kube-rbac-proxy-rules/0.log" Jun 12 20:14:40.474553 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:40.474483 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/kube-rbac-proxy-metrics/0.log" Jun 12 20:14:40.673399 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:40.673366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-55qkf_93e94b98-02b4-40a6-8f99-7fbea15426d3/networking-console-plugin/0.log" Jun 12 20:14:40.875540 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:40.875516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:14:41.074562 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:41.074535 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/2.log" Jun 12 20:14:41.606687 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:41.606658 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:41.701958 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:41.701909 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:41.803248 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:41.803210 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:41.875114 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:41.875042 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-l8gvn_bea2f805-a6ec-4145-8574-11261b03c8c3/download-server/0.log" Jun 12 20:14:42.473028 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:42.473004 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-926pk_a86c9aa6-de6b-4296-bb91-dee632048c30/dns/0.log" Jun 12 20:14:42.673266 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:42.673234 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-926pk_a86c9aa6-de6b-4296-bb91-dee632048c30/kube-rbac-proxy/0.log" Jun 12 20:14:43.261915 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:43.261883 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:43.273275 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:43.273256 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9zvlx_eefdd8b6-744f-417c-b929-430ad6eaeefb/dns-node-resolver/0.log" Jun 12 20:14:43.363178 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:43.363150 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:43.477542 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:43.477506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:43.576044 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:43.576009 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:43.872910 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:43.872833 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-579654b649-nh9mp_743f04db-f64f-43f0-97d9-6c2b8fa82b59/registry/0.log" Jun 12 20:14:44.049178 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:44.049130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:44.474692 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:44.474667 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ck9f_c0eadafd-3454-437e-ab4d-4fe2fb19e0f0/node-ca/0.log" Jun 12 20:14:45.073995 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:45.073964 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c794b8896-9ksmt_151621a4-fce8-4f46-8f41-9abc14e9a492/router/0.log" Jun 12 20:14:45.275104 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:45.275073 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6khsh_18259a15-c027-4dfc-8ad3-75f944b62ed2/serve-healthcheck-canary/0.log" Jun 12 20:14:46.250991 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:46.250958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:46.308882 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:46.308847 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:47.287806 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:47.287748 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:47.385280 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:47.385245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:49.521907 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:49.521867 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-579654b649-nh9mp"] Jun 12 20:14:49.615228 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:49.615198 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:49.717925 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:49.717830 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:49.816257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:49.816226 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:54.966882 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:54.966855 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:55.015331 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:55.015305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:14:56.282742 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:14:56.282701 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:04.441654 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:04.441618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:04.542656 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:04.542628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:07.486032 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:07.485991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:07.874426 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:07.874393 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:08.547453 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:08.547424 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 20:15:08.547837 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:08.547723 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="alertmanager" containerID="cri-o://3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14" gracePeriod=120 Jun 12 20:15:08.547837 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:08.547788 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy-metric" containerID="cri-o://9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd" gracePeriod=120 Jun 12 20:15:08.547950 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:08.547834 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy-web" containerID="cri-o://e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436" gracePeriod=120 Jun 12 20:15:08.547950 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:08.547853 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="config-reloader" containerID="cri-o://7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce" gracePeriod=120 Jun 12 20:15:08.547950 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:08.547891 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="prom-label-proxy" containerID="cri-o://4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc" gracePeriod=120 Jun 12 20:15:08.548079 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:08.547852 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy" containerID="cri-o://361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195" gracePeriod=120 Jun 12 20:15:09.356346 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.356309 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8e63956-3421-42e3-aa17-1977beeccf40" containerID="4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc" exitCode=0 Jun 12 20:15:09.356346 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.356338 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8e63956-3421-42e3-aa17-1977beeccf40" containerID="361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195" exitCode=0 Jun 12 20:15:09.356346 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.356345 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8e63956-3421-42e3-aa17-1977beeccf40" containerID="7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce" exitCode=0 Jun 12 20:15:09.356346 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.356350 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8e63956-3421-42e3-aa17-1977beeccf40" containerID="3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14" exitCode=0 Jun 12 20:15:09.356611 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.356379 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerDied","Data":"4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc"} Jun 12 20:15:09.356611 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.356441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerDied","Data":"361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195"} Jun 12 20:15:09.356611 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.356467 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerDied","Data":"7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce"} Jun 12 20:15:09.356611 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.356493 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerDied","Data":"3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14"} Jun 12 20:15:09.794342 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.794318 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:09.831135 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831108 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-web-config\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831303 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831150 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-main-tls\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831303 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831179 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-main-db\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831303 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831214 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-tls-assets\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831303 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831245 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-config-out\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831303 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831271 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-config-volume\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831315 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831345 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-trusted-ca-bundle\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831393 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831445 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-cluster-tls-config\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831494 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lpw9\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-kube-api-access-7lpw9\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831524 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-metrics-client-ca\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831873 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831562 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-web\") pod \"c8e63956-3421-42e3-aa17-1977beeccf40\" (UID: \"c8e63956-3421-42e3-aa17-1977beeccf40\") " Jun 12 20:15:09.831931 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.831862 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:15:09.832937 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.832901 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:09.833337 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.833309 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:09.834686 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.834626 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:09.835160 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.835120 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:09.835706 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.835667 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-kube-api-access-7lpw9" (OuterVolumeSpecName: "kube-api-access-7lpw9") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "kube-api-access-7lpw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:15:09.836112 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.836089 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:09.836496 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.836460 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:15:09.836582 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.836493 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-config-out" (OuterVolumeSpecName: "config-out") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:15:09.836645 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.836581 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-config-volume" (OuterVolumeSpecName: "config-volume") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:09.837101 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.837066 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:09.840448 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.840412 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:09.848878 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.848853 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-web-config" (OuterVolumeSpecName: "web-config") pod "c8e63956-3421-42e3-aa17-1977beeccf40" (UID: "c8e63956-3421-42e3-aa17-1977beeccf40"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:09.932746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932669 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.932746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932693 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.932746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932705 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.932746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932714 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-cluster-tls-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.932746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932723 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lpw9\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-kube-api-access-7lpw9\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.932746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932731 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e63956-3421-42e3-aa17-1977beeccf40-metrics-client-ca\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.932746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932739 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.932746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932748 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-web-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.933103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932779 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-secret-alertmanager-main-tls\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.933103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932791 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-alertmanager-main-db\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.933103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932803 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8e63956-3421-42e3-aa17-1977beeccf40-tls-assets\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.933103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932816 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8e63956-3421-42e3-aa17-1977beeccf40-config-out\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.933103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:09.932827 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8e63956-3421-42e3-aa17-1977beeccf40-config-volume\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:10.364016 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.363985 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8e63956-3421-42e3-aa17-1977beeccf40" containerID="9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd" exitCode=0 Jun 12 20:15:10.364016 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.364010 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8e63956-3421-42e3-aa17-1977beeccf40" containerID="e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436" exitCode=0 Jun 12 20:15:10.364279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.364080 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.364279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.364083 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerDied","Data":"9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd"} Jun 12 20:15:10.364279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.364152 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerDied","Data":"e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436"} Jun 12 20:15:10.364279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.364179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8e63956-3421-42e3-aa17-1977beeccf40","Type":"ContainerDied","Data":"b5d94201a3e8a26667f5c65a0f563e88eb6b08de28472af38f409b8755d8049e"} Jun 12 20:15:10.364279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.364209 2578 scope.go:117] "RemoveContainer" containerID="4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc" Jun 12 20:15:10.372048 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.372035 2578 scope.go:117] "RemoveContainer" containerID="9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd" Jun 12 20:15:10.379209 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.379190 2578 scope.go:117] "RemoveContainer" containerID="361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195" Jun 12 20:15:10.385297 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.385274 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 20:15:10.386936 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.386921 2578 scope.go:117] "RemoveContainer" containerID="e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436" Jun 12 20:15:10.391802 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.391781 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 20:15:10.394150 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.394134 2578 scope.go:117] "RemoveContainer" containerID="7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce" Jun 12 20:15:10.401042 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.401021 2578 scope.go:117] "RemoveContainer" containerID="3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14" Jun 12 20:15:10.407999 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.407974 2578 scope.go:117] "RemoveContainer" containerID="e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8" Jun 12 20:15:10.415013 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.414997 2578 scope.go:117] "RemoveContainer" containerID="4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc" Jun 12 20:15:10.415291 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:15:10.415264 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc\": container with ID starting with 4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc not found: ID does not exist" containerID="4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc" Jun 12 20:15:10.415338 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.415299 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc"} err="failed to get container status \"4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc\": rpc error: code = NotFound desc = could not find container \"4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc\": container with ID starting with 4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc not found: ID does not exist" Jun 12 20:15:10.415338 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.415328 2578 scope.go:117] "RemoveContainer" containerID="9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd" Jun 12 20:15:10.415618 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:15:10.415594 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd\": container with ID starting with 9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd not found: ID does not exist" containerID="9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd" Jun 12 20:15:10.415793 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.415748 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd"} err="failed to get container status \"9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd\": rpc error: code = NotFound desc = could not find container \"9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd\": container with ID starting with 9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd not found: ID does not exist" Jun 12 20:15:10.415793 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.415792 2578 scope.go:117] "RemoveContainer" containerID="361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195" Jun 12 20:15:10.416384 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:15:10.416360 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195\": container with ID starting with 361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195 not found: ID does not exist" containerID="361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195" Jun 12 20:15:10.416470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.416389 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195"} err="failed to get container status \"361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195\": rpc error: code = NotFound desc = could not find container \"361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195\": container with ID starting with 361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195 not found: ID does not exist" Jun 12 20:15:10.416470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.416405 2578 scope.go:117] "RemoveContainer" containerID="e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436" Jun 12 20:15:10.416727 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:15:10.416705 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436\": container with ID starting with e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436 not found: ID does not exist" containerID="e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436" Jun 12 20:15:10.416894 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.416869 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436"} err="failed to get container status \"e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436\": rpc error: code = NotFound desc = could not find container \"e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436\": container with ID starting with e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436 not found: ID does not exist" Jun 12 20:15:10.416894 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.416896 2578 scope.go:117] "RemoveContainer" containerID="7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce" Jun 12 20:15:10.417205 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:15:10.417185 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce\": container with ID starting with 7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce not found: ID does not exist" containerID="7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce" Jun 12 20:15:10.417277 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.417213 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce"} err="failed to get container status \"7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce\": rpc error: code = NotFound desc = could not find container \"7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce\": container with ID starting with 7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce not found: ID does not exist" Jun 12 20:15:10.417277 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.417235 2578 scope.go:117] "RemoveContainer" containerID="3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14" Jun 12 20:15:10.417517 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:15:10.417501 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14\": container with ID starting with 3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14 not found: ID does not exist" containerID="3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14" Jun 12 20:15:10.417594 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.417524 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14"} err="failed to get container status \"3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14\": rpc error: code = NotFound desc = could not find container \"3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14\": container with ID starting with 3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14 not found: ID does not exist" Jun 12 20:15:10.417594 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.417544 2578 scope.go:117] "RemoveContainer" containerID="e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8" Jun 12 20:15:10.417838 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:15:10.417798 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8\": container with ID starting with e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8 not found: ID does not exist" containerID="e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8" Jun 12 20:15:10.417838 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.417820 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8"} err="failed to get container status \"e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8\": rpc error: code = NotFound desc = could not find container \"e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8\": container with ID starting with e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8 not found: ID does not exist" Jun 12 20:15:10.417838 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.417835 2578 scope.go:117] "RemoveContainer" containerID="4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc" Jun 12 20:15:10.417988 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.417907 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 20:15:10.418063 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418044 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc"} err="failed to get container status \"4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc\": rpc error: code = NotFound desc = could not find container \"4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc\": container with ID starting with 4834897f8d7fe315ea39d94c0ee55b5e5a0de5724232ba7bf46a1a2f377444cc not found: ID does not exist" Jun 12 20:15:10.418119 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418066 2578 scope.go:117] "RemoveContainer" containerID="9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd" Jun 12 20:15:10.418213 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418198 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy-web" Jun 12 20:15:10.418260 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418218 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy-web" Jun 12 20:15:10.418260 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418229 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="prom-label-proxy" Jun 12 20:15:10.418260 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418235 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="prom-label-proxy" Jun 12 20:15:10.418260 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418248 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="alertmanager" Jun 12 20:15:10.418260 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418254 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="alertmanager" Jun 12 20:15:10.418260 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418261 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy-metric" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418268 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy-metric" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418276 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="init-config-reloader" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418281 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="init-config-reloader" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418287 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="config-reloader" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418292 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="config-reloader" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418302 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418307 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418254 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd"} err="failed to get container status \"9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd\": rpc error: code = NotFound desc = could not find container \"9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd\": container with ID starting with 9406fa810425f258659e0f8e0a19592980b85b872e666093dc0d135558f650dd not found: ID does not exist" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418339 2578 scope.go:117] "RemoveContainer" containerID="361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418354 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy-web" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418362 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy-metric" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418368 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="kube-rbac-proxy" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418375 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="prom-label-proxy" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418381 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="alertmanager" Jun 12 20:15:10.418474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418386 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" containerName="config-reloader" Jun 12 20:15:10.418966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418513 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195"} err="failed to get container status \"361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195\": rpc error: code = NotFound desc = could not find container \"361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195\": container with ID starting with 361da1499b9c74a13109631bbac4e04f8c95cf076ce81f39d202a557282f0195 not found: ID does not exist" Jun 12 20:15:10.418966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418527 2578 scope.go:117] "RemoveContainer" containerID="e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436" Jun 12 20:15:10.418966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418737 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436"} err="failed to get container status \"e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436\": rpc error: code = NotFound desc = could not find container \"e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436\": container with ID starting with e0b5d4e58510108dc30c5b3a61e45e7aec7999db720d35732e44fb8bf726a436 not found: ID does not exist" Jun 12 20:15:10.418966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418750 2578 scope.go:117] "RemoveContainer" containerID="7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce" Jun 12 20:15:10.419103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418970 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce"} err="failed to get container status \"7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce\": rpc error: code = NotFound desc = could not find container \"7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce\": container with ID starting with 7e0e334cb8da2345650fdb682f359c976ef736e84f2e3c5285e4fb1a7aabf8ce not found: ID does not exist" Jun 12 20:15:10.419103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.418988 2578 scope.go:117] "RemoveContainer" containerID="3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14" Jun 12 20:15:10.419198 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.419182 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14"} err="failed to get container status \"3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14\": rpc error: code = NotFound desc = could not find container \"3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14\": container with ID starting with 3f03f9c30fb0d4790802ae0ed89be4051aacfa7ba431a041e268d022109d8f14 not found: ID does not exist" Jun 12 20:15:10.419245 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.419199 2578 scope.go:117] "RemoveContainer" containerID="e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8" Jun 12 20:15:10.419394 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.419377 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8"} err="failed to get container status \"e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8\": rpc error: code = NotFound desc = could not find container \"e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8\": container with ID starting with e33875caddfd4aba8921edd0517a4e0ceb3181966946bca4d96d60ffc19c43a8 not found: ID does not exist" Jun 12 20:15:10.421593 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.421578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.423966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.423948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 20:15:10.424066 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.423970 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 20:15:10.424066 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.423996 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 20:15:10.424275 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.424244 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 20:15:10.424324 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.424273 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 20:15:10.424324 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.424277 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 20:15:10.424615 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.424602 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kzgvv\"" Jun 12 20:15:10.424692 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.424679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 20:15:10.425072 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.425057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 20:15:10.429835 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.429818 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 20:15:10.434325 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.434306 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 20:15:10.437968 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.437948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xcm7\" (UniqueName: \"kubernetes.io/projected/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-kube-api-access-2xcm7\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438060 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.437992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438060 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438142 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438142 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-web-config\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438222 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438222 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438222 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438215 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438310 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438310 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438310 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-config-out\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438397 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.438397 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.438370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.538763 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xcm7\" (UniqueName: \"kubernetes.io/projected/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-kube-api-access-2xcm7\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.538935 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.538935 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.538935 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.538935 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-web-config\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.538935 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.538935 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.538935 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.539290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.539290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.538975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.539290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.539000 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-config-out\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.539290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.539027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.539290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.539052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.539586 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.539321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.540041 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.540013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.540207 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.540117 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.542282 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.542208 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.542282 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.542224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.542454 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.542418 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.542454 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.542422 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.542564 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.542478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.542564 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.542490 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-web-config\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.542672 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.542637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-config-out\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.542884 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.542863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.544239 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.544221 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.546303 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.546287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xcm7\" (UniqueName: \"kubernetes.io/projected/dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e-kube-api-access-2xcm7\") pod \"alertmanager-main-0\" (UID: \"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.731029 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.730944 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 20:15:10.872927 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:10.872897 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 20:15:10.875315 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:15:10.875284 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd42dfa1_e12a_4cdc_b03e_bfb00d0b180e.slice/crio-0f29318cc9dc090b39e57679ced0a42883195e1ad72d6f879fd9bf8f20d740ac WatchSource:0}: Error finding container 0f29318cc9dc090b39e57679ced0a42883195e1ad72d6f879fd9bf8f20d740ac: Status 404 returned error can't find the container with id 0f29318cc9dc090b39e57679ced0a42883195e1ad72d6f879fd9bf8f20d740ac Jun 12 20:15:11.370123 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:11.370084 2578 generic.go:356] "Generic (PLEG): container finished" podID="dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e" containerID="4cf68046c6b5669c21c4440dec38bd4c6a5ee6ff66fcb587f28d6fb47e530cc0" exitCode=0 Jun 12 20:15:11.370297 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:11.370170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e","Type":"ContainerDied","Data":"4cf68046c6b5669c21c4440dec38bd4c6a5ee6ff66fcb587f28d6fb47e530cc0"} Jun 12 20:15:11.370297 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:11.370231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e","Type":"ContainerStarted","Data":"0f29318cc9dc090b39e57679ced0a42883195e1ad72d6f879fd9bf8f20d740ac"} Jun 12 20:15:12.168228 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.168199 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8e63956-3421-42e3-aa17-1977beeccf40" path="/var/lib/kubelet/pods/c8e63956-3421-42e3-aa17-1977beeccf40/volumes" Jun 12 20:15:12.377889 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.377854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e","Type":"ContainerStarted","Data":"cf7781fb6a74a1ecf07c16883acc7b85bdf9cc2f8b864986af876c4292636f6a"} Jun 12 20:15:12.378049 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.377918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e","Type":"ContainerStarted","Data":"d7f0706ad27ac27d637404774e2db665157f37d5f7f7f7f71d1d74831428b38f"} Jun 12 20:15:12.378049 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.377945 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e","Type":"ContainerStarted","Data":"94611ba44bb5f21bf31d326038856d1d4b69ceea615a4a2620c1d1c1b04d0006"} Jun 12 20:15:12.378049 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.377970 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e","Type":"ContainerStarted","Data":"2d25d19c1cb224227b7a3f101c02426211440d75a436b2c36b6ece613ae74334"} Jun 12 20:15:12.378049 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.377995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e","Type":"ContainerStarted","Data":"445b6417076193b846b89d3163a4a9a3bea51b02ac46106384741356a3f0583e"} Jun 12 20:15:12.378049 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.378018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e","Type":"ContainerStarted","Data":"3fe501391e5a754232803e62ad2fb5a1da2c21f5c375937b5d2026a81b53b505"} Jun 12 20:15:12.403208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.403157 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.386614773 podStartE2EDuration="2.403144678s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.529905ms" isStatefulPod=false podCreationTimestamp="2026-06-12 20:15:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:15:12.401932103 +0000 UTC m=+342.689438865" watchObservedRunningTime="2026-06-12 20:15:12.403144678 +0000 UTC m=+342.690651439" Jun 12 20:15:12.565141 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.565106 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d68c985f7-jbr7k"] Jun 12 20:15:12.568842 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.568825 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.571237 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.571214 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 20:15:12.571499 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.571475 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 20:15:12.571631 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.571612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qwnxw\"" Jun 12 20:15:12.571721 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.571697 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 20:15:12.571785 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.571740 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 20:15:12.571869 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.571854 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 20:15:12.576448 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.576428 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 20:15:12.582444 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.582423 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d68c985f7-jbr7k"] Jun 12 20:15:12.657118 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.657077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-federate-client-tls\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.657312 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.657133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp6vm\" (UniqueName: \"kubernetes.io/projected/5205dbbd-abf3-4a03-b23d-993a3f845d31-kube-api-access-hp6vm\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.657312 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.657201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.657312 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.657232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-telemeter-client-tls\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.657312 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.657270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-secret-telemeter-client\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.657312 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.657291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5205dbbd-abf3-4a03-b23d-993a3f845d31-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.657574 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.657328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5205dbbd-abf3-4a03-b23d-993a3f845d31-serving-certs-ca-bundle\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.657574 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.657356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5205dbbd-abf3-4a03-b23d-993a3f845d31-metrics-client-ca\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.758491 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.758436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.758491 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.758494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-telemeter-client-tls\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.758751 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.758525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-secret-telemeter-client\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.758751 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.758542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5205dbbd-abf3-4a03-b23d-993a3f845d31-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.758751 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.758562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5205dbbd-abf3-4a03-b23d-993a3f845d31-serving-certs-ca-bundle\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.758751 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.758581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5205dbbd-abf3-4a03-b23d-993a3f845d31-metrics-client-ca\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.758751 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.758605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-federate-client-tls\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.758751 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.758637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp6vm\" (UniqueName: \"kubernetes.io/projected/5205dbbd-abf3-4a03-b23d-993a3f845d31-kube-api-access-hp6vm\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.759524 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.759497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5205dbbd-abf3-4a03-b23d-993a3f845d31-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.759626 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.759497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5205dbbd-abf3-4a03-b23d-993a3f845d31-metrics-client-ca\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.759840 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.759817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5205dbbd-abf3-4a03-b23d-993a3f845d31-serving-certs-ca-bundle\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.761348 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.761325 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.761454 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.761361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-secret-telemeter-client\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.761704 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.761682 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-federate-client-tls\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.761704 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.761697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5205dbbd-abf3-4a03-b23d-993a3f845d31-telemeter-client-tls\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.766156 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.766132 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp6vm\" (UniqueName: \"kubernetes.io/projected/5205dbbd-abf3-4a03-b23d-993a3f845d31-kube-api-access-hp6vm\") pod \"telemeter-client-d68c985f7-jbr7k\" (UID: \"5205dbbd-abf3-4a03-b23d-993a3f845d31\") " pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:12.879195 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:12.879114 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" Jun 12 20:15:13.013434 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:13.013409 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d68c985f7-jbr7k"] Jun 12 20:15:13.015645 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:15:13.015604 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5205dbbd_abf3_4a03_b23d_993a3f845d31.slice/crio-65a9743fae901702b746fc6d9085fe97f0a9bd6b2b13b23b508bf97a3d7c76dc WatchSource:0}: Error finding container 65a9743fae901702b746fc6d9085fe97f0a9bd6b2b13b23b508bf97a3d7c76dc: Status 404 returned error can't find the container with id 65a9743fae901702b746fc6d9085fe97f0a9bd6b2b13b23b508bf97a3d7c76dc Jun 12 20:15:13.017654 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:13.017638 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 20:15:13.383305 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:13.383268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" event={"ID":"5205dbbd-abf3-4a03-b23d-993a3f845d31","Type":"ContainerStarted","Data":"65a9743fae901702b746fc6d9085fe97f0a9bd6b2b13b23b508bf97a3d7c76dc"} Jun 12 20:15:14.545903 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.545859 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-579654b649-nh9mp" podUID="743f04db-f64f-43f0-97d9-6c2b8fa82b59" containerName="registry" containerID="cri-o://71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8" gracePeriod=30 Jun 12 20:15:14.806490 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.806433 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:15:14.874799 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.874745 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") pod \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " Jun 12 20:15:14.874974 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.874809 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-certificates\") pod \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " Jun 12 20:15:14.874974 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.874836 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-bound-sa-token\") pod \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " Jun 12 20:15:14.874974 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.874868 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-image-registry-private-configuration\") pod \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " Jun 12 20:15:14.874974 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.874901 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr8bz\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-kube-api-access-kr8bz\") pod \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " Jun 12 20:15:14.874974 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.874944 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/743f04db-f64f-43f0-97d9-6c2b8fa82b59-ca-trust-extracted\") pod \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " Jun 12 20:15:14.875229 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.875003 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-installation-pull-secrets\") pod \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " Jun 12 20:15:14.875229 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.875037 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-trusted-ca\") pod \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\" (UID: \"743f04db-f64f-43f0-97d9-6c2b8fa82b59\") " Jun 12 20:15:14.875340 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.875259 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "743f04db-f64f-43f0-97d9-6c2b8fa82b59" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:14.875810 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.875783 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "743f04db-f64f-43f0-97d9-6c2b8fa82b59" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:14.877560 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.877514 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "743f04db-f64f-43f0-97d9-6c2b8fa82b59" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:15:14.877695 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.877576 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "743f04db-f64f-43f0-97d9-6c2b8fa82b59" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:15:14.877913 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.877884 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "743f04db-f64f-43f0-97d9-6c2b8fa82b59" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:14.878006 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.877968 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "743f04db-f64f-43f0-97d9-6c2b8fa82b59" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:14.878499 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.878475 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-kube-api-access-kr8bz" (OuterVolumeSpecName: "kube-api-access-kr8bz") pod "743f04db-f64f-43f0-97d9-6c2b8fa82b59" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59"). InnerVolumeSpecName "kube-api-access-kr8bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:15:14.886970 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.886944 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/743f04db-f64f-43f0-97d9-6c2b8fa82b59-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "743f04db-f64f-43f0-97d9-6c2b8fa82b59" (UID: "743f04db-f64f-43f0-97d9-6c2b8fa82b59"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:15:14.975989 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.975953 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-installation-pull-secrets\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:14.975989 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.975982 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-trusted-ca\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:14.975989 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.975991 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-tls\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:14.976206 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.976000 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/743f04db-f64f-43f0-97d9-6c2b8fa82b59-registry-certificates\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:14.976206 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.976009 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-bound-sa-token\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:14.976206 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.976017 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/743f04db-f64f-43f0-97d9-6c2b8fa82b59-image-registry-private-configuration\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:14.976206 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.976028 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr8bz\" (UniqueName: \"kubernetes.io/projected/743f04db-f64f-43f0-97d9-6c2b8fa82b59-kube-api-access-kr8bz\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:14.976206 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:14.976036 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/743f04db-f64f-43f0-97d9-6c2b8fa82b59-ca-trust-extracted\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:15:15.393279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:15.393246 2578 generic.go:356] "Generic (PLEG): container finished" podID="743f04db-f64f-43f0-97d9-6c2b8fa82b59" containerID="71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8" exitCode=0 Jun 12 20:15:15.393470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:15.393300 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579654b649-nh9mp" Jun 12 20:15:15.393470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:15.393313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579654b649-nh9mp" event={"ID":"743f04db-f64f-43f0-97d9-6c2b8fa82b59","Type":"ContainerDied","Data":"71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8"} Jun 12 20:15:15.393470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:15.393367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579654b649-nh9mp" event={"ID":"743f04db-f64f-43f0-97d9-6c2b8fa82b59","Type":"ContainerDied","Data":"fce781fe4b58dfc5becbf0b2b58ab0d44cadf79b6bcbc0e1f332030af98acdbc"} Jun 12 20:15:15.393470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:15.393399 2578 scope.go:117] "RemoveContainer" containerID="71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8" Jun 12 20:15:15.415898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:15.415868 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-579654b649-nh9mp"] Jun 12 20:15:15.422064 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:15.422038 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-579654b649-nh9mp"] Jun 12 20:15:15.506440 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:15.506415 2578 scope.go:117] "RemoveContainer" containerID="71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8" Jun 12 20:15:15.506780 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:15:15.506741 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8\": container with ID starting with 71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8 not found: ID does not exist" containerID="71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8" Jun 12 20:15:15.506855 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:15.506791 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8"} err="failed to get container status \"71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8\": rpc error: code = NotFound desc = could not find container \"71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8\": container with ID starting with 71e55fc172ab89391c81197b5e259ca0625547618d89d7cd39a2c30af5a147e8 not found: ID does not exist" Jun 12 20:15:16.172346 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:16.172309 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="743f04db-f64f-43f0-97d9-6c2b8fa82b59" path="/var/lib/kubelet/pods/743f04db-f64f-43f0-97d9-6c2b8fa82b59/volumes" Jun 12 20:15:16.399773 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:16.399705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" event={"ID":"5205dbbd-abf3-4a03-b23d-993a3f845d31","Type":"ContainerStarted","Data":"a0f7ee8ecbb788f7d23b0d98c3b2fcd923245d358352d8c1cc9920b52e18316f"} Jun 12 20:15:16.399966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:16.399815 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" event={"ID":"5205dbbd-abf3-4a03-b23d-993a3f845d31","Type":"ContainerStarted","Data":"8dea728026895294a66d8dab9d4af7b29a0562cf78d7173b17722ea684f25910"} Jun 12 20:15:16.399966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:16.399843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" event={"ID":"5205dbbd-abf3-4a03-b23d-993a3f845d31","Type":"ContainerStarted","Data":"9487fbfac5da9a213573e768203613d7e54e6920296701208587ed94f0c147d5"} Jun 12 20:15:16.422236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:16.422188 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d68c985f7-jbr7k" podStartSLOduration=1.885632854 podStartE2EDuration="4.42217431s" totalImagesPullingTime="2.536541456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:15:16.420202547 +0000 UTC m=+346.707709309" watchObservedRunningTime="2026-06-12 20:15:16.42217431 +0000 UTC m=+346.709681079" Jun 12 20:15:17.179738 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:17.179707 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:17.239158 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:17.239123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:17.294703 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:17.294671 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:17.885894 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:17.885817 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:17.938258 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:17.938228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:23.332274 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:23.332222 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:28.006475 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:28.006443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:28.062083 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:28.062038 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:28.111636 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:28.111604 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:15:53.557609 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:15:53.557569 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:16:00.408545 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:16:00.408509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:16:22.715187 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:16:22.715149 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:16:22.767079 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:16:22.767051 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:16:34.591885 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:16:34.591847 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:16:34.642188 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:16:34.642157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:16:49.450823 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:16:49.450730 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:16:49.549853 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:16:49.549796 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:22.180943 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:22.180909 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:22.234623 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:22.234591 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:29.137317 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.137273 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:29.237155 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.237118 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:29.746140 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.746105 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4"] Jun 12 20:17:29.746434 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.746420 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="743f04db-f64f-43f0-97d9-6c2b8fa82b59" containerName="registry" Jun 12 20:17:29.746434 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.746434 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="743f04db-f64f-43f0-97d9-6c2b8fa82b59" containerName="registry" Jun 12 20:17:29.746522 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.746487 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="743f04db-f64f-43f0-97d9-6c2b8fa82b59" containerName="registry" Jun 12 20:17:29.749594 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.749569 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:29.752073 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.752055 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 20:17:29.752181 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.752126 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 20:17:29.752181 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.752146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqvqx\"" Jun 12 20:17:29.757891 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.757866 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4"] Jun 12 20:17:29.916053 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.916023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:29.916208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.916072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4jsx\" (UniqueName: \"kubernetes.io/projected/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-kube-api-access-x4jsx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:29.916208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:29.916126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:30.017298 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:30.017190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:30.017298 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:30.017260 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4jsx\" (UniqueName: \"kubernetes.io/projected/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-kube-api-access-x4jsx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:30.017298 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:30.017283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:30.017593 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:30.017575 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:30.017692 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:30.017599 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:30.025367 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:30.025326 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4jsx\" (UniqueName: \"kubernetes.io/projected/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-kube-api-access-x4jsx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:30.060115 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:30.060085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:30.194440 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:30.194411 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4"] Jun 12 20:17:30.196509 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:17:30.196472 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7d9d3f_203a_4822_88e5_f6bc4da768b4.slice/crio-7867952665e90dd64f708fd29383b5930ab014dc5497d76e3c5dd305a29558e9 WatchSource:0}: Error finding container 7867952665e90dd64f708fd29383b5930ab014dc5497d76e3c5dd305a29558e9: Status 404 returned error can't find the container with id 7867952665e90dd64f708fd29383b5930ab014dc5497d76e3c5dd305a29558e9 Jun 12 20:17:30.936693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:30.936648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" event={"ID":"4e7d9d3f-203a-4822-88e5-f6bc4da768b4","Type":"ContainerStarted","Data":"7867952665e90dd64f708fd29383b5930ab014dc5497d76e3c5dd305a29558e9"} Jun 12 20:17:33.475742 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:33.475711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:33.531956 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:33.531924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:33.588377 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:33.588343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:38.979134 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:38.979093 2578 generic.go:356] "Generic (PLEG): container finished" podID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerID="ee741d7134820cdaa691cdb8d83ca481b8e0e32df0dd52c16849cf7f0cdeb8b6" exitCode=0 Jun 12 20:17:38.979535 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:38.979183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" event={"ID":"4e7d9d3f-203a-4822-88e5-f6bc4da768b4","Type":"ContainerDied","Data":"ee741d7134820cdaa691cdb8d83ca481b8e0e32df0dd52c16849cf7f0cdeb8b6"} Jun 12 20:17:41.994535 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:41.994498 2578 generic.go:356] "Generic (PLEG): container finished" podID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerID="ab5b47de99207ccbfa8327e4133e381a58bfe04706ea753ffc7071f4a26d97a7" exitCode=0 Jun 12 20:17:41.994535 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:41.994537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" event={"ID":"4e7d9d3f-203a-4822-88e5-f6bc4da768b4","Type":"ContainerDied","Data":"ab5b47de99207ccbfa8327e4133e381a58bfe04706ea753ffc7071f4a26d97a7"} Jun 12 20:17:50.032602 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:50.032563 2578 generic.go:356] "Generic (PLEG): container finished" podID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerID="4232fb94ea97c6515c452bfa139be8f567af85d925d226394174cede64b7b4c8" exitCode=0 Jun 12 20:17:50.032971 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:50.032653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" event={"ID":"4e7d9d3f-203a-4822-88e5-f6bc4da768b4","Type":"ContainerDied","Data":"4232fb94ea97c6515c452bfa139be8f567af85d925d226394174cede64b7b4c8"} Jun 12 20:17:51.219526 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.219496 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:51.280824 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.280789 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4jsx\" (UniqueName: \"kubernetes.io/projected/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-kube-api-access-x4jsx\") pod \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " Jun 12 20:17:51.281004 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.280839 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-bundle\") pod \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " Jun 12 20:17:51.281557 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.281526 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-bundle" (OuterVolumeSpecName: "bundle") pod "4e7d9d3f-203a-4822-88e5-f6bc4da768b4" (UID: "4e7d9d3f-203a-4822-88e5-f6bc4da768b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:17:51.283103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.283079 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-kube-api-access-x4jsx" (OuterVolumeSpecName: "kube-api-access-x4jsx") pod "4e7d9d3f-203a-4822-88e5-f6bc4da768b4" (UID: "4e7d9d3f-203a-4822-88e5-f6bc4da768b4"). InnerVolumeSpecName "kube-api-access-x4jsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:17:51.381639 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.381604 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-util\") pod \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\" (UID: \"4e7d9d3f-203a-4822-88e5-f6bc4da768b4\") " Jun 12 20:17:51.381849 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.381826 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4jsx\" (UniqueName: \"kubernetes.io/projected/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-kube-api-access-x4jsx\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:17:51.381849 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.381844 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:17:51.385589 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.385564 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-util" (OuterVolumeSpecName: "util") pod "4e7d9d3f-203a-4822-88e5-f6bc4da768b4" (UID: "4e7d9d3f-203a-4822-88e5-f6bc4da768b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:17:51.482187 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:51.482153 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e7d9d3f-203a-4822-88e5-f6bc4da768b4-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:17:52.043553 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:52.043518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" event={"ID":"4e7d9d3f-203a-4822-88e5-f6bc4da768b4","Type":"ContainerDied","Data":"7867952665e90dd64f708fd29383b5930ab014dc5497d76e3c5dd305a29558e9"} Jun 12 20:17:52.043553 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:52.043544 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fkn4" Jun 12 20:17:52.043824 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:52.043570 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7867952665e90dd64f708fd29383b5930ab014dc5497d76e3c5dd305a29558e9" Jun 12 20:17:55.759410 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:55.759379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:56.551288 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:56.551257 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:59.351264 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:59.351231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:17:59.454412 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:17:59.454385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:01.287452 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:01.287416 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:01.382495 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:01.382461 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:01.589904 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:01.589870 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:01.710660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:01.710630 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:02.248506 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.248468 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q"] Jun 12 20:18:02.248803 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.248790 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerName="extract" Jun 12 20:18:02.248854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.248805 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerName="extract" Jun 12 20:18:02.248854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.248821 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerName="util" Jun 12 20:18:02.248854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.248826 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerName="util" Jun 12 20:18:02.248854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.248836 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerName="pull" Jun 12 20:18:02.248854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.248842 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerName="pull" Jun 12 20:18:02.249001 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.248915 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7d9d3f-203a-4822-88e5-f6bc4da768b4" containerName="extract" Jun 12 20:18:02.251106 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.251090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.253735 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.253699 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 20:18:02.254652 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.254638 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 20:18:02.254710 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.254644 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqvqx\"" Jun 12 20:18:02.261449 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.261423 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q"] Jun 12 20:18:02.261800 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.261782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.261902 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.261812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf5hl\" (UniqueName: \"kubernetes.io/projected/e7d3ac54-dd0e-45b8-932b-6d15d439de12-kube-api-access-kf5hl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.261902 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.261834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.362906 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.362863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.362906 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.362910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf5hl\" (UniqueName: \"kubernetes.io/projected/e7d3ac54-dd0e-45b8-932b-6d15d439de12-kube-api-access-kf5hl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.363438 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.363028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.363438 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.363361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.363438 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.363362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.371244 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.371219 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf5hl\" (UniqueName: \"kubernetes.io/projected/e7d3ac54-dd0e-45b8-932b-6d15d439de12-kube-api-access-kf5hl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.560607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.560569 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:02.707533 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:02.707500 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q"] Jun 12 20:18:02.710736 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:18:02.710709 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d3ac54_dd0e_45b8_932b_6d15d439de12.slice/crio-3a1d8b88d0ee8c8387c486083b5ed3baf33356f91be399ee3fcc47d0f3f32212 WatchSource:0}: Error finding container 3a1d8b88d0ee8c8387c486083b5ed3baf33356f91be399ee3fcc47d0f3f32212: Status 404 returned error can't find the container with id 3a1d8b88d0ee8c8387c486083b5ed3baf33356f91be399ee3fcc47d0f3f32212 Jun 12 20:18:03.087825 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:03.087791 2578 generic.go:356] "Generic (PLEG): container finished" podID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerID="8361d6c993417b18db987d94e8f3a46979f1a204cc6d9ef267ce2bbfdf6d6148" exitCode=0 Jun 12 20:18:03.088011 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:03.087913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" event={"ID":"e7d3ac54-dd0e-45b8-932b-6d15d439de12","Type":"ContainerDied","Data":"8361d6c993417b18db987d94e8f3a46979f1a204cc6d9ef267ce2bbfdf6d6148"} Jun 12 20:18:03.088011 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:03.087963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" event={"ID":"e7d3ac54-dd0e-45b8-932b-6d15d439de12","Type":"ContainerStarted","Data":"3a1d8b88d0ee8c8387c486083b5ed3baf33356f91be399ee3fcc47d0f3f32212"} Jun 12 20:18:04.585350 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:04.585305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:05.098225 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.098194 2578 generic.go:356] "Generic (PLEG): container finished" podID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerID="ffbd1f335c0d02e754b1fb70cd17c59c5ee86bb1e8055bd7619ee90e1a4dd19b" exitCode=0 Jun 12 20:18:05.098366 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.098269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" event={"ID":"e7d3ac54-dd0e-45b8-932b-6d15d439de12","Type":"ContainerDied","Data":"ffbd1f335c0d02e754b1fb70cd17c59c5ee86bb1e8055bd7619ee90e1a4dd19b"} Jun 12 20:18:05.185830 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.185748 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:05.764479 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.764443 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl"] Jun 12 20:18:05.766794 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.766779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:05.769143 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.769122 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 20:18:05.770133 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.770104 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 20:18:05.770233 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.770117 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jw2f8\"" Jun 12 20:18:05.777676 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.777657 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl"] Jun 12 20:18:05.796731 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.796700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7k22\" (UniqueName: \"kubernetes.io/projected/6eac4332-05de-4334-a2b3-bead470989d3-kube-api-access-x7k22\") pod \"cert-manager-webhook-7dc76cbb94-k2rcl\" (UID: \"6eac4332-05de-4334-a2b3-bead470989d3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:05.796868 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.796769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6eac4332-05de-4334-a2b3-bead470989d3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-k2rcl\" (UID: \"6eac4332-05de-4334-a2b3-bead470989d3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:05.897655 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.897618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7k22\" (UniqueName: \"kubernetes.io/projected/6eac4332-05de-4334-a2b3-bead470989d3-kube-api-access-x7k22\") pod \"cert-manager-webhook-7dc76cbb94-k2rcl\" (UID: \"6eac4332-05de-4334-a2b3-bead470989d3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:05.897834 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.897683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6eac4332-05de-4334-a2b3-bead470989d3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-k2rcl\" (UID: \"6eac4332-05de-4334-a2b3-bead470989d3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:05.906912 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.906881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6eac4332-05de-4334-a2b3-bead470989d3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-k2rcl\" (UID: \"6eac4332-05de-4334-a2b3-bead470989d3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:05.906912 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:05.906896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7k22\" (UniqueName: \"kubernetes.io/projected/6eac4332-05de-4334-a2b3-bead470989d3-kube-api-access-x7k22\") pod \"cert-manager-webhook-7dc76cbb94-k2rcl\" (UID: \"6eac4332-05de-4334-a2b3-bead470989d3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:06.084015 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.083989 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:06.106874 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.106839 2578 generic.go:356] "Generic (PLEG): container finished" podID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerID="dfe68b99f3016b416913cda81726c0a80e06a4062cd7e51b8004e66e4131ff87" exitCode=0 Jun 12 20:18:06.106994 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.106937 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" event={"ID":"e7d3ac54-dd0e-45b8-932b-6d15d439de12","Type":"ContainerDied","Data":"dfe68b99f3016b416913cda81726c0a80e06a4062cd7e51b8004e66e4131ff87"} Jun 12 20:18:06.221371 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.221339 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl"] Jun 12 20:18:06.223788 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:18:06.223739 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6eac4332_05de_4334_a2b3_bead470989d3.slice/crio-3380968d11eeab06aef51ebb9b37fdf812353c0025effead3878341895394e82 WatchSource:0}: Error finding container 3380968d11eeab06aef51ebb9b37fdf812353c0025effead3878341895394e82: Status 404 returned error can't find the container with id 3380968d11eeab06aef51ebb9b37fdf812353c0025effead3878341895394e82 Jun 12 20:18:06.338401 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.338313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:06.437313 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.437277 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:06.464568 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.464535 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-5596m"] Jun 12 20:18:06.467944 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.467929 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" Jun 12 20:18:06.470142 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.470127 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nkwx6\"" Jun 12 20:18:06.478010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.477981 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-5596m"] Jun 12 20:18:06.503903 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.503876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79x26\" (UniqueName: \"kubernetes.io/projected/839eefa9-2ebc-4357-bb1d-c40d9744970d-kube-api-access-79x26\") pod \"cert-manager-cainjector-5d99449ffd-5596m\" (UID: \"839eefa9-2ebc-4357-bb1d-c40d9744970d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" Jun 12 20:18:06.504008 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.503938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/839eefa9-2ebc-4357-bb1d-c40d9744970d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-5596m\" (UID: \"839eefa9-2ebc-4357-bb1d-c40d9744970d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" Jun 12 20:18:06.604521 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.604419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/839eefa9-2ebc-4357-bb1d-c40d9744970d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-5596m\" (UID: \"839eefa9-2ebc-4357-bb1d-c40d9744970d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" Jun 12 20:18:06.604521 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.604507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x26\" (UniqueName: \"kubernetes.io/projected/839eefa9-2ebc-4357-bb1d-c40d9744970d-kube-api-access-79x26\") pod \"cert-manager-cainjector-5d99449ffd-5596m\" (UID: \"839eefa9-2ebc-4357-bb1d-c40d9744970d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" Jun 12 20:18:06.612818 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.612784 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/839eefa9-2ebc-4357-bb1d-c40d9744970d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-5596m\" (UID: \"839eefa9-2ebc-4357-bb1d-c40d9744970d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" Jun 12 20:18:06.612927 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.612876 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79x26\" (UniqueName: \"kubernetes.io/projected/839eefa9-2ebc-4357-bb1d-c40d9744970d-kube-api-access-79x26\") pod \"cert-manager-cainjector-5d99449ffd-5596m\" (UID: \"839eefa9-2ebc-4357-bb1d-c40d9744970d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" Jun 12 20:18:06.777209 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.777176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" Jun 12 20:18:06.906945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:06.906914 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-5596m"] Jun 12 20:18:06.910062 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:18:06.910035 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod839eefa9_2ebc_4357_bb1d_c40d9744970d.slice/crio-0dbffdea1ad9746f7341d4dfc7a12c20431a698cbc3ec404c6f84b4033a8cf77 WatchSource:0}: Error finding container 0dbffdea1ad9746f7341d4dfc7a12c20431a698cbc3ec404c6f84b4033a8cf77: Status 404 returned error can't find the container with id 0dbffdea1ad9746f7341d4dfc7a12c20431a698cbc3ec404c6f84b4033a8cf77 Jun 12 20:18:07.112656 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.112542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" event={"ID":"839eefa9-2ebc-4357-bb1d-c40d9744970d","Type":"ContainerStarted","Data":"0dbffdea1ad9746f7341d4dfc7a12c20431a698cbc3ec404c6f84b4033a8cf77"} Jun 12 20:18:07.113801 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.113777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" event={"ID":"6eac4332-05de-4334-a2b3-bead470989d3","Type":"ContainerStarted","Data":"3380968d11eeab06aef51ebb9b37fdf812353c0025effead3878341895394e82"} Jun 12 20:18:07.239904 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.239875 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:07.309271 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.309236 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-bundle\") pod \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " Jun 12 20:18:07.309457 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.309327 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf5hl\" (UniqueName: \"kubernetes.io/projected/e7d3ac54-dd0e-45b8-932b-6d15d439de12-kube-api-access-kf5hl\") pod \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " Jun 12 20:18:07.309457 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.309392 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-util\") pod \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\" (UID: \"e7d3ac54-dd0e-45b8-932b-6d15d439de12\") " Jun 12 20:18:07.309732 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.309709 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-bundle" (OuterVolumeSpecName: "bundle") pod "e7d3ac54-dd0e-45b8-932b-6d15d439de12" (UID: "e7d3ac54-dd0e-45b8-932b-6d15d439de12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:18:07.311536 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.311511 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d3ac54-dd0e-45b8-932b-6d15d439de12-kube-api-access-kf5hl" (OuterVolumeSpecName: "kube-api-access-kf5hl") pod "e7d3ac54-dd0e-45b8-932b-6d15d439de12" (UID: "e7d3ac54-dd0e-45b8-932b-6d15d439de12"). InnerVolumeSpecName "kube-api-access-kf5hl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:18:07.315228 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.315209 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-util" (OuterVolumeSpecName: "util") pod "e7d3ac54-dd0e-45b8-932b-6d15d439de12" (UID: "e7d3ac54-dd0e-45b8-932b-6d15d439de12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:18:07.411010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.410891 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf5hl\" (UniqueName: \"kubernetes.io/projected/e7d3ac54-dd0e-45b8-932b-6d15d439de12-kube-api-access-kf5hl\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:18:07.411010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.410922 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:18:07.411010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:07.410935 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7d3ac54-dd0e-45b8-932b-6d15d439de12-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:18:08.122026 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:08.121978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" event={"ID":"e7d3ac54-dd0e-45b8-932b-6d15d439de12","Type":"ContainerDied","Data":"3a1d8b88d0ee8c8387c486083b5ed3baf33356f91be399ee3fcc47d0f3f32212"} Jun 12 20:18:08.122026 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:08.122017 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff9h6q" Jun 12 20:18:08.122549 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:08.122038 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a1d8b88d0ee8c8387c486083b5ed3baf33356f91be399ee3fcc47d0f3f32212" Jun 12 20:18:09.923713 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:09.923679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:10.024616 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:10.024577 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:10.134232 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:10.134199 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" event={"ID":"839eefa9-2ebc-4357-bb1d-c40d9744970d","Type":"ContainerStarted","Data":"851b9980a76a1a4f01313b4511805a52ec9f2f18508fa11926957649e30aa94f"} Jun 12 20:18:10.135804 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:10.135777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" event={"ID":"6eac4332-05de-4334-a2b3-bead470989d3","Type":"ContainerStarted","Data":"74875482cb678504c660d26224aff1cba982762ae23c1c07b49f5d46f1b23c7d"} Jun 12 20:18:10.135932 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:10.135829 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:10.150345 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:10.150297 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5596m" podStartSLOduration=1.714546823 podStartE2EDuration="4.150282758s" totalImagesPullingTime="2.435735935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:18:10.149731385 +0000 UTC m=+520.437238151" watchObservedRunningTime="2026-06-12 20:18:10.150282758 +0000 UTC m=+520.437789519" Jun 12 20:18:10.167634 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:10.167570 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" podStartSLOduration=2.052188779 podStartE2EDuration="5.167550731s" totalImagesPullingTime="3.115361952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:18:10.165265596 +0000 UTC m=+520.452772358" watchObservedRunningTime="2026-06-12 20:18:10.167550731 +0000 UTC m=+520.455057494" Jun 12 20:18:12.736892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:12.736856 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:13.859845 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:13.859780 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:16.143512 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:16.143484 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k2rcl" Jun 12 20:18:17.071257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:17.071199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:17.129798 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:17.129726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:18.906725 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:18.906640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:19.007889 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:19.007852 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:21.282453 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:21.282426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:22.169987 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.169953 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-nkr8r"] Jun 12 20:18:22.170299 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.170285 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerName="extract" Jun 12 20:18:22.170347 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.170301 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerName="extract" Jun 12 20:18:22.170347 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.170318 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerName="pull" Jun 12 20:18:22.170347 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.170324 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerName="pull" Jun 12 20:18:22.170347 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.170338 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerName="util" Jun 12 20:18:22.170347 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.170344 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerName="util" Jun 12 20:18:22.170497 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.170416 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d3ac54-dd0e-45b8-932b-6d15d439de12" containerName="extract" Jun 12 20:18:22.192671 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.192642 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-nkr8r"] Jun 12 20:18:22.192862 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.192720 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-nkr8r" Jun 12 20:18:22.195308 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.195288 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gp59r\"" Jun 12 20:18:22.238986 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.238948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn4c2\" (UniqueName: \"kubernetes.io/projected/c145f373-686a-489b-a9dd-59f6452f88e8-kube-api-access-jn4c2\") pod \"cert-manager-59c77684cc-nkr8r\" (UID: \"c145f373-686a-489b-a9dd-59f6452f88e8\") " pod="cert-manager/cert-manager-59c77684cc-nkr8r" Jun 12 20:18:22.239135 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.239025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c145f373-686a-489b-a9dd-59f6452f88e8-bound-sa-token\") pod \"cert-manager-59c77684cc-nkr8r\" (UID: \"c145f373-686a-489b-a9dd-59f6452f88e8\") " pod="cert-manager/cert-manager-59c77684cc-nkr8r" Jun 12 20:18:22.339950 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.339913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c145f373-686a-489b-a9dd-59f6452f88e8-bound-sa-token\") pod \"cert-manager-59c77684cc-nkr8r\" (UID: \"c145f373-686a-489b-a9dd-59f6452f88e8\") " pod="cert-manager/cert-manager-59c77684cc-nkr8r" Jun 12 20:18:22.340331 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.339973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn4c2\" (UniqueName: \"kubernetes.io/projected/c145f373-686a-489b-a9dd-59f6452f88e8-kube-api-access-jn4c2\") pod \"cert-manager-59c77684cc-nkr8r\" (UID: \"c145f373-686a-489b-a9dd-59f6452f88e8\") " pod="cert-manager/cert-manager-59c77684cc-nkr8r" Jun 12 20:18:22.347938 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.347908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn4c2\" (UniqueName: \"kubernetes.io/projected/c145f373-686a-489b-a9dd-59f6452f88e8-kube-api-access-jn4c2\") pod \"cert-manager-59c77684cc-nkr8r\" (UID: \"c145f373-686a-489b-a9dd-59f6452f88e8\") " pod="cert-manager/cert-manager-59c77684cc-nkr8r" Jun 12 20:18:22.348077 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.348000 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c145f373-686a-489b-a9dd-59f6452f88e8-bound-sa-token\") pod \"cert-manager-59c77684cc-nkr8r\" (UID: \"c145f373-686a-489b-a9dd-59f6452f88e8\") " pod="cert-manager/cert-manager-59c77684cc-nkr8r" Jun 12 20:18:22.501413 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.501336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-nkr8r" Jun 12 20:18:22.656845 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:22.656774 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-nkr8r"] Jun 12 20:18:22.659590 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:18:22.659564 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc145f373_686a_489b_a9dd_59f6452f88e8.slice/crio-9c0f67cb2ad636efccdbec8e299226d6fbccd4a57828c996632b18dff383961a WatchSource:0}: Error finding container 9c0f67cb2ad636efccdbec8e299226d6fbccd4a57828c996632b18dff383961a: Status 404 returned error can't find the container with id 9c0f67cb2ad636efccdbec8e299226d6fbccd4a57828c996632b18dff383961a Jun 12 20:18:23.195981 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:23.195947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-nkr8r" event={"ID":"c145f373-686a-489b-a9dd-59f6452f88e8","Type":"ContainerStarted","Data":"4f0131869f350463871ec1d270d7eea1588dcb4e9aa9fd9a13b9303e3f8fba23"} Jun 12 20:18:23.195981 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:23.195985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-nkr8r" event={"ID":"c145f373-686a-489b-a9dd-59f6452f88e8","Type":"ContainerStarted","Data":"9c0f67cb2ad636efccdbec8e299226d6fbccd4a57828c996632b18dff383961a"} Jun 12 20:18:23.212987 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:23.212943 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-nkr8r" podStartSLOduration=1.212929105 podStartE2EDuration="1.212929105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:18:23.211271981 +0000 UTC m=+533.498778832" watchObservedRunningTime="2026-06-12 20:18:23.212929105 +0000 UTC m=+533.500435867" Jun 12 20:18:34.215671 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.215638 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn"] Jun 12 20:18:34.218429 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.218412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.220838 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.220815 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 20:18:34.220838 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.220815 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 20:18:34.221026 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.220818 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqvqx\"" Jun 12 20:18:34.228140 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.228115 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn"] Jun 12 20:18:34.336481 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.336431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.336713 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.336599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbl52\" (UniqueName: \"kubernetes.io/projected/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-kube-api-access-mbl52\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.336713 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.336654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.438043 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.438002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbl52\" (UniqueName: \"kubernetes.io/projected/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-kube-api-access-mbl52\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.438043 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.438048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.438293 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.438079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.438429 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.438413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.438499 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.438475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.446569 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.446545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbl52\" (UniqueName: \"kubernetes.io/projected/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-kube-api-access-mbl52\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.528714 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.528613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:34.660009 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:34.659985 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn"] Jun 12 20:18:34.662138 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:18:34.662112 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c6b0fd_75b2_429d_92b3_d4a84364fd8b.slice/crio-b77848190ffdb3fbd5f26446b7cd8ba9e2e1b50f2099a889e83a31a272749cb8 WatchSource:0}: Error finding container b77848190ffdb3fbd5f26446b7cd8ba9e2e1b50f2099a889e83a31a272749cb8: Status 404 returned error can't find the container with id b77848190ffdb3fbd5f26446b7cd8ba9e2e1b50f2099a889e83a31a272749cb8 Jun 12 20:18:35.250191 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:35.250158 2578 generic.go:356] "Generic (PLEG): container finished" podID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerID="fc47287f42434d8949cd8101b60beb7bd36fb16b1f1716d6cca46c19cf5664d0" exitCode=0 Jun 12 20:18:35.250574 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:35.250209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" event={"ID":"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b","Type":"ContainerDied","Data":"fc47287f42434d8949cd8101b60beb7bd36fb16b1f1716d6cca46c19cf5664d0"} Jun 12 20:18:35.250574 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:35.250252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" event={"ID":"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b","Type":"ContainerStarted","Data":"b77848190ffdb3fbd5f26446b7cd8ba9e2e1b50f2099a889e83a31a272749cb8"} Jun 12 20:18:36.256338 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:36.256303 2578 generic.go:356] "Generic (PLEG): container finished" podID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerID="987239df1d30cb2cbcf214f65d2426b95d9728d6c32813e7e0b378bc183a4fb4" exitCode=0 Jun 12 20:18:36.256722 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:36.256351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" event={"ID":"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b","Type":"ContainerDied","Data":"987239df1d30cb2cbcf214f65d2426b95d9728d6c32813e7e0b378bc183a4fb4"} Jun 12 20:18:37.263301 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:37.263267 2578 generic.go:356] "Generic (PLEG): container finished" podID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerID="5ee3abb961ff660539eab22f1071d88cbc822e255ac90365b61648d14810204c" exitCode=0 Jun 12 20:18:37.263677 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:37.263356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" event={"ID":"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b","Type":"ContainerDied","Data":"5ee3abb961ff660539eab22f1071d88cbc822e255ac90365b61648d14810204c"} Jun 12 20:18:38.399169 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.399140 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:38.476889 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.476857 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-util\") pod \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " Jun 12 20:18:38.477061 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.476924 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-bundle\") pod \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " Jun 12 20:18:38.477061 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.476954 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbl52\" (UniqueName: \"kubernetes.io/projected/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-kube-api-access-mbl52\") pod \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\" (UID: \"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b\") " Jun 12 20:18:38.477640 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.477609 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-bundle" (OuterVolumeSpecName: "bundle") pod "a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" (UID: "a3c6b0fd-75b2-429d-92b3-d4a84364fd8b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:18:38.479179 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.479156 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-kube-api-access-mbl52" (OuterVolumeSpecName: "kube-api-access-mbl52") pod "a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" (UID: "a3c6b0fd-75b2-429d-92b3-d4a84364fd8b"). InnerVolumeSpecName "kube-api-access-mbl52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:18:38.482676 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.482638 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-util" (OuterVolumeSpecName: "util") pod "a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" (UID: "a3c6b0fd-75b2-429d-92b3-d4a84364fd8b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:18:38.578323 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.578269 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:18:38.578323 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.578314 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:18:38.578576 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:38.578328 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbl52\" (UniqueName: \"kubernetes.io/projected/a3c6b0fd-75b2-429d-92b3-d4a84364fd8b-kube-api-access-mbl52\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:18:39.274833 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:39.274796 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" event={"ID":"a3c6b0fd-75b2-429d-92b3-d4a84364fd8b","Type":"ContainerDied","Data":"b77848190ffdb3fbd5f26446b7cd8ba9e2e1b50f2099a889e83a31a272749cb8"} Jun 12 20:18:39.275012 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:39.274842 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd648wn" Jun 12 20:18:39.275012 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:39.274845 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b77848190ffdb3fbd5f26446b7cd8ba9e2e1b50f2099a889e83a31a272749cb8" Jun 12 20:18:44.963555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:44.963519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:45.058148 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.058116 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:45.564785 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.564727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:45.773777 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.773725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:45.892127 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.892040 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:45.937837 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.937799 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd"] Jun 12 20:18:45.938150 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.938137 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerName="util" Jun 12 20:18:45.938150 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.938150 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerName="util" Jun 12 20:18:45.938230 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.938167 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerName="extract" Jun 12 20:18:45.938230 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.938173 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerName="extract" Jun 12 20:18:45.938230 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.938185 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerName="pull" Jun 12 20:18:45.938230 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.938191 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerName="pull" Jun 12 20:18:45.938395 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.938252 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3c6b0fd-75b2-429d-92b3-d4a84364fd8b" containerName="extract" Jun 12 20:18:45.942712 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.942693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:45.945553 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.945511 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 20:18:45.945825 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.945791 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-chtxb\"" Jun 12 20:18:45.946102 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.945909 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 20:18:45.946102 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.945789 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 20:18:45.946257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.946238 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 20:18:45.960882 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:45.960862 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd"] Jun 12 20:18:46.037695 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.037659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0fd67d75-aff3-4cb6-b513-474c7db52288-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.038087 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.037711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbnvk\" (UniqueName: \"kubernetes.io/projected/0fd67d75-aff3-4cb6-b513-474c7db52288-kube-api-access-pbnvk\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.038087 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.037739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0fd67d75-aff3-4cb6-b513-474c7db52288-manifests\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.038087 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.037800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fd67d75-aff3-4cb6-b513-474c7db52288-webhook-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.038087 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.037818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fd67d75-aff3-4cb6-b513-474c7db52288-tmp\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.074958 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.074929 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:46.139095 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.139064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fd67d75-aff3-4cb6-b513-474c7db52288-tmp\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.139255 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.139112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0fd67d75-aff3-4cb6-b513-474c7db52288-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.139255 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.139171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbnvk\" (UniqueName: \"kubernetes.io/projected/0fd67d75-aff3-4cb6-b513-474c7db52288-kube-api-access-pbnvk\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.139255 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.139212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0fd67d75-aff3-4cb6-b513-474c7db52288-manifests\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.139255 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.139252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fd67d75-aff3-4cb6-b513-474c7db52288-webhook-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.139598 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.139568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0fd67d75-aff3-4cb6-b513-474c7db52288-manifests\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.141654 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.141629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fd67d75-aff3-4cb6-b513-474c7db52288-tmp\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.141774 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.141702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fd67d75-aff3-4cb6-b513-474c7db52288-webhook-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.141832 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.141821 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0fd67d75-aff3-4cb6-b513-474c7db52288-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.147158 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.147110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbnvk\" (UniqueName: \"kubernetes.io/projected/0fd67d75-aff3-4cb6-b513-474c7db52288-kube-api-access-pbnvk\") pod \"opendatahub-operator-controller-manager-68bb89b4d-hfgkd\" (UID: \"0fd67d75-aff3-4cb6-b513-474c7db52288\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.175673 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.175645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:46.253474 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.253442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:46.275842 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.275814 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:46.369663 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.369618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:46.387897 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.387868 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd"] Jun 12 20:18:46.391177 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:18:46.391154 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd67d75_aff3_4cb6_b513_474c7db52288.slice/crio-0c2437776f0b1e300061629fe1a82556f8a264418b1d7b0291d612313c5a1c83 WatchSource:0}: Error finding container 0c2437776f0b1e300061629fe1a82556f8a264418b1d7b0291d612313c5a1c83: Status 404 returned error can't find the container with id 0c2437776f0b1e300061629fe1a82556f8a264418b1d7b0291d612313c5a1c83 Jun 12 20:18:46.441583 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.441484 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:46.549492 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:46.549459 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:47.316625 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:47.316582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" event={"ID":"0fd67d75-aff3-4cb6-b513-474c7db52288","Type":"ContainerStarted","Data":"0c2437776f0b1e300061629fe1a82556f8a264418b1d7b0291d612313c5a1c83"} Jun 12 20:18:49.327786 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:49.327741 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" event={"ID":"0fd67d75-aff3-4cb6-b513-474c7db52288","Type":"ContainerStarted","Data":"48fbef29ec5748256b15b7c3aeba868599aa6570769043472ca162a5a95915a7"} Jun 12 20:18:50.333213 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:50.333173 2578 generic.go:356] "Generic (PLEG): container finished" podID="0fd67d75-aff3-4cb6-b513-474c7db52288" containerID="48fbef29ec5748256b15b7c3aeba868599aa6570769043472ca162a5a95915a7" exitCode=0 Jun 12 20:18:50.333213 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:50.333216 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" event={"ID":"0fd67d75-aff3-4cb6-b513-474c7db52288","Type":"ContainerDied","Data":"48fbef29ec5748256b15b7c3aeba868599aa6570769043472ca162a5a95915a7"} Jun 12 20:18:51.339910 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:51.339875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" event={"ID":"0fd67d75-aff3-4cb6-b513-474c7db52288","Type":"ContainerStarted","Data":"a517ff276b8a7545433d83527bba3e0606d2c67655a691f6b7a89f85ad7aa890"} Jun 12 20:18:51.340381 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:51.340109 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:18:51.362284 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:51.362240 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" podStartSLOduration=2.324463309 podStartE2EDuration="6.362224909s" totalImagesPullingTime="3.072354443s" totalInitContainerRuntime="965.407157ms" isStatefulPod=false podCreationTimestamp="2026-06-12 20:18:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:18:51.360383934 +0000 UTC m=+561.647890732" watchObservedRunningTime="2026-06-12 20:18:51.362224909 +0000 UTC m=+561.649731695" Jun 12 20:18:57.595088 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:57.595054 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:18:57.720828 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:18:57.720773 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:02.347796 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:02.347747 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-hfgkd" Jun 12 20:19:04.166612 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:04.166571 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:04.289263 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:04.289228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:04.840985 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:04.840917 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:04.946409 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:04.946368 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:05.090641 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.090607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:05.290816 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.290655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:05.382728 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.382676 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:05.488260 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.488212 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:05.567315 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.567282 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc"] Jun 12 20:19:05.569179 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.569149 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:05.575824 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.575803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.578633 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.578614 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 20:19:05.579214 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.579194 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqvqx\"" Jun 12 20:19:05.579480 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.579462 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 20:19:05.593235 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.593211 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc"] Jun 12 20:19:05.597406 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.597378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.597535 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.597463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsbd\" (UniqueName: \"kubernetes.io/projected/3db7c487-afcc-4b26-8161-485a01726d37-kube-api-access-6wsbd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.597535 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.597499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.698346 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.698309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.698546 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.698412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsbd\" (UniqueName: \"kubernetes.io/projected/3db7c487-afcc-4b26-8161-485a01726d37-kube-api-access-6wsbd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.698546 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.698451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.698826 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.698799 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.698940 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.698836 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.708309 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.708269 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsbd\" (UniqueName: \"kubernetes.io/projected/3db7c487-afcc-4b26-8161-485a01726d37-kube-api-access-6wsbd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.888242 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.888163 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:05.900665 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:05.900634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:06.032485 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:06.032454 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc"] Jun 12 20:19:06.035116 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:19:06.035088 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db7c487_afcc_4b26_8161_485a01726d37.slice/crio-a5a9247362984ce5beae74d66a9009a510f8ef62d491c11f773583ae082aa95f WatchSource:0}: Error finding container a5a9247362984ce5beae74d66a9009a510f8ef62d491c11f773583ae082aa95f: Status 404 returned error can't find the container with id a5a9247362984ce5beae74d66a9009a510f8ef62d491c11f773583ae082aa95f Jun 12 20:19:06.417106 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:06.417019 2578 generic.go:356] "Generic (PLEG): container finished" podID="3db7c487-afcc-4b26-8161-485a01726d37" containerID="ff7afd3d305a9f3840da86078f940a825da431c58d8ad689ff0f3f6cfe845ee4" exitCode=0 Jun 12 20:19:06.417106 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:06.417064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" event={"ID":"3db7c487-afcc-4b26-8161-485a01726d37","Type":"ContainerDied","Data":"ff7afd3d305a9f3840da86078f940a825da431c58d8ad689ff0f3f6cfe845ee4"} Jun 12 20:19:06.417614 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:06.417125 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" event={"ID":"3db7c487-afcc-4b26-8161-485a01726d37","Type":"ContainerStarted","Data":"a5a9247362984ce5beae74d66a9009a510f8ef62d491c11f773583ae082aa95f"} Jun 12 20:19:08.429508 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:08.429474 2578 generic.go:356] "Generic (PLEG): container finished" podID="3db7c487-afcc-4b26-8161-485a01726d37" containerID="eb09e4da15685bf02cc8e242088cdf08af4ae5e4f55e817805f24372c048a9af" exitCode=0 Jun 12 20:19:08.429925 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:08.429527 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" event={"ID":"3db7c487-afcc-4b26-8161-485a01726d37","Type":"ContainerDied","Data":"eb09e4da15685bf02cc8e242088cdf08af4ae5e4f55e817805f24372c048a9af"} Jun 12 20:19:09.437508 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:09.437464 2578 generic.go:356] "Generic (PLEG): container finished" podID="3db7c487-afcc-4b26-8161-485a01726d37" containerID="784c9a6292510ed9fb4070e3688ef4dece9b160e0f89a0ee80e84c7d24ffc8ea" exitCode=0 Jun 12 20:19:09.437894 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:09.437537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" event={"ID":"3db7c487-afcc-4b26-8161-485a01726d37","Type":"ContainerDied","Data":"784c9a6292510ed9fb4070e3688ef4dece9b160e0f89a0ee80e84c7d24ffc8ea"} Jun 12 20:19:10.575954 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.575926 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:10.638471 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.638434 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-bundle\") pod \"3db7c487-afcc-4b26-8161-485a01726d37\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " Jun 12 20:19:10.638636 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.638484 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-util\") pod \"3db7c487-afcc-4b26-8161-485a01726d37\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " Jun 12 20:19:10.638636 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.638517 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wsbd\" (UniqueName: \"kubernetes.io/projected/3db7c487-afcc-4b26-8161-485a01726d37-kube-api-access-6wsbd\") pod \"3db7c487-afcc-4b26-8161-485a01726d37\" (UID: \"3db7c487-afcc-4b26-8161-485a01726d37\") " Jun 12 20:19:10.639350 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.639322 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-bundle" (OuterVolumeSpecName: "bundle") pod "3db7c487-afcc-4b26-8161-485a01726d37" (UID: "3db7c487-afcc-4b26-8161-485a01726d37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:19:10.640800 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.640775 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db7c487-afcc-4b26-8161-485a01726d37-kube-api-access-6wsbd" (OuterVolumeSpecName: "kube-api-access-6wsbd") pod "3db7c487-afcc-4b26-8161-485a01726d37" (UID: "3db7c487-afcc-4b26-8161-485a01726d37"). InnerVolumeSpecName "kube-api-access-6wsbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:19:10.643608 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.643584 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-util" (OuterVolumeSpecName: "util") pod "3db7c487-afcc-4b26-8161-485a01726d37" (UID: "3db7c487-afcc-4b26-8161-485a01726d37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:19:10.740002 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.739921 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:19:10.740002 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.739946 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3db7c487-afcc-4b26-8161-485a01726d37-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:19:10.740002 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:10.739956 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wsbd\" (UniqueName: \"kubernetes.io/projected/3db7c487-afcc-4b26-8161-485a01726d37-kube-api-access-6wsbd\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:19:11.450456 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:11.450419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" event={"ID":"3db7c487-afcc-4b26-8161-485a01726d37","Type":"ContainerDied","Data":"a5a9247362984ce5beae74d66a9009a510f8ef62d491c11f773583ae082aa95f"} Jun 12 20:19:11.450456 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:11.450442 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nmdcc" Jun 12 20:19:11.450662 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:11.450470 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5a9247362984ce5beae74d66a9009a510f8ef62d491c11f773583ae082aa95f" Jun 12 20:19:14.574354 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.574314 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:14.601414 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.601380 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4"] Jun 12 20:19:14.601787 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.601773 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db7c487-afcc-4b26-8161-485a01726d37" containerName="util" Jun 12 20:19:14.601787 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.601789 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db7c487-afcc-4b26-8161-485a01726d37" containerName="util" Jun 12 20:19:14.601877 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.601805 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db7c487-afcc-4b26-8161-485a01726d37" containerName="extract" Jun 12 20:19:14.601877 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.601811 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db7c487-afcc-4b26-8161-485a01726d37" containerName="extract" Jun 12 20:19:14.601877 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.601834 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db7c487-afcc-4b26-8161-485a01726d37" containerName="pull" Jun 12 20:19:14.601877 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.601840 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db7c487-afcc-4b26-8161-485a01726d37" containerName="pull" Jun 12 20:19:14.601998 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.601894 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db7c487-afcc-4b26-8161-485a01726d37" containerName="extract" Jun 12 20:19:14.605217 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.605202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.608834 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.608814 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 20:19:14.608977 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.608952 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:19:14.609295 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.609260 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 20:19:14.609295 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.609270 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 20:19:14.609295 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.609275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-swxbf\"" Jun 12 20:19:14.609295 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.609286 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 20:19:14.617891 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.617858 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4"] Jun 12 20:19:14.672958 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.672916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3d997e3-ebd7-4490-8387-10889b9e4526-cert\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.673123 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.672965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqrqj\" (UniqueName: \"kubernetes.io/projected/a3d997e3-ebd7-4490-8387-10889b9e4526-kube-api-access-fqrqj\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.673123 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.673001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3d997e3-ebd7-4490-8387-10889b9e4526-metrics-cert\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.673123 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.673054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a3d997e3-ebd7-4490-8387-10889b9e4526-manager-config\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.685887 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.685858 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:14.745316 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.745280 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:14.774102 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.774073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3d997e3-ebd7-4490-8387-10889b9e4526-cert\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.774102 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.774105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqrqj\" (UniqueName: \"kubernetes.io/projected/a3d997e3-ebd7-4490-8387-10889b9e4526-kube-api-access-fqrqj\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.774351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.774129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3d997e3-ebd7-4490-8387-10889b9e4526-metrics-cert\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.774351 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.774149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a3d997e3-ebd7-4490-8387-10889b9e4526-manager-config\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.774943 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.774907 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a3d997e3-ebd7-4490-8387-10889b9e4526-manager-config\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.776785 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.776731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3d997e3-ebd7-4490-8387-10889b9e4526-cert\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.776894 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.776880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3d997e3-ebd7-4490-8387-10889b9e4526-metrics-cert\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.792127 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.792103 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqrqj\" (UniqueName: \"kubernetes.io/projected/a3d997e3-ebd7-4490-8387-10889b9e4526-kube-api-access-fqrqj\") pod \"lws-controller-manager-546dccc465-6j2d4\" (UID: \"a3d997e3-ebd7-4490-8387-10889b9e4526\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.915571 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.915487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:14.927839 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:14.927788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:15.039355 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:15.039318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:15.064463 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:15.064442 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4"] Jun 12 20:19:15.066022 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:19:15.065986 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d997e3_ebd7_4490_8387_10889b9e4526.slice/crio-7ce397dcefb470d33b3630f4b637bf606da21e515da5d67fff16efaa0be46bbc WatchSource:0}: Error finding container 7ce397dcefb470d33b3630f4b637bf606da21e515da5d67fff16efaa0be46bbc: Status 404 returned error can't find the container with id 7ce397dcefb470d33b3630f4b637bf606da21e515da5d67fff16efaa0be46bbc Jun 12 20:19:15.136367 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:15.136338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:15.474845 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:15.474805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" event={"ID":"a3d997e3-ebd7-4490-8387-10889b9e4526","Type":"ContainerStarted","Data":"7ce397dcefb470d33b3630f4b637bf606da21e515da5d67fff16efaa0be46bbc"} Jun 12 20:19:17.486228 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:17.486193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" event={"ID":"a3d997e3-ebd7-4490-8387-10889b9e4526","Type":"ContainerStarted","Data":"a07df4fc57679e60e02f60d83e9bd30ecf0388911471ac0391f99d625c17ce0b"} Jun 12 20:19:17.486744 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:17.486253 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:17.552978 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:17.552924 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" podStartSLOduration=2.112734564 podStartE2EDuration="3.552908225s" totalImagesPullingTime="1.440173661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:19:17.550947889 +0000 UTC m=+587.838454651" watchObservedRunningTime="2026-06-12 20:19:17.552908225 +0000 UTC m=+587.840414987" Jun 12 20:19:18.564800 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:18.564750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:18.665566 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:18.665527 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:19.758713 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.758644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:19.822393 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.822355 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p"] Jun 12 20:19:19.826226 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.826205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:19.829516 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.829495 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 20:19:19.830079 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.830061 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 20:19:19.833519 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.833497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqvqx\"" Jun 12 20:19:19.847614 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.847589 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p"] Jun 12 20:19:19.885798 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.885772 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:19.922272 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.922247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:19.922432 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.922283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:19.922432 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:19.922322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkh55\" (UniqueName: \"kubernetes.io/projected/03f36040-35c7-451f-a7b9-e4a232aee1fd-kube-api-access-vkh55\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:20.023465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.023371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:20.023465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.023419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:20.023465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.023452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkh55\" (UniqueName: \"kubernetes.io/projected/03f36040-35c7-451f-a7b9-e4a232aee1fd-kube-api-access-vkh55\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:20.023818 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.023793 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:20.023901 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.023842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:20.037631 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.037602 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkh55\" (UniqueName: \"kubernetes.io/projected/03f36040-35c7-451f-a7b9-e4a232aee1fd-kube-api-access-vkh55\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:20.135638 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.135597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:20.283003 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.282978 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p"] Jun 12 20:19:20.286738 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:19:20.286343 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f36040_35c7_451f_a7b9_e4a232aee1fd.slice/crio-950a5c369e58abf0ae4743004719c951573a10e30ca896ed115e0ab3b5db4ea7 WatchSource:0}: Error finding container 950a5c369e58abf0ae4743004719c951573a10e30ca896ed115e0ab3b5db4ea7: Status 404 returned error can't find the container with id 950a5c369e58abf0ae4743004719c951573a10e30ca896ed115e0ab3b5db4ea7 Jun 12 20:19:20.447581 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.447551 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:20.503045 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.503011 2578 generic.go:356] "Generic (PLEG): container finished" podID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerID="af5b1f1b6f609cf793fab340b9d1c2afbde5a8cd4073d6fc495b3b39949ee03c" exitCode=0 Jun 12 20:19:20.503214 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.503098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" event={"ID":"03f36040-35c7-451f-a7b9-e4a232aee1fd","Type":"ContainerDied","Data":"af5b1f1b6f609cf793fab340b9d1c2afbde5a8cd4073d6fc495b3b39949ee03c"} Jun 12 20:19:20.503214 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.503145 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" event={"ID":"03f36040-35c7-451f-a7b9-e4a232aee1fd","Type":"ContainerStarted","Data":"950a5c369e58abf0ae4743004719c951573a10e30ca896ed115e0ab3b5db4ea7"} Jun 12 20:19:20.913749 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:20.913722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:21.089651 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:21.089620 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:21.509450 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:21.509355 2578 generic.go:356] "Generic (PLEG): container finished" podID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerID="4aefaf80cbaf35507a55ccd4f108f11be424719f4aeb1be12486fe0fd32c8d12" exitCode=0 Jun 12 20:19:21.509450 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:21.509420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" event={"ID":"03f36040-35c7-451f-a7b9-e4a232aee1fd","Type":"ContainerDied","Data":"4aefaf80cbaf35507a55ccd4f108f11be424719f4aeb1be12486fe0fd32c8d12"} Jun 12 20:19:22.364852 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.364819 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7476dfc89-spptl"] Jun 12 20:19:22.389069 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.389041 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7476dfc89-spptl"] Jun 12 20:19:22.389250 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.389137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7476dfc89-spptl" Jun 12 20:19:22.391617 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.391597 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7l6w6\"" Jun 12 20:19:22.392043 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.392014 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 20:19:22.392990 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.392968 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:22.444887 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.444861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e9658baf-abb5-4f07-bc2e-7349db068c6d-redirect-config\") pod \"dashboard-redirect-7476dfc89-spptl\" (UID: \"e9658baf-abb5-4f07-bc2e-7349db068c6d\") " pod="opendatahub/dashboard-redirect-7476dfc89-spptl" Jun 12 20:19:22.445028 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.444913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntppl\" (UniqueName: \"kubernetes.io/projected/e9658baf-abb5-4f07-bc2e-7349db068c6d-kube-api-access-ntppl\") pod \"dashboard-redirect-7476dfc89-spptl\" (UID: \"e9658baf-abb5-4f07-bc2e-7349db068c6d\") " pod="opendatahub/dashboard-redirect-7476dfc89-spptl" Jun 12 20:19:22.516903 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.516864 2578 generic.go:356] "Generic (PLEG): container finished" podID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerID="b35f8699915830276543d26f24fb8632e72ed55a5714bbfaefe5315e38fd9464" exitCode=0 Jun 12 20:19:22.517061 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.516940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" event={"ID":"03f36040-35c7-451f-a7b9-e4a232aee1fd","Type":"ContainerDied","Data":"b35f8699915830276543d26f24fb8632e72ed55a5714bbfaefe5315e38fd9464"} Jun 12 20:19:22.546231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.546196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntppl\" (UniqueName: \"kubernetes.io/projected/e9658baf-abb5-4f07-bc2e-7349db068c6d-kube-api-access-ntppl\") pod \"dashboard-redirect-7476dfc89-spptl\" (UID: \"e9658baf-abb5-4f07-bc2e-7349db068c6d\") " pod="opendatahub/dashboard-redirect-7476dfc89-spptl" Jun 12 20:19:22.546386 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.546258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e9658baf-abb5-4f07-bc2e-7349db068c6d-redirect-config\") pod \"dashboard-redirect-7476dfc89-spptl\" (UID: \"e9658baf-abb5-4f07-bc2e-7349db068c6d\") " pod="opendatahub/dashboard-redirect-7476dfc89-spptl" Jun 12 20:19:22.546958 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.546941 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e9658baf-abb5-4f07-bc2e-7349db068c6d-redirect-config\") pod \"dashboard-redirect-7476dfc89-spptl\" (UID: \"e9658baf-abb5-4f07-bc2e-7349db068c6d\") " pod="opendatahub/dashboard-redirect-7476dfc89-spptl" Jun 12 20:19:22.566443 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.566409 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntppl\" (UniqueName: \"kubernetes.io/projected/e9658baf-abb5-4f07-bc2e-7349db068c6d-kube-api-access-ntppl\") pod \"dashboard-redirect-7476dfc89-spptl\" (UID: \"e9658baf-abb5-4f07-bc2e-7349db068c6d\") " pod="opendatahub/dashboard-redirect-7476dfc89-spptl" Jun 12 20:19:22.700481 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.700401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7476dfc89-spptl" Jun 12 20:19:22.833926 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:22.833902 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7476dfc89-spptl"] Jun 12 20:19:22.835653 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:19:22.835609 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9658baf_abb5_4f07_bc2e_7349db068c6d.slice/crio-cb98737e7a006e150a206cc9dca579bee17ca7d46281e22881c51b035903111d WatchSource:0}: Error finding container cb98737e7a006e150a206cc9dca579bee17ca7d46281e22881c51b035903111d: Status 404 returned error can't find the container with id cb98737e7a006e150a206cc9dca579bee17ca7d46281e22881c51b035903111d Jun 12 20:19:23.522521 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.522481 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7476dfc89-spptl" event={"ID":"e9658baf-abb5-4f07-bc2e-7349db068c6d","Type":"ContainerStarted","Data":"cb98737e7a006e150a206cc9dca579bee17ca7d46281e22881c51b035903111d"} Jun 12 20:19:23.649971 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.649948 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:23.756128 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.756097 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkh55\" (UniqueName: \"kubernetes.io/projected/03f36040-35c7-451f-a7b9-e4a232aee1fd-kube-api-access-vkh55\") pod \"03f36040-35c7-451f-a7b9-e4a232aee1fd\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " Jun 12 20:19:23.756295 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.756161 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-bundle\") pod \"03f36040-35c7-451f-a7b9-e4a232aee1fd\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " Jun 12 20:19:23.756295 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.756182 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-util\") pod \"03f36040-35c7-451f-a7b9-e4a232aee1fd\" (UID: \"03f36040-35c7-451f-a7b9-e4a232aee1fd\") " Jun 12 20:19:23.757091 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.757046 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-bundle" (OuterVolumeSpecName: "bundle") pod "03f36040-35c7-451f-a7b9-e4a232aee1fd" (UID: "03f36040-35c7-451f-a7b9-e4a232aee1fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:19:23.758397 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.758372 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03f36040-35c7-451f-a7b9-e4a232aee1fd-kube-api-access-vkh55" (OuterVolumeSpecName: "kube-api-access-vkh55") pod "03f36040-35c7-451f-a7b9-e4a232aee1fd" (UID: "03f36040-35c7-451f-a7b9-e4a232aee1fd"). InnerVolumeSpecName "kube-api-access-vkh55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:19:23.761709 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.761686 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-util" (OuterVolumeSpecName: "util") pod "03f36040-35c7-451f-a7b9-e4a232aee1fd" (UID: "03f36040-35c7-451f-a7b9-e4a232aee1fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:19:23.857421 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.857385 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:19:23.857421 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.857420 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f36040-35c7-451f-a7b9-e4a232aee1fd-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:19:23.857673 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:23.857435 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkh55\" (UniqueName: \"kubernetes.io/projected/03f36040-35c7-451f-a7b9-e4a232aee1fd-kube-api-access-vkh55\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:19:24.529749 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:24.529677 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" Jun 12 20:19:24.530139 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:24.529650 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alfh7p" event={"ID":"03f36040-35c7-451f-a7b9-e4a232aee1fd","Type":"ContainerDied","Data":"950a5c369e58abf0ae4743004719c951573a10e30ca896ed115e0ab3b5db4ea7"} Jun 12 20:19:24.530139 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:24.529834 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="950a5c369e58abf0ae4743004719c951573a10e30ca896ed115e0ab3b5db4ea7" Jun 12 20:19:25.535613 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:25.535570 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7476dfc89-spptl" event={"ID":"e9658baf-abb5-4f07-bc2e-7349db068c6d","Type":"ContainerStarted","Data":"ec14a1989a04bbdb8453334a328fc83a280f6dc5c46fb2c0a72808f9cd7626d6"} Jun 12 20:19:25.552002 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:25.551951 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7476dfc89-spptl" podStartSLOduration=1.424970762 podStartE2EDuration="3.551936722s" totalImagesPullingTime="2.12696596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:19:25.551140232 +0000 UTC m=+595.838647013" watchObservedRunningTime="2026-06-12 20:19:25.551936722 +0000 UTC m=+595.839443484" Jun 12 20:19:28.494537 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:28.494508 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-546dccc465-6j2d4" Jun 12 20:19:30.138432 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:30.138404 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:19:30.139461 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:30.139440 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:19:30.146543 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:30.146522 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:19:30.147404 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:30.147383 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:19:31.169698 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:31.169664 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:31.261538 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:31.261507 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:36.764002 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:36.763964 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:36.865000 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:36.864965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:37.601981 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:37.601951 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:40.199842 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.199808 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:40.300767 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.300730 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:40.460132 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.460041 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v"] Jun 12 20:19:40.460414 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.460398 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerName="extract" Jun 12 20:19:40.460414 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.460413 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerName="extract" Jun 12 20:19:40.460536 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.460430 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerName="util" Jun 12 20:19:40.460536 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.460435 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerName="util" Jun 12 20:19:40.460536 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.460457 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerName="pull" Jun 12 20:19:40.460536 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.460462 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerName="pull" Jun 12 20:19:40.460536 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.460519 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="03f36040-35c7-451f-a7b9-e4a232aee1fd" containerName="extract" Jun 12 20:19:40.464186 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.464165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.466731 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.466708 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 20:19:40.466865 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.466728 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rkg6r\"" Jun 12 20:19:40.479979 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.479953 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v"] Jun 12 20:19:40.496729 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.496705 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:40.617569 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.617530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.617808 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.617574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.617808 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.617600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.617808 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.617623 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/180a234a-680f-4ab3-babb-1d618d534ea3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.617808 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.617675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9hg\" (UniqueName: \"kubernetes.io/projected/180a234a-680f-4ab3-babb-1d618d534ea3-kube-api-access-pt9hg\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.617808 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.617752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.617808 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.617794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/180a234a-680f-4ab3-babb-1d618d534ea3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.618141 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.617843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/180a234a-680f-4ab3-babb-1d618d534ea3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.618141 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.617873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.718693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.718604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.718693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.718636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.718693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.718661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.718693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.718679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/180a234a-680f-4ab3-babb-1d618d534ea3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719023 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.718703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9hg\" (UniqueName: \"kubernetes.io/projected/180a234a-680f-4ab3-babb-1d618d534ea3-kube-api-access-pt9hg\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719023 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.718748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719023 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.718791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/180a234a-680f-4ab3-babb-1d618d534ea3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719023 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.718820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/180a234a-680f-4ab3-babb-1d618d534ea3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719023 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.718844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.719119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.719156 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719279 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.719258 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719427 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.719314 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.719639 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.719620 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/180a234a-680f-4ab3-babb-1d618d534ea3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.721283 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.721261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/180a234a-680f-4ab3-babb-1d618d534ea3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.721409 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.721371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/180a234a-680f-4ab3-babb-1d618d534ea3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.726621 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.726593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:40.729349 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.729321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/180a234a-680f-4ab3-babb-1d618d534ea3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.729471 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.729403 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9hg\" (UniqueName: \"kubernetes.io/projected/180a234a-680f-4ab3-babb-1d618d534ea3-kube-api-access-pt9hg\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6h5v\" (UID: \"180a234a-680f-4ab3-babb-1d618d534ea3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.774177 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.774143 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:40.824848 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.824817 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:40.924314 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:40.924285 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v"] Jun 12 20:19:40.925852 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:19:40.925817 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180a234a_680f_4ab3_babb_1d618d534ea3.slice/crio-ef3ea4b97b27d5e0eda71196b9961e2e9e0d36cb984e2f57bc9f7bf88ee24b56 WatchSource:0}: Error finding container ef3ea4b97b27d5e0eda71196b9961e2e9e0d36cb984e2f57bc9f7bf88ee24b56: Status 404 returned error can't find the container with id ef3ea4b97b27d5e0eda71196b9961e2e9e0d36cb984e2f57bc9f7bf88ee24b56 Jun 12 20:19:41.619383 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:41.619344 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" event={"ID":"180a234a-680f-4ab3-babb-1d618d534ea3","Type":"ContainerStarted","Data":"ef3ea4b97b27d5e0eda71196b9961e2e9e0d36cb984e2f57bc9f7bf88ee24b56"} Jun 12 20:19:42.412412 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:42.412375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:43.770179 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:43.770134 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 12 20:19:43.770449 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:43.770225 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 12 20:19:43.770449 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:43.770253 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 12 20:19:44.638724 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:44.638685 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" event={"ID":"180a234a-680f-4ab3-babb-1d618d534ea3","Type":"ContainerStarted","Data":"037fa8815388f657700b23a8c6764b0b4963f3cb956aac068f6b71138ab3ad3a"} Jun 12 20:19:44.680911 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:44.680864 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" podStartSLOduration=1.838929354 podStartE2EDuration="4.680848559s" totalImagesPullingTime="2.841919205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:19:44.680099409 +0000 UTC m=+614.967606188" watchObservedRunningTime="2026-06-12 20:19:44.680848559 +0000 UTC m=+614.968355386" Jun 12 20:19:44.774498 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:44.774463 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:44.779543 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:44.779517 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:45.644138 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:45.644112 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:45.645171 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:45.645149 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6h5v" Jun 12 20:19:46.293749 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:46.293714 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:58.222224 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:58.222116 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:19:58.280424 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:19:58.280387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:05.738081 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.738046 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:05.836695 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.836663 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:05.858720 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.858685 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4vhmn"] Jun 12 20:20:05.871102 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.871073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" Jun 12 20:20:05.873333 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.873299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4vhmn"] Jun 12 20:20:05.875874 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.875841 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 20:20:05.876204 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.876184 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qm2pf\"" Jun 12 20:20:05.876376 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.876357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 20:20:05.933864 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.933815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9mt8\" (UniqueName: \"kubernetes.io/projected/0e307484-a6c8-4c19-9ff7-7cf07fe55f8f-kube-api-access-t9mt8\") pod \"kuadrant-operator-catalog-4vhmn\" (UID: \"0e307484-a6c8-4c19-9ff7-7cf07fe55f8f\") " pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" Jun 12 20:20:05.946099 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:05.946073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:06.035263 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.035175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9mt8\" (UniqueName: \"kubernetes.io/projected/0e307484-a6c8-4c19-9ff7-7cf07fe55f8f-kube-api-access-t9mt8\") pod \"kuadrant-operator-catalog-4vhmn\" (UID: \"0e307484-a6c8-4c19-9ff7-7cf07fe55f8f\") " pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" Jun 12 20:20:06.050718 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.050684 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9mt8\" (UniqueName: \"kubernetes.io/projected/0e307484-a6c8-4c19-9ff7-7cf07fe55f8f-kube-api-access-t9mt8\") pod \"kuadrant-operator-catalog-4vhmn\" (UID: \"0e307484-a6c8-4c19-9ff7-7cf07fe55f8f\") " pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" Jun 12 20:20:06.184850 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.184811 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" Jun 12 20:20:06.221523 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.221478 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4vhmn"] Jun 12 20:20:06.321242 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.321215 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4vhmn"] Jun 12 20:20:06.322971 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:20:06.322947 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e307484_a6c8_4c19_9ff7_7cf07fe55f8f.slice/crio-0798f795c8780324f39e282b73f4d8bc49cdec08af3b994021abd30960843d3b WatchSource:0}: Error finding container 0798f795c8780324f39e282b73f4d8bc49cdec08af3b994021abd30960843d3b: Status 404 returned error can't find the container with id 0798f795c8780324f39e282b73f4d8bc49cdec08af3b994021abd30960843d3b Jun 12 20:20:06.430800 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.430751 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t6qcx"] Jun 12 20:20:06.435692 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.435672 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" Jun 12 20:20:06.441681 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.441654 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t6qcx"] Jun 12 20:20:06.540231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.540197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkh88\" (UniqueName: \"kubernetes.io/projected/bc4e6016-3e33-403d-8355-e74679e34f25-kube-api-access-jkh88\") pod \"kuadrant-operator-catalog-t6qcx\" (UID: \"bc4e6016-3e33-403d-8355-e74679e34f25\") " pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" Jun 12 20:20:06.641223 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.641139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkh88\" (UniqueName: \"kubernetes.io/projected/bc4e6016-3e33-403d-8355-e74679e34f25-kube-api-access-jkh88\") pod \"kuadrant-operator-catalog-t6qcx\" (UID: \"bc4e6016-3e33-403d-8355-e74679e34f25\") " pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" Jun 12 20:20:06.650027 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.649997 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkh88\" (UniqueName: \"kubernetes.io/projected/bc4e6016-3e33-403d-8355-e74679e34f25-kube-api-access-jkh88\") pod \"kuadrant-operator-catalog-t6qcx\" (UID: \"bc4e6016-3e33-403d-8355-e74679e34f25\") " pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" Jun 12 20:20:06.747139 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.747106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" Jun 12 20:20:06.762265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.762237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" event={"ID":"0e307484-a6c8-4c19-9ff7-7cf07fe55f8f","Type":"ContainerStarted","Data":"0798f795c8780324f39e282b73f4d8bc49cdec08af3b994021abd30960843d3b"} Jun 12 20:20:06.886747 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:06.886702 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t6qcx"] Jun 12 20:20:06.889565 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:20:06.889539 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4e6016_3e33_403d_8355_e74679e34f25.slice/crio-d70bb581b02502d3c8899bb586b731609fc68d2d31964700fe37ced00f935b39 WatchSource:0}: Error finding container d70bb581b02502d3c8899bb586b731609fc68d2d31964700fe37ced00f935b39: Status 404 returned error can't find the container with id d70bb581b02502d3c8899bb586b731609fc68d2d31964700fe37ced00f935b39 Jun 12 20:20:07.769522 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:07.769489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" event={"ID":"bc4e6016-3e33-403d-8355-e74679e34f25","Type":"ContainerStarted","Data":"d70bb581b02502d3c8899bb586b731609fc68d2d31964700fe37ced00f935b39"} Jun 12 20:20:08.776195 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:08.776098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" event={"ID":"bc4e6016-3e33-403d-8355-e74679e34f25","Type":"ContainerStarted","Data":"05235adb27f2ab05ecd4a2370d97af8ba5f29fb57bcb7734652ff179e849a91a"} Jun 12 20:20:08.777511 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:08.777488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" event={"ID":"0e307484-a6c8-4c19-9ff7-7cf07fe55f8f","Type":"ContainerStarted","Data":"7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26"} Jun 12 20:20:08.777613 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:08.777589 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" podUID="0e307484-a6c8-4c19-9ff7-7cf07fe55f8f" containerName="registry-server" containerID="cri-o://7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26" gracePeriod=2 Jun 12 20:20:08.791621 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:08.791582 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" podStartSLOduration=1.180643066 podStartE2EDuration="2.791567943s" totalImagesPullingTime="1.610924877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:20:08.790685943 +0000 UTC m=+639.078192731" watchObservedRunningTime="2026-06-12 20:20:08.791567943 +0000 UTC m=+639.079074704" Jun 12 20:20:08.806287 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:08.806246 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" podStartSLOduration=1.631627162 podStartE2EDuration="3.806232314s" totalImagesPullingTime="2.174605152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:20:08.805224432 +0000 UTC m=+639.092731211" watchObservedRunningTime="2026-06-12 20:20:08.806232314 +0000 UTC m=+639.093739093" Jun 12 20:20:09.026733 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.026670 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" Jun 12 20:20:09.064841 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.064811 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9mt8\" (UniqueName: \"kubernetes.io/projected/0e307484-a6c8-4c19-9ff7-7cf07fe55f8f-kube-api-access-t9mt8\") pod \"0e307484-a6c8-4c19-9ff7-7cf07fe55f8f\" (UID: \"0e307484-a6c8-4c19-9ff7-7cf07fe55f8f\") " Jun 12 20:20:09.067080 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.067054 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e307484-a6c8-4c19-9ff7-7cf07fe55f8f-kube-api-access-t9mt8" (OuterVolumeSpecName: "kube-api-access-t9mt8") pod "0e307484-a6c8-4c19-9ff7-7cf07fe55f8f" (UID: "0e307484-a6c8-4c19-9ff7-7cf07fe55f8f"). InnerVolumeSpecName "kube-api-access-t9mt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:20:09.165720 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.165692 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9mt8\" (UniqueName: \"kubernetes.io/projected/0e307484-a6c8-4c19-9ff7-7cf07fe55f8f-kube-api-access-t9mt8\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:09.784213 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.784127 2578 generic.go:356] "Generic (PLEG): container finished" podID="0e307484-a6c8-4c19-9ff7-7cf07fe55f8f" containerID="7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26" exitCode=0 Jun 12 20:20:09.784213 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.784170 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" Jun 12 20:20:09.784702 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.784218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" event={"ID":"0e307484-a6c8-4c19-9ff7-7cf07fe55f8f","Type":"ContainerDied","Data":"7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26"} Jun 12 20:20:09.784702 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.784262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4vhmn" event={"ID":"0e307484-a6c8-4c19-9ff7-7cf07fe55f8f","Type":"ContainerDied","Data":"0798f795c8780324f39e282b73f4d8bc49cdec08af3b994021abd30960843d3b"} Jun 12 20:20:09.784702 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.784289 2578 scope.go:117] "RemoveContainer" containerID="7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26" Jun 12 20:20:09.793962 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.793941 2578 scope.go:117] "RemoveContainer" containerID="7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26" Jun 12 20:20:09.794217 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:20:09.794201 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26\": container with ID starting with 7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26 not found: ID does not exist" containerID="7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26" Jun 12 20:20:09.794267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.794225 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26"} err="failed to get container status \"7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26\": rpc error: code = NotFound desc = could not find container \"7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26\": container with ID starting with 7ecb438f0935238bbb6c8208a0f6ce928934d634387104ca4bf55371faeb3c26 not found: ID does not exist" Jun 12 20:20:09.804398 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.804372 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4vhmn"] Jun 12 20:20:09.810176 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:09.810155 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4vhmn"] Jun 12 20:20:10.169128 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:10.169095 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e307484-a6c8-4c19-9ff7-7cf07fe55f8f" path="/var/lib/kubelet/pods/0e307484-a6c8-4c19-9ff7-7cf07fe55f8f/volumes" Jun 12 20:20:12.344481 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:12.344443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:12.395936 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:12.395907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:16.747876 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:16.747845 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" Jun 12 20:20:16.748350 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:16.748183 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" Jun 12 20:20:16.771007 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:16.770977 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" Jun 12 20:20:16.843876 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:16.843851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t6qcx" Jun 12 20:20:20.803061 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.803021 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5"] Jun 12 20:20:20.803561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.803403 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e307484-a6c8-4c19-9ff7-7cf07fe55f8f" containerName="registry-server" Jun 12 20:20:20.803561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.803415 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e307484-a6c8-4c19-9ff7-7cf07fe55f8f" containerName="registry-server" Jun 12 20:20:20.803561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.803500 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e307484-a6c8-4c19-9ff7-7cf07fe55f8f" containerName="registry-server" Jun 12 20:20:20.806670 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.806654 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:20.809125 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.809110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rwn6j\"" Jun 12 20:20:20.814643 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.814621 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5"] Jun 12 20:20:20.864009 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.863979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sww4q\" (UniqueName: \"kubernetes.io/projected/02ad858b-13e8-41f9-a7c8-11f115cc11d7-kube-api-access-sww4q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:20.864191 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.864026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:20.864191 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.864104 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:20.964976 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.964941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:20.965171 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.965023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sww4q\" (UniqueName: \"kubernetes.io/projected/02ad858b-13e8-41f9-a7c8-11f115cc11d7-kube-api-access-sww4q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:20.965171 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.965073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:20.965347 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.965317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:20.965467 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.965447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:20.973638 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:20.973605 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sww4q\" (UniqueName: \"kubernetes.io/projected/02ad858b-13e8-41f9-a7c8-11f115cc11d7-kube-api-access-sww4q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:21.118019 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.117985 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:21.211051 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.211020 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b"] Jun 12 20:20:21.216354 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.216326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.222679 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.222624 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b"] Jun 12 20:20:21.280126 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.280095 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5"] Jun 12 20:20:21.282365 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:20:21.282312 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ad858b_13e8_41f9_a7c8_11f115cc11d7.slice/crio-8378e3b012af657a78623801461bce5bff52198a4770d1f87bff1478ad848dae WatchSource:0}: Error finding container 8378e3b012af657a78623801461bce5bff52198a4770d1f87bff1478ad848dae: Status 404 returned error can't find the container with id 8378e3b012af657a78623801461bce5bff52198a4770d1f87bff1478ad848dae Jun 12 20:20:21.368331 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.368226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nmll\" (UniqueName: \"kubernetes.io/projected/0eff3b0f-0279-4b5f-bf42-039c127fbf27-kube-api-access-7nmll\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.368331 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.368274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.368570 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.368328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.469062 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.469029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nmll\" (UniqueName: \"kubernetes.io/projected/0eff3b0f-0279-4b5f-bf42-039c127fbf27-kube-api-access-7nmll\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.469261 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.469075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.469261 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.469207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.469408 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.469394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.469521 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.469503 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.477736 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.477715 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nmll\" (UniqueName: \"kubernetes.io/projected/0eff3b0f-0279-4b5f-bf42-039c127fbf27-kube-api-access-7nmll\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.529849 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.529819 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:21.662139 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.662113 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b"] Jun 12 20:20:21.663627 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:20:21.663598 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eff3b0f_0279_4b5f_bf42_039c127fbf27.slice/crio-00e0a189cd6b81ea5332197041eea2ef9766664402aac8d5be3cf0cac455f7f1 WatchSource:0}: Error finding container 00e0a189cd6b81ea5332197041eea2ef9766664402aac8d5be3cf0cac455f7f1: Status 404 returned error can't find the container with id 00e0a189cd6b81ea5332197041eea2ef9766664402aac8d5be3cf0cac455f7f1 Jun 12 20:20:21.813144 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.813110 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n"] Jun 12 20:20:21.816999 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.816977 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:21.827465 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.827439 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n"] Jun 12 20:20:21.850135 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.850092 2578 generic.go:356] "Generic (PLEG): container finished" podID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerID="e1e8322cad6f95dc9b3e9a0df70caff7f48b97e68fc25e2645bf7f2c1d666bfc" exitCode=0 Jun 12 20:20:21.850290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.850175 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" event={"ID":"0eff3b0f-0279-4b5f-bf42-039c127fbf27","Type":"ContainerDied","Data":"e1e8322cad6f95dc9b3e9a0df70caff7f48b97e68fc25e2645bf7f2c1d666bfc"} Jun 12 20:20:21.850290 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.850217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" event={"ID":"0eff3b0f-0279-4b5f-bf42-039c127fbf27","Type":"ContainerStarted","Data":"00e0a189cd6b81ea5332197041eea2ef9766664402aac8d5be3cf0cac455f7f1"} Jun 12 20:20:21.850696 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.850680 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 20:20:21.851966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.851941 2578 generic.go:356] "Generic (PLEG): container finished" podID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerID="cec712c692f44cc0ca9332ab3579369f550a78c97a3ba0d17a3aadaaed9aab66" exitCode=0 Jun 12 20:20:21.852082 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.851978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" event={"ID":"02ad858b-13e8-41f9-a7c8-11f115cc11d7","Type":"ContainerDied","Data":"cec712c692f44cc0ca9332ab3579369f550a78c97a3ba0d17a3aadaaed9aab66"} Jun 12 20:20:21.852082 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.852023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" event={"ID":"02ad858b-13e8-41f9-a7c8-11f115cc11d7","Type":"ContainerStarted","Data":"8378e3b012af657a78623801461bce5bff52198a4770d1f87bff1478ad848dae"} Jun 12 20:20:21.872984 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.872960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhmg\" (UniqueName: \"kubernetes.io/projected/45d0351b-56f8-4804-856c-d9ac0c465d0b-kube-api-access-pmhmg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:21.873104 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.872998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:21.873104 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.873022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:21.974142 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.974051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhmg\" (UniqueName: \"kubernetes.io/projected/45d0351b-56f8-4804-856c-d9ac0c465d0b-kube-api-access-pmhmg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:21.974142 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.974096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:21.974372 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.974226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:21.974484 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.974464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:21.974539 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.974528 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:21.982845 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:21.982815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhmg\" (UniqueName: \"kubernetes.io/projected/45d0351b-56f8-4804-856c-d9ac0c465d0b-kube-api-access-pmhmg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:22.126808 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.126751 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:22.261779 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.261727 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n"] Jun 12 20:20:22.263553 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:20:22.263528 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d0351b_56f8_4804_856c_d9ac0c465d0b.slice/crio-2f75dbcfb911ceaf9967470f0b85ac9b3b9a71cae163507f768955e90ab6895c WatchSource:0}: Error finding container 2f75dbcfb911ceaf9967470f0b85ac9b3b9a71cae163507f768955e90ab6895c: Status 404 returned error can't find the container with id 2f75dbcfb911ceaf9967470f0b85ac9b3b9a71cae163507f768955e90ab6895c Jun 12 20:20:22.408623 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.406400 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl"] Jun 12 20:20:22.421446 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.410959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.425178 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.425144 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl"] Jun 12 20:20:22.479926 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.479892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppv5t\" (UniqueName: \"kubernetes.io/projected/0e96668c-80aa-416f-8de3-cf9cf1816658-kube-api-access-ppv5t\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.480077 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.479950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.480120 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.480097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.581700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.581601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.581700 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.581674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppv5t\" (UniqueName: \"kubernetes.io/projected/0e96668c-80aa-416f-8de3-cf9cf1816658-kube-api-access-ppv5t\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.582130 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.581743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.583219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.583193 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.583341 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.583222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.597371 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.597342 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppv5t\" (UniqueName: \"kubernetes.io/projected/0e96668c-80aa-416f-8de3-cf9cf1816658-kube-api-access-ppv5t\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.628046 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.628018 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:22.683970 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.683944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:22.730970 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.730938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:22.859595 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.859513 2578 generic.go:356] "Generic (PLEG): container finished" podID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerID="11a6bb46d078f507736721e1595d4d2fc4a99e64e10a4412813a5dd52e05f4c5" exitCode=0 Jun 12 20:20:22.860025 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.859607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" event={"ID":"0eff3b0f-0279-4b5f-bf42-039c127fbf27","Type":"ContainerDied","Data":"11a6bb46d078f507736721e1595d4d2fc4a99e64e10a4412813a5dd52e05f4c5"} Jun 12 20:20:22.861569 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.861548 2578 generic.go:356] "Generic (PLEG): container finished" podID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerID="be83f0773a87e488e6e8a6820ad1f8b437d0ab03e4b9ec6ff1bdd7a8eec2b263" exitCode=0 Jun 12 20:20:22.861659 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.861608 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" event={"ID":"02ad858b-13e8-41f9-a7c8-11f115cc11d7","Type":"ContainerDied","Data":"be83f0773a87e488e6e8a6820ad1f8b437d0ab03e4b9ec6ff1bdd7a8eec2b263"} Jun 12 20:20:22.863225 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.863207 2578 generic.go:356] "Generic (PLEG): container finished" podID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerID="ac23ea78d2aeaf8e383ec6473772484a1eddbf351c168075ccdd9022753b8509" exitCode=0 Jun 12 20:20:22.863313 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.863249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" event={"ID":"45d0351b-56f8-4804-856c-d9ac0c465d0b","Type":"ContainerDied","Data":"ac23ea78d2aeaf8e383ec6473772484a1eddbf351c168075ccdd9022753b8509"} Jun 12 20:20:22.863313 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.863286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" event={"ID":"45d0351b-56f8-4804-856c-d9ac0c465d0b","Type":"ContainerStarted","Data":"2f75dbcfb911ceaf9967470f0b85ac9b3b9a71cae163507f768955e90ab6895c"} Jun 12 20:20:22.869673 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:22.869653 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl"] Jun 12 20:20:22.872743 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:20:22.872722 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e96668c_80aa_416f_8de3_cf9cf1816658.slice/crio-2bf9a9deae54e3a769b3a117e9276f3a97c244a7488f65ba5db89f65a721c1af WatchSource:0}: Error finding container 2bf9a9deae54e3a769b3a117e9276f3a97c244a7488f65ba5db89f65a721c1af: Status 404 returned error can't find the container with id 2bf9a9deae54e3a769b3a117e9276f3a97c244a7488f65ba5db89f65a721c1af Jun 12 20:20:23.872916 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:23.872882 2578 generic.go:356] "Generic (PLEG): container finished" podID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerID="910336a8b9f3edc758e204f23bef119536abcfec28a4dd0f949d90bad8971d01" exitCode=0 Jun 12 20:20:23.873302 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:23.872970 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" event={"ID":"0eff3b0f-0279-4b5f-bf42-039c127fbf27","Type":"ContainerDied","Data":"910336a8b9f3edc758e204f23bef119536abcfec28a4dd0f949d90bad8971d01"} Jun 12 20:20:23.875034 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:23.875009 2578 generic.go:356] "Generic (PLEG): container finished" podID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerID="533e0df2ea8379345126a5ea12d74a378f604729fc6e4f27a13a7ba1fe7e1701" exitCode=0 Jun 12 20:20:23.875137 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:23.875085 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" event={"ID":"02ad858b-13e8-41f9-a7c8-11f115cc11d7","Type":"ContainerDied","Data":"533e0df2ea8379345126a5ea12d74a378f604729fc6e4f27a13a7ba1fe7e1701"} Jun 12 20:20:23.876404 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:23.876356 2578 generic.go:356] "Generic (PLEG): container finished" podID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerID="924dd5ace08a0b248d2b0b116eda77944b811440099f74f1f215b910f25baf64" exitCode=0 Jun 12 20:20:23.876481 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:23.876444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" event={"ID":"0e96668c-80aa-416f-8de3-cf9cf1816658","Type":"ContainerDied","Data":"924dd5ace08a0b248d2b0b116eda77944b811440099f74f1f215b910f25baf64"} Jun 12 20:20:23.876530 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:23.876486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" event={"ID":"0e96668c-80aa-416f-8de3-cf9cf1816658","Type":"ContainerStarted","Data":"2bf9a9deae54e3a769b3a117e9276f3a97c244a7488f65ba5db89f65a721c1af"} Jun 12 20:20:23.878417 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:23.878394 2578 generic.go:356] "Generic (PLEG): container finished" podID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerID="234945f714bffc682a6fa3690ec50443a80a9872d11c2c021168f9ee013a055d" exitCode=0 Jun 12 20:20:23.878518 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:23.878441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" event={"ID":"45d0351b-56f8-4804-856c-d9ac0c465d0b","Type":"ContainerDied","Data":"234945f714bffc682a6fa3690ec50443a80a9872d11c2c021168f9ee013a055d"} Jun 12 20:20:24.885300 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:24.885270 2578 generic.go:356] "Generic (PLEG): container finished" podID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerID="4162d0897dfad67eb18117529c6f6b7f9bf7ab4b368f0c6ffab32a423c1de9f2" exitCode=0 Jun 12 20:20:24.885691 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:24.885361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" event={"ID":"0e96668c-80aa-416f-8de3-cf9cf1816658","Type":"ContainerDied","Data":"4162d0897dfad67eb18117529c6f6b7f9bf7ab4b368f0c6ffab32a423c1de9f2"} Jun 12 20:20:24.887446 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:24.887421 2578 generic.go:356] "Generic (PLEG): container finished" podID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerID="0cb29fae8ccc5c67a04109bb66d8c32998832b49371811b2c0c660fa39a63075" exitCode=0 Jun 12 20:20:24.887539 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:24.887504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" event={"ID":"45d0351b-56f8-4804-856c-d9ac0c465d0b","Type":"ContainerDied","Data":"0cb29fae8ccc5c67a04109bb66d8c32998832b49371811b2c0c660fa39a63075"} Jun 12 20:20:25.039568 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.039544 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:25.109218 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.109188 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-bundle\") pod \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " Jun 12 20:20:25.109388 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.109241 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nmll\" (UniqueName: \"kubernetes.io/projected/0eff3b0f-0279-4b5f-bf42-039c127fbf27-kube-api-access-7nmll\") pod \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " Jun 12 20:20:25.109388 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.109335 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-util\") pod \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\" (UID: \"0eff3b0f-0279-4b5f-bf42-039c127fbf27\") " Jun 12 20:20:25.109719 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.109693 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-bundle" (OuterVolumeSpecName: "bundle") pod "0eff3b0f-0279-4b5f-bf42-039c127fbf27" (UID: "0eff3b0f-0279-4b5f-bf42-039c127fbf27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:20:25.111555 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.111537 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eff3b0f-0279-4b5f-bf42-039c127fbf27-kube-api-access-7nmll" (OuterVolumeSpecName: "kube-api-access-7nmll") pod "0eff3b0f-0279-4b5f-bf42-039c127fbf27" (UID: "0eff3b0f-0279-4b5f-bf42-039c127fbf27"). InnerVolumeSpecName "kube-api-access-7nmll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:20:25.117947 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.117908 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-util" (OuterVolumeSpecName: "util") pod "0eff3b0f-0279-4b5f-bf42-039c127fbf27" (UID: "0eff3b0f-0279-4b5f-bf42-039c127fbf27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:20:25.127472 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.127452 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:25.210308 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.210276 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-util\") pod \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " Jun 12 20:20:25.210463 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.210331 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-bundle\") pod \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " Jun 12 20:20:25.210463 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.210374 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sww4q\" (UniqueName: \"kubernetes.io/projected/02ad858b-13e8-41f9-a7c8-11f115cc11d7-kube-api-access-sww4q\") pod \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\" (UID: \"02ad858b-13e8-41f9-a7c8-11f115cc11d7\") " Jun 12 20:20:25.210567 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.210558 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:25.210605 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.210568 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff3b0f-0279-4b5f-bf42-039c127fbf27-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:25.210605 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.210576 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nmll\" (UniqueName: \"kubernetes.io/projected/0eff3b0f-0279-4b5f-bf42-039c127fbf27-kube-api-access-7nmll\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:25.210905 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.210876 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-bundle" (OuterVolumeSpecName: "bundle") pod "02ad858b-13e8-41f9-a7c8-11f115cc11d7" (UID: "02ad858b-13e8-41f9-a7c8-11f115cc11d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:20:25.212641 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.212621 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ad858b-13e8-41f9-a7c8-11f115cc11d7-kube-api-access-sww4q" (OuterVolumeSpecName: "kube-api-access-sww4q") pod "02ad858b-13e8-41f9-a7c8-11f115cc11d7" (UID: "02ad858b-13e8-41f9-a7c8-11f115cc11d7"). InnerVolumeSpecName "kube-api-access-sww4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:20:25.216110 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.216085 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-util" (OuterVolumeSpecName: "util") pod "02ad858b-13e8-41f9-a7c8-11f115cc11d7" (UID: "02ad858b-13e8-41f9-a7c8-11f115cc11d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:20:25.311146 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.311117 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:25.311146 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.311144 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02ad858b-13e8-41f9-a7c8-11f115cc11d7-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:25.311330 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.311153 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sww4q\" (UniqueName: \"kubernetes.io/projected/02ad858b-13e8-41f9-a7c8-11f115cc11d7-kube-api-access-sww4q\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:25.894991 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.894947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" event={"ID":"0eff3b0f-0279-4b5f-bf42-039c127fbf27","Type":"ContainerDied","Data":"00e0a189cd6b81ea5332197041eea2ef9766664402aac8d5be3cf0cac455f7f1"} Jun 12 20:20:25.895399 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.895012 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00e0a189cd6b81ea5332197041eea2ef9766664402aac8d5be3cf0cac455f7f1" Jun 12 20:20:25.895399 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.894972 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b" Jun 12 20:20:25.896979 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.896959 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" Jun 12 20:20:25.896979 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.896966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5" event={"ID":"02ad858b-13e8-41f9-a7c8-11f115cc11d7","Type":"ContainerDied","Data":"8378e3b012af657a78623801461bce5bff52198a4770d1f87bff1478ad848dae"} Jun 12 20:20:25.897180 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.897007 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8378e3b012af657a78623801461bce5bff52198a4770d1f87bff1478ad848dae" Jun 12 20:20:25.899271 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.899248 2578 generic.go:356] "Generic (PLEG): container finished" podID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerID="b490263020f584a68e0599f1282a08ae490602f289aaff887fc79fa1930db101" exitCode=0 Jun 12 20:20:25.899401 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:25.899380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" event={"ID":"0e96668c-80aa-416f-8de3-cf9cf1816658","Type":"ContainerDied","Data":"b490263020f584a68e0599f1282a08ae490602f289aaff887fc79fa1930db101"} Jun 12 20:20:26.031680 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.031651 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:26.117635 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.117599 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-util\") pod \"45d0351b-56f8-4804-856c-d9ac0c465d0b\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " Jun 12 20:20:26.117838 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.117657 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmhmg\" (UniqueName: \"kubernetes.io/projected/45d0351b-56f8-4804-856c-d9ac0c465d0b-kube-api-access-pmhmg\") pod \"45d0351b-56f8-4804-856c-d9ac0c465d0b\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " Jun 12 20:20:26.117838 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.117725 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-bundle\") pod \"45d0351b-56f8-4804-856c-d9ac0c465d0b\" (UID: \"45d0351b-56f8-4804-856c-d9ac0c465d0b\") " Jun 12 20:20:26.118417 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.118393 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-bundle" (OuterVolumeSpecName: "bundle") pod "45d0351b-56f8-4804-856c-d9ac0c465d0b" (UID: "45d0351b-56f8-4804-856c-d9ac0c465d0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:20:26.119978 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.119957 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d0351b-56f8-4804-856c-d9ac0c465d0b-kube-api-access-pmhmg" (OuterVolumeSpecName: "kube-api-access-pmhmg") pod "45d0351b-56f8-4804-856c-d9ac0c465d0b" (UID: "45d0351b-56f8-4804-856c-d9ac0c465d0b"). InnerVolumeSpecName "kube-api-access-pmhmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:20:26.122939 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.122912 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-util" (OuterVolumeSpecName: "util") pod "45d0351b-56f8-4804-856c-d9ac0c465d0b" (UID: "45d0351b-56f8-4804-856c-d9ac0c465d0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:20:26.218672 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.218646 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:26.218672 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.218670 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45d0351b-56f8-4804-856c-d9ac0c465d0b-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:26.218876 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.218679 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmhmg\" (UniqueName: \"kubernetes.io/projected/45d0351b-56f8-4804-856c-d9ac0c465d0b-kube-api-access-pmhmg\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:26.906809 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.906777 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" Jun 12 20:20:26.906809 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.906797 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n" event={"ID":"45d0351b-56f8-4804-856c-d9ac0c465d0b","Type":"ContainerDied","Data":"2f75dbcfb911ceaf9967470f0b85ac9b3b9a71cae163507f768955e90ab6895c"} Jun 12 20:20:26.907226 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:26.906843 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f75dbcfb911ceaf9967470f0b85ac9b3b9a71cae163507f768955e90ab6895c" Jun 12 20:20:27.037947 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.037919 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:27.125533 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.125498 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-util\") pod \"0e96668c-80aa-416f-8de3-cf9cf1816658\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " Jun 12 20:20:27.125693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.125574 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-bundle\") pod \"0e96668c-80aa-416f-8de3-cf9cf1816658\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " Jun 12 20:20:27.125693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.125648 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppv5t\" (UniqueName: \"kubernetes.io/projected/0e96668c-80aa-416f-8de3-cf9cf1816658-kube-api-access-ppv5t\") pod \"0e96668c-80aa-416f-8de3-cf9cf1816658\" (UID: \"0e96668c-80aa-416f-8de3-cf9cf1816658\") " Jun 12 20:20:27.126085 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.126061 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-bundle" (OuterVolumeSpecName: "bundle") pod "0e96668c-80aa-416f-8de3-cf9cf1816658" (UID: "0e96668c-80aa-416f-8de3-cf9cf1816658"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:20:27.127955 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.127927 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e96668c-80aa-416f-8de3-cf9cf1816658-kube-api-access-ppv5t" (OuterVolumeSpecName: "kube-api-access-ppv5t") pod "0e96668c-80aa-416f-8de3-cf9cf1816658" (UID: "0e96668c-80aa-416f-8de3-cf9cf1816658"). InnerVolumeSpecName "kube-api-access-ppv5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:20:27.131127 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.131101 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-util" (OuterVolumeSpecName: "util") pod "0e96668c-80aa-416f-8de3-cf9cf1816658" (UID: "0e96668c-80aa-416f-8de3-cf9cf1816658"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:20:27.226748 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.226647 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:27.226748 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.226686 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppv5t\" (UniqueName: \"kubernetes.io/projected/0e96668c-80aa-416f-8de3-cf9cf1816658-kube-api-access-ppv5t\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:27.226748 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.226700 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e96668c-80aa-416f-8de3-cf9cf1816658-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:20:27.914680 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.914652 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" Jun 12 20:20:27.914680 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.914674 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl" event={"ID":"0e96668c-80aa-416f-8de3-cf9cf1816658","Type":"ContainerDied","Data":"2bf9a9deae54e3a769b3a117e9276f3a97c244a7488f65ba5db89f65a721c1af"} Jun 12 20:20:27.915110 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:27.914717 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bf9a9deae54e3a769b3a117e9276f3a97c244a7488f65ba5db89f65a721c1af" Jun 12 20:20:33.230423 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:33.230380 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:33.332959 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:33.332927 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:33.433606 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:33.433568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:34.509363 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:34.509318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:37.177473 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177437 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm"] Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177817 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerName="util" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177831 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerName="util" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177841 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerName="pull" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177846 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerName="pull" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177857 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerName="extract" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177864 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerName="extract" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177878 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerName="pull" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177883 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerName="pull" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177889 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerName="extract" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177894 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerName="extract" Jun 12 20:20:37.177898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177903 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerName="pull" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177908 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerName="pull" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177915 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerName="pull" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177920 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerName="pull" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177925 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerName="extract" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177930 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerName="extract" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177935 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerName="util" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177940 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerName="util" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177945 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerName="util" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177950 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerName="util" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177954 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerName="extract" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177960 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerName="extract" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177965 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerName="util" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.177969 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerName="util" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.178022 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e96668c-80aa-416f-8de3-cf9cf1816658" containerName="extract" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.178030 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ad858b-13e8-41f9-a7c8-11f115cc11d7" containerName="extract" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.178036 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eff3b0f-0279-4b5f-bf42-039c127fbf27" containerName="extract" Jun 12 20:20:37.178265 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.178043 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d0351b-56f8-4804-856c-d9ac0c465d0b" containerName="extract" Jun 12 20:20:37.182390 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.182372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:20:37.185123 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.185101 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m9prf\"" Jun 12 20:20:37.195989 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.195967 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm"] Jun 12 20:20:37.317840 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.317801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdx6q\" (UniqueName: \"kubernetes.io/projected/0420b69c-1c0a-4740-9dda-ed63ecb81912-kube-api-access-sdx6q\") pod \"limitador-operator-controller-manager-859d7b78bd-l2lnm\" (UID: \"0420b69c-1c0a-4740-9dda-ed63ecb81912\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:20:37.418412 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.418372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdx6q\" (UniqueName: \"kubernetes.io/projected/0420b69c-1c0a-4740-9dda-ed63ecb81912-kube-api-access-sdx6q\") pod \"limitador-operator-controller-manager-859d7b78bd-l2lnm\" (UID: \"0420b69c-1c0a-4740-9dda-ed63ecb81912\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:20:37.441597 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.441521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdx6q\" (UniqueName: \"kubernetes.io/projected/0420b69c-1c0a-4740-9dda-ed63ecb81912-kube-api-access-sdx6q\") pod \"limitador-operator-controller-manager-859d7b78bd-l2lnm\" (UID: \"0420b69c-1c0a-4740-9dda-ed63ecb81912\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:20:37.492363 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.492315 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:20:37.631672 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.631645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm"] Jun 12 20:20:37.634202 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:20:37.634174 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0420b69c_1c0a_4740_9dda_ed63ecb81912.slice/crio-0090eddb2e78ba7539a40a5f563ba0d25e414fe81b0f29b94c9111aab31933c4 WatchSource:0}: Error finding container 0090eddb2e78ba7539a40a5f563ba0d25e414fe81b0f29b94c9111aab31933c4: Status 404 returned error can't find the container with id 0090eddb2e78ba7539a40a5f563ba0d25e414fe81b0f29b94c9111aab31933c4 Jun 12 20:20:37.974723 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:37.974690 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" event={"ID":"0420b69c-1c0a-4740-9dda-ed63ecb81912","Type":"ContainerStarted","Data":"0090eddb2e78ba7539a40a5f563ba0d25e414fe81b0f29b94c9111aab31933c4"} Jun 12 20:20:38.116163 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:38.116128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:38.218218 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:38.218182 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:39.986857 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:39.986816 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" event={"ID":"0420b69c-1c0a-4740-9dda-ed63ecb81912","Type":"ContainerStarted","Data":"b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7"} Jun 12 20:20:39.987302 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:39.986883 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:20:40.016405 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:40.016356 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" podStartSLOduration=1.101648653 podStartE2EDuration="3.016341295s" totalImagesPullingTime="1.914692642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:20:40.014570593 +0000 UTC m=+670.302077356" watchObservedRunningTime="2026-06-12 20:20:40.016341295 +0000 UTC m=+670.303848057" Jun 12 20:20:42.707315 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:42.707276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:43.103712 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:43.103678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:44.570950 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:44.570903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:46.114959 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:46.114924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:47.025873 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:47.025837 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:48.302066 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.302035 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm"] Jun 12 20:20:48.309007 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.308981 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" Jun 12 20:20:48.311864 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.311613 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 12 20:20:48.311864 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.311623 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j7zcx\"" Jun 12 20:20:48.314172 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.314149 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm"] Jun 12 20:20:48.403057 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.403019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvbj8\" (UniqueName: \"kubernetes.io/projected/e8b8126c-6a5e-4d46-a515-84e562c72a3e-kube-api-access-hvbj8\") pod \"dns-operator-controller-manager-864dd78c4c-5j8tm\" (UID: \"e8b8126c-6a5e-4d46-a515-84e562c72a3e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" Jun 12 20:20:48.503984 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.503954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvbj8\" (UniqueName: \"kubernetes.io/projected/e8b8126c-6a5e-4d46-a515-84e562c72a3e-kube-api-access-hvbj8\") pod \"dns-operator-controller-manager-864dd78c4c-5j8tm\" (UID: \"e8b8126c-6a5e-4d46-a515-84e562c72a3e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" Jun 12 20:20:48.511920 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.511893 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvbj8\" (UniqueName: \"kubernetes.io/projected/e8b8126c-6a5e-4d46-a515-84e562c72a3e-kube-api-access-hvbj8\") pod \"dns-operator-controller-manager-864dd78c4c-5j8tm\" (UID: \"e8b8126c-6a5e-4d46-a515-84e562c72a3e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" Jun 12 20:20:48.620505 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.620474 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" Jun 12 20:20:48.759207 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.759180 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm"] Jun 12 20:20:48.761157 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:20:48.761127 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b8126c_6a5e_4d46_a515_84e562c72a3e.slice/crio-4f8216414ec048eb3de217948c77ae5b91908ac9ba89af5580df577a2f8edc1f WatchSource:0}: Error finding container 4f8216414ec048eb3de217948c77ae5b91908ac9ba89af5580df577a2f8edc1f: Status 404 returned error can't find the container with id 4f8216414ec048eb3de217948c77ae5b91908ac9ba89af5580df577a2f8edc1f Jun 12 20:20:48.944673 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:48.944581 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:49.035175 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:49.035140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" event={"ID":"e8b8126c-6a5e-4d46-a515-84e562c72a3e","Type":"ContainerStarted","Data":"4f8216414ec048eb3de217948c77ae5b91908ac9ba89af5580df577a2f8edc1f"} Jun 12 20:20:50.308236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:50.308192 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:50.431707 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:50.431673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:50.995350 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:50.995327 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:20:51.048276 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:51.048242 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" event={"ID":"e8b8126c-6a5e-4d46-a515-84e562c72a3e","Type":"ContainerStarted","Data":"ea0d019e5c5e4f9f1b8744061cbb2f03e091947c74d30c44e3ea9bbc3472d7e6"} Jun 12 20:20:51.048478 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:51.048413 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" Jun 12 20:20:51.068067 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:51.067821 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" podStartSLOduration=0.871803058 podStartE2EDuration="3.067801505s" totalImagesPullingTime="2.195998447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:20:51.067781721 +0000 UTC m=+681.355288484" watchObservedRunningTime="2026-06-12 20:20:51.067801505 +0000 UTC m=+681.355308269" Jun 12 20:20:53.223817 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.223779 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6"] Jun 12 20:20:53.227377 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.227356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.229709 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.229673 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 12 20:20:53.229709 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.229691 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rwn6j\"" Jun 12 20:20:53.229910 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.229890 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 12 20:20:53.235250 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.234976 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6"] Jun 12 20:20:53.236780 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.236731 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:53.347259 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.347219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqrht\" (UniqueName: \"kubernetes.io/projected/166143a2-d29c-48a3-959e-16015c5c1713-kube-api-access-wqrht\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.347444 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.347357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/166143a2-d29c-48a3-959e-16015c5c1713-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.347444 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.347403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/166143a2-d29c-48a3-959e-16015c5c1713-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.448221 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.448184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/166143a2-d29c-48a3-959e-16015c5c1713-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.448396 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.448233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/166143a2-d29c-48a3-959e-16015c5c1713-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.448396 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:20:53.448354 2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 12 20:20:53.448470 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:20:53.448437 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/166143a2-d29c-48a3-959e-16015c5c1713-plugin-serving-cert podName:166143a2-d29c-48a3-959e-16015c5c1713 nodeName:}" failed. No retries permitted until 2026-06-12 20:20:53.948416381 +0000 UTC m=+684.235923127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/166143a2-d29c-48a3-959e-16015c5c1713-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-44tb6" (UID: "166143a2-d29c-48a3-959e-16015c5c1713") : secret "plugin-serving-cert" not found Jun 12 20:20:53.448514 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.448489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqrht\" (UniqueName: \"kubernetes.io/projected/166143a2-d29c-48a3-959e-16015c5c1713-kube-api-access-wqrht\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.448925 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.448908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/166143a2-d29c-48a3-959e-16015c5c1713-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.464514 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.464490 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqrht\" (UniqueName: \"kubernetes.io/projected/166143a2-d29c-48a3-959e-16015c5c1713-kube-api-access-wqrht\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.576752 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.576717 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:53.705745 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.705713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:53.807660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.807629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:20:53.954967 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.954860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/166143a2-d29c-48a3-959e-16015c5c1713-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:53.957961 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:53.957934 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/166143a2-d29c-48a3-959e-16015c5c1713-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-44tb6\" (UID: \"166143a2-d29c-48a3-959e-16015c5c1713\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:54.138704 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:54.138667 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" Jun 12 20:20:54.288121 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:54.288094 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6"] Jun 12 20:20:54.289320 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:20:54.289293 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod166143a2_d29c_48a3_959e_16015c5c1713.slice/crio-f68d06c9b2b9cc4358f0ed0c87145f427d62c1221cc8902c903ed20e9d43c866 WatchSource:0}: Error finding container f68d06c9b2b9cc4358f0ed0c87145f427d62c1221cc8902c903ed20e9d43c866: Status 404 returned error can't find the container with id f68d06c9b2b9cc4358f0ed0c87145f427d62c1221cc8902c903ed20e9d43c866 Jun 12 20:20:55.071030 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:20:55.070922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" event={"ID":"166143a2-d29c-48a3-959e-16015c5c1713","Type":"ContainerStarted","Data":"f68d06c9b2b9cc4358f0ed0c87145f427d62c1221cc8902c903ed20e9d43c866"} Jun 12 20:21:02.056276 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:02.056245 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5j8tm" Jun 12 20:21:02.388683 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:02.388646 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:02.504850 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:02.504820 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:03.609725 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.609691 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm"] Jun 12 20:21:03.610308 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.609934 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" containerName="manager" containerID="cri-o://b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7" gracePeriod=2 Jun 12 20:21:03.616788 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.616738 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm"] Jun 12 20:21:03.635063 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.635030 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj"] Jun 12 20:21:03.635528 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.635511 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" containerName="manager" Jun 12 20:21:03.635528 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.635530 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" containerName="manager" Jun 12 20:21:03.635648 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.635604 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" containerName="manager" Jun 12 20:21:03.640453 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.640432 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" Jun 12 20:21:03.642955 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:21:03.642805 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l2lnm\" is forbidden: User \"system:node:ip-10-0-136-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-62.ec2.internal' and this object" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:21:03.652236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.652211 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj"] Jun 12 20:21:03.703134 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.703097 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x"] Jun 12 20:21:03.708449 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.708425 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:03.710843 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:21:03.710811 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l2lnm\" is forbidden: User \"system:node:ip-10-0-136-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-62.ec2.internal' and this object" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:21:03.711309 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.711287 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-skmxt\"" Jun 12 20:21:03.717171 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.717146 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x"] Jun 12 20:21:03.748394 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.748362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb76r\" (UniqueName: \"kubernetes.io/projected/92355527-6f06-4759-aa4e-32b68f11c113-kube-api-access-kb76r\") pod \"limitador-operator-controller-manager-859d7b78bd-mx5cj\" (UID: \"92355527-6f06-4759-aa4e-32b68f11c113\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" Jun 12 20:21:03.849969 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.849922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlpwz\" (UniqueName: \"kubernetes.io/projected/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-kube-api-access-hlpwz\") pod \"kuadrant-operator-controller-manager-86878c769f-r275x\" (UID: \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:03.850167 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.850018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb76r\" (UniqueName: \"kubernetes.io/projected/92355527-6f06-4759-aa4e-32b68f11c113-kube-api-access-kb76r\") pod \"limitador-operator-controller-manager-859d7b78bd-mx5cj\" (UID: \"92355527-6f06-4759-aa4e-32b68f11c113\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" Jun 12 20:21:03.850167 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.850067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r275x\" (UID: \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:03.870291 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.870224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb76r\" (UniqueName: \"kubernetes.io/projected/92355527-6f06-4759-aa4e-32b68f11c113-kube-api-access-kb76r\") pod \"limitador-operator-controller-manager-859d7b78bd-mx5cj\" (UID: \"92355527-6f06-4759-aa4e-32b68f11c113\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" Jun 12 20:21:03.951070 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.951027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlpwz\" (UniqueName: \"kubernetes.io/projected/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-kube-api-access-hlpwz\") pod \"kuadrant-operator-controller-manager-86878c769f-r275x\" (UID: \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:03.951261 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.951137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r275x\" (UID: \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:03.951573 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.951548 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r275x\" (UID: \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:03.960327 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.960299 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlpwz\" (UniqueName: \"kubernetes.io/projected/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-kube-api-access-hlpwz\") pod \"kuadrant-operator-controller-manager-86878c769f-r275x\" (UID: \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:03.982105 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:03.982073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" Jun 12 20:21:04.021616 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:04.021577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:04.791521 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:04.791478 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:04.891049 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:04.891009 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:09.121545 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:09.121504 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:09.221143 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:09.221111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:11.557392 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:11.557347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:11.652293 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:11.652265 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:17.886834 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:17.886804 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:21:17.889312 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:21:17.889270 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l2lnm\" is forbidden: User \"system:node:ip-10-0-136-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-62.ec2.internal' and this object" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:21:17.906377 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:17.906343 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj"] Jun 12 20:21:17.907439 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:21:17.907411 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92355527_6f06_4759_aa4e_32b68f11c113.slice/crio-dc7cf8d94f04e1605c773e33d5bd1f5d201477d90d9bbbd3458668a2b8451f6f WatchSource:0}: Error finding container dc7cf8d94f04e1605c773e33d5bd1f5d201477d90d9bbbd3458668a2b8451f6f: Status 404 returned error can't find the container with id dc7cf8d94f04e1605c773e33d5bd1f5d201477d90d9bbbd3458668a2b8451f6f Jun 12 20:21:17.933116 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:17.933091 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x"] Jun 12 20:21:17.943877 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:21:17.943848 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0ea40f_dbf0_4b55_9191_2ec80f8dd93e.slice/crio-a6472a9e31e6434c8f77174c39e0778c6483d3ca4735551e1018a30f9eed1f11 WatchSource:0}: Error finding container a6472a9e31e6434c8f77174c39e0778c6483d3ca4735551e1018a30f9eed1f11: Status 404 returned error can't find the container with id a6472a9e31e6434c8f77174c39e0778c6483d3ca4735551e1018a30f9eed1f11 Jun 12 20:21:17.988173 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:17.988150 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdx6q\" (UniqueName: \"kubernetes.io/projected/0420b69c-1c0a-4740-9dda-ed63ecb81912-kube-api-access-sdx6q\") pod \"0420b69c-1c0a-4740-9dda-ed63ecb81912\" (UID: \"0420b69c-1c0a-4740-9dda-ed63ecb81912\") " Jun 12 20:21:17.990161 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:17.990135 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0420b69c-1c0a-4740-9dda-ed63ecb81912-kube-api-access-sdx6q" (OuterVolumeSpecName: "kube-api-access-sdx6q") pod "0420b69c-1c0a-4740-9dda-ed63ecb81912" (UID: "0420b69c-1c0a-4740-9dda-ed63ecb81912"). InnerVolumeSpecName "kube-api-access-sdx6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:21:18.089103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.089070 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdx6q\" (UniqueName: \"kubernetes.io/projected/0420b69c-1c0a-4740-9dda-ed63ecb81912-kube-api-access-sdx6q\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:21:18.169373 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.169323 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" path="/var/lib/kubelet/pods/0420b69c-1c0a-4740-9dda-ed63ecb81912/volumes" Jun 12 20:21:18.218631 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.218583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" event={"ID":"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e","Type":"ContainerStarted","Data":"a6472a9e31e6434c8f77174c39e0778c6483d3ca4735551e1018a30f9eed1f11"} Jun 12 20:21:18.220245 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.220217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" event={"ID":"166143a2-d29c-48a3-959e-16015c5c1713","Type":"ContainerStarted","Data":"df5009bd8ab158657d1a1103fdd3864c1279811fbd6894983cd97813ddf963db"} Jun 12 20:21:18.221525 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.221499 2578 generic.go:356] "Generic (PLEG): container finished" podID="0420b69c-1c0a-4740-9dda-ed63ecb81912" containerID="b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7" exitCode=0 Jun 12 20:21:18.221659 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.221540 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:21:18.221659 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.221581 2578 scope.go:117] "RemoveContainer" containerID="b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7" Jun 12 20:21:18.223258 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.223222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" event={"ID":"92355527-6f06-4759-aa4e-32b68f11c113","Type":"ContainerStarted","Data":"2d7d7ff091e39c6d1d38f72db28a5f0e3ac68e696d0d1e4d20d88884684062ff"} Jun 12 20:21:18.223374 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.223266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" event={"ID":"92355527-6f06-4759-aa4e-32b68f11c113","Type":"ContainerStarted","Data":"dc7cf8d94f04e1605c773e33d5bd1f5d201477d90d9bbbd3458668a2b8451f6f"} Jun 12 20:21:18.223374 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.223355 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" Jun 12 20:21:18.230687 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.230667 2578 scope.go:117] "RemoveContainer" containerID="b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7" Jun 12 20:21:18.230958 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:21:18.230933 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7\": container with ID starting with b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7 not found: ID does not exist" containerID="b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7" Jun 12 20:21:18.231043 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.230959 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7"} err="failed to get container status \"b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7\": rpc error: code = NotFound desc = could not find container \"b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7\": container with ID starting with b8fe969b82396e13ffa627018d48adc9754c88fa8792a3d2bae552ebb4d005a7 not found: ID does not exist" Jun 12 20:21:18.237012 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:21:18.236971 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l2lnm\" is forbidden: User \"system:node:ip-10-0-136-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-62.ec2.internal' and this object" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:21:18.237882 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.237845 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44tb6" podStartSLOduration=1.730110501 podStartE2EDuration="25.237834278s" totalImagesPullingTime="23.507723777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:21:18.23483603 +0000 UTC m=+708.522342805" watchObservedRunningTime="2026-06-12 20:21:18.237834278 +0000 UTC m=+708.525341037" Jun 12 20:21:18.260321 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:18.260276 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" podStartSLOduration=15.260259934 podStartE2EDuration="15.260259934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:21:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:21:18.258712497 +0000 UTC m=+708.546219260" watchObservedRunningTime="2026-06-12 20:21:18.260259934 +0000 UTC m=+708.547766696" Jun 12 20:21:20.167868 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:21:20.167827 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l2lnm\" is forbidden: User \"system:node:ip-10-0-136-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-62.ec2.internal' and this object" podUID="0420b69c-1c0a-4740-9dda-ed63ecb81912" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l2lnm" Jun 12 20:21:20.387854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:20.387821 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:20.486511 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:20.486428 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:22.082937 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:22.082901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:22.838399 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:22.838362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:22.939126 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:22.939043 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:23.255993 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:23.255910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" event={"ID":"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e","Type":"ContainerStarted","Data":"abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e"} Jun 12 20:21:23.256430 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:23.256020 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:23.277288 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:23.277227 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" podStartSLOduration=15.626685744 podStartE2EDuration="20.277211593s" totalImagesPullingTime="4.650525849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:21:23.273622992 +0000 UTC m=+713.561129752" watchObservedRunningTime="2026-06-12 20:21:23.277211593 +0000 UTC m=+713.564718355" Jun 12 20:21:27.192923 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:27.192888 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:27.294789 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:27.294737 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:29.231902 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:29.231868 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mx5cj" Jun 12 20:21:30.224298 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:30.224274 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:30.316068 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:30.316037 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:34.263425 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:34.263396 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:21:39.187570 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:39.187530 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:39.288434 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:39.288394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:39.793243 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:39.793206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:39.853933 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:39.853906 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:39.991781 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:39.991726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:40.047024 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:40.046951 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:41.858638 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:41.858605 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:41.924249 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:41.924214 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:50.626458 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:50.626426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:51.231153 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:51.231116 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:55.216116 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:55.216084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:55.317918 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:55.317879 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:55.416988 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:55.416957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:56.025858 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.025819 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bkgmz"] Jun 12 20:21:56.049656 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.049615 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bkgmz"] Jun 12 20:21:56.049863 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.049723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bkgmz" Jun 12 20:21:56.052253 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.052225 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-98pb2\"" Jun 12 20:21:56.061182 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.061155 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:56.115942 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.115887 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:21:56.120080 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.120046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrxnr\" (UniqueName: \"kubernetes.io/projected/c6ee6548-7449-4040-8d90-0d83e2c76aec-kube-api-access-lrxnr\") pod \"authorino-58cd955675-bkgmz\" (UID: \"c6ee6548-7449-4040-8d90-0d83e2c76aec\") " pod="kuadrant-system/authorino-58cd955675-bkgmz" Jun 12 20:21:56.221135 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.221099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrxnr\" (UniqueName: \"kubernetes.io/projected/c6ee6548-7449-4040-8d90-0d83e2c76aec-kube-api-access-lrxnr\") pod \"authorino-58cd955675-bkgmz\" (UID: \"c6ee6548-7449-4040-8d90-0d83e2c76aec\") " pod="kuadrant-system/authorino-58cd955675-bkgmz" Jun 12 20:21:56.229274 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.229243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrxnr\" (UniqueName: \"kubernetes.io/projected/c6ee6548-7449-4040-8d90-0d83e2c76aec-kube-api-access-lrxnr\") pod \"authorino-58cd955675-bkgmz\" (UID: \"c6ee6548-7449-4040-8d90-0d83e2c76aec\") " pod="kuadrant-system/authorino-58cd955675-bkgmz" Jun 12 20:21:56.359302 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.359265 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bkgmz" Jun 12 20:21:56.517553 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:56.517522 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bkgmz"] Jun 12 20:21:56.520452 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:21:56.520425 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6ee6548_7449_4040_8d90_0d83e2c76aec.slice/crio-1a309a9970d5bd9c3388fb0d17cd01b111dc39d8ea3b1265fe84d1327b7c7b17 WatchSource:0}: Error finding container 1a309a9970d5bd9c3388fb0d17cd01b111dc39d8ea3b1265fe84d1327b7c7b17: Status 404 returned error can't find the container with id 1a309a9970d5bd9c3388fb0d17cd01b111dc39d8ea3b1265fe84d1327b7c7b17 Jun 12 20:21:57.459104 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:21:57.459049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bkgmz" event={"ID":"c6ee6548-7449-4040-8d90-0d83e2c76aec","Type":"ContainerStarted","Data":"1a309a9970d5bd9c3388fb0d17cd01b111dc39d8ea3b1265fe84d1327b7c7b17"} Jun 12 20:22:00.479096 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:00.479050 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bkgmz" event={"ID":"c6ee6548-7449-4040-8d90-0d83e2c76aec","Type":"ContainerStarted","Data":"7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf"} Jun 12 20:22:00.495295 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:00.495250 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bkgmz" podStartSLOduration=1.2801872730000001 podStartE2EDuration="4.495235198s" totalImagesPullingTime="3.215047925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:22:00.494498202 +0000 UTC m=+750.782004955" watchObservedRunningTime="2026-06-12 20:22:00.495235198 +0000 UTC m=+750.782741959" Jun 12 20:22:00.524111 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:00.524079 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bkgmz"] Jun 12 20:22:02.490417 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:02.490352 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bkgmz" podUID="c6ee6548-7449-4040-8d90-0d83e2c76aec" containerName="authorino" containerID="cri-o://7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf" gracePeriod=30 Jun 12 20:22:02.747379 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:02.747321 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bkgmz" Jun 12 20:22:02.878143 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:02.878113 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrxnr\" (UniqueName: \"kubernetes.io/projected/c6ee6548-7449-4040-8d90-0d83e2c76aec-kube-api-access-lrxnr\") pod \"c6ee6548-7449-4040-8d90-0d83e2c76aec\" (UID: \"c6ee6548-7449-4040-8d90-0d83e2c76aec\") " Jun 12 20:22:02.880219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:02.880187 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ee6548-7449-4040-8d90-0d83e2c76aec-kube-api-access-lrxnr" (OuterVolumeSpecName: "kube-api-access-lrxnr") pod "c6ee6548-7449-4040-8d90-0d83e2c76aec" (UID: "c6ee6548-7449-4040-8d90-0d83e2c76aec"). InnerVolumeSpecName "kube-api-access-lrxnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:22:02.979139 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:02.979105 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrxnr\" (UniqueName: \"kubernetes.io/projected/c6ee6548-7449-4040-8d90-0d83e2c76aec-kube-api-access-lrxnr\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:22:03.496911 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:03.496880 2578 generic.go:356] "Generic (PLEG): container finished" podID="c6ee6548-7449-4040-8d90-0d83e2c76aec" containerID="7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf" exitCode=0 Jun 12 20:22:03.497406 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:03.496919 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bkgmz" Jun 12 20:22:03.497406 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:03.496976 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bkgmz" event={"ID":"c6ee6548-7449-4040-8d90-0d83e2c76aec","Type":"ContainerDied","Data":"7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf"} Jun 12 20:22:03.497406 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:03.497018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bkgmz" event={"ID":"c6ee6548-7449-4040-8d90-0d83e2c76aec","Type":"ContainerDied","Data":"1a309a9970d5bd9c3388fb0d17cd01b111dc39d8ea3b1265fe84d1327b7c7b17"} Jun 12 20:22:03.497406 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:03.497036 2578 scope.go:117] "RemoveContainer" containerID="7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf" Jun 12 20:22:03.507897 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:03.507749 2578 scope.go:117] "RemoveContainer" containerID="7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf" Jun 12 20:22:03.513635 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:22:03.513508 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf\": container with ID starting with 7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf not found: ID does not exist" containerID="7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf" Jun 12 20:22:03.513823 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:03.513655 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf"} err="failed to get container status \"7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf\": rpc error: code = NotFound desc = could not find container \"7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf\": container with ID starting with 7efd32652a7a926fff334d07d789bd26f93fab897c70ec763999b45869fed8cf not found: ID does not exist" Jun 12 20:22:03.521116 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:03.521092 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bkgmz"] Jun 12 20:22:03.524910 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:03.524889 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bkgmz"] Jun 12 20:22:04.169892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:04.169859 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6ee6548-7449-4040-8d90-0d83e2c76aec" path="/var/lib/kubelet/pods/c6ee6548-7449-4040-8d90-0d83e2c76aec/volumes" Jun 12 20:22:16.751002 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:16.750966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:22:17.858937 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:17.858903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:22:17.910566 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:17.910524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:22:27.687678 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:27.687630 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:22:27.790383 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:27.790353 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:22:27.932437 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:27.932404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:22:28.865585 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.865546 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb"] Jun 12 20:22:28.866150 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.866128 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ee6548-7449-4040-8d90-0d83e2c76aec" containerName="authorino" Jun 12 20:22:28.866231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.866153 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ee6548-7449-4040-8d90-0d83e2c76aec" containerName="authorino" Jun 12 20:22:28.866296 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.866256 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6ee6548-7449-4040-8d90-0d83e2c76aec" containerName="authorino" Jun 12 20:22:28.869859 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.869836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:28.872768 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.872726 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 20:22:28.873736 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.873715 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqvqx\"" Jun 12 20:22:28.873847 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.873737 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 20:22:28.880058 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.880035 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb"] Jun 12 20:22:28.911627 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.911591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:28.911627 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.911630 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:28.911832 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:28.911654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xctr2\" (UniqueName: \"kubernetes.io/projected/fdf87360-de39-4400-8182-2de06d7632d8-kube-api-access-xctr2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:29.013078 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.013036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:29.013078 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.013079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:29.013294 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.013102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctr2\" (UniqueName: \"kubernetes.io/projected/fdf87360-de39-4400-8182-2de06d7632d8-kube-api-access-xctr2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:29.013451 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.013432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:29.013495 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.013462 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:29.023793 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.023747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xctr2\" (UniqueName: \"kubernetes.io/projected/fdf87360-de39-4400-8182-2de06d7632d8-kube-api-access-xctr2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:29.180553 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.180462 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:29.318317 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.318286 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb"] Jun 12 20:22:29.319435 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:22:29.319412 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf87360_de39_4400_8182_2de06d7632d8.slice/crio-2e4a38cee6ee5eedd2d04ffe3caabf2fe5d2b25bd0fe877dea501a6df7b44c8f WatchSource:0}: Error finding container 2e4a38cee6ee5eedd2d04ffe3caabf2fe5d2b25bd0fe877dea501a6df7b44c8f: Status 404 returned error can't find the container with id 2e4a38cee6ee5eedd2d04ffe3caabf2fe5d2b25bd0fe877dea501a6df7b44c8f Jun 12 20:22:29.646673 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.646639 2578 generic.go:356] "Generic (PLEG): container finished" podID="fdf87360-de39-4400-8182-2de06d7632d8" containerID="870e64915c6d7a369fa6b03897d67d2e4fb2348c46faf574f0218ccbec6a65b0" exitCode=0 Jun 12 20:22:29.646876 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.646720 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" event={"ID":"fdf87360-de39-4400-8182-2de06d7632d8","Type":"ContainerDied","Data":"870e64915c6d7a369fa6b03897d67d2e4fb2348c46faf574f0218ccbec6a65b0"} Jun 12 20:22:29.646876 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:29.646788 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" event={"ID":"fdf87360-de39-4400-8182-2de06d7632d8","Type":"ContainerStarted","Data":"2e4a38cee6ee5eedd2d04ffe3caabf2fe5d2b25bd0fe877dea501a6df7b44c8f"} Jun 12 20:22:30.654616 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:30.654587 2578 generic.go:356] "Generic (PLEG): container finished" podID="fdf87360-de39-4400-8182-2de06d7632d8" containerID="c1f298478683a2a1fba7a5f6ea36e2e5fe287ac910b108d6bf5d237059241cb3" exitCode=0 Jun 12 20:22:30.655091 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:30.654668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" event={"ID":"fdf87360-de39-4400-8182-2de06d7632d8","Type":"ContainerDied","Data":"c1f298478683a2a1fba7a5f6ea36e2e5fe287ac910b108d6bf5d237059241cb3"} Jun 12 20:22:31.662116 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:31.662077 2578 generic.go:356] "Generic (PLEG): container finished" podID="fdf87360-de39-4400-8182-2de06d7632d8" containerID="ba776a75895fb79ef5398bff7cd38592f7724b1050835f0b32cedb210f4d51e5" exitCode=0 Jun 12 20:22:31.662562 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:31.662140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" event={"ID":"fdf87360-de39-4400-8182-2de06d7632d8","Type":"ContainerDied","Data":"ba776a75895fb79ef5398bff7cd38592f7724b1050835f0b32cedb210f4d51e5"} Jun 12 20:22:32.806015 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.805984 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:32.842961 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.842929 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xctr2\" (UniqueName: \"kubernetes.io/projected/fdf87360-de39-4400-8182-2de06d7632d8-kube-api-access-xctr2\") pod \"fdf87360-de39-4400-8182-2de06d7632d8\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " Jun 12 20:22:32.843111 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.843022 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-bundle\") pod \"fdf87360-de39-4400-8182-2de06d7632d8\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " Jun 12 20:22:32.843111 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.843073 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-util\") pod \"fdf87360-de39-4400-8182-2de06d7632d8\" (UID: \"fdf87360-de39-4400-8182-2de06d7632d8\") " Jun 12 20:22:32.843655 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.843621 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-bundle" (OuterVolumeSpecName: "bundle") pod "fdf87360-de39-4400-8182-2de06d7632d8" (UID: "fdf87360-de39-4400-8182-2de06d7632d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:22:32.845120 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.845088 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf87360-de39-4400-8182-2de06d7632d8-kube-api-access-xctr2" (OuterVolumeSpecName: "kube-api-access-xctr2") pod "fdf87360-de39-4400-8182-2de06d7632d8" (UID: "fdf87360-de39-4400-8182-2de06d7632d8"). InnerVolumeSpecName "kube-api-access-xctr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:22:32.849336 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.849312 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-util" (OuterVolumeSpecName: "util") pod "fdf87360-de39-4400-8182-2de06d7632d8" (UID: "fdf87360-de39-4400-8182-2de06d7632d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:22:32.943934 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.943858 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:22:32.943934 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.943885 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdf87360-de39-4400-8182-2de06d7632d8-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:22:32.943934 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:32.943897 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xctr2\" (UniqueName: \"kubernetes.io/projected/fdf87360-de39-4400-8182-2de06d7632d8-kube-api-access-xctr2\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:22:33.674744 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:33.674718 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" Jun 12 20:22:33.674924 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:33.674750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xrthb" event={"ID":"fdf87360-de39-4400-8182-2de06d7632d8","Type":"ContainerDied","Data":"2e4a38cee6ee5eedd2d04ffe3caabf2fe5d2b25bd0fe877dea501a6df7b44c8f"} Jun 12 20:22:33.674924 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:33.674810 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e4a38cee6ee5eedd2d04ffe3caabf2fe5d2b25bd0fe877dea501a6df7b44c8f" Jun 12 20:22:51.651425 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:51.651330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:22:51.748967 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:51.748929 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:22:52.035885 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.035795 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 20:22:52.036190 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.036177 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf87360-de39-4400-8182-2de06d7632d8" containerName="util" Jun 12 20:22:52.036231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.036191 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf87360-de39-4400-8182-2de06d7632d8" containerName="util" Jun 12 20:22:52.036231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.036203 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf87360-de39-4400-8182-2de06d7632d8" containerName="pull" Jun 12 20:22:52.036231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.036209 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf87360-de39-4400-8182-2de06d7632d8" containerName="pull" Jun 12 20:22:52.036231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.036226 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf87360-de39-4400-8182-2de06d7632d8" containerName="extract" Jun 12 20:22:52.036231 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.036231 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf87360-de39-4400-8182-2de06d7632d8" containerName="extract" Jun 12 20:22:52.036385 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.036288 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdf87360-de39-4400-8182-2de06d7632d8" containerName="extract" Jun 12 20:22:52.039442 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.039422 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 20:22:52.042585 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.042563 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 20:22:52.042711 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.042595 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 20:22:52.042711 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.042568 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 20:22:52.043410 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.043391 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-l9vll\"" Jun 12 20:22:52.050769 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.050728 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 20:22:52.118444 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.118405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d22kb\" (UniqueName: \"kubernetes.io/projected/174bb34b-9346-485f-8227-5c7f92930164-kube-api-access-d22kb\") pod \"maas-keycloak-0\" (UID: \"174bb34b-9346-485f-8227-5c7f92930164\") " pod="keycloak-system/maas-keycloak-0" Jun 12 20:22:52.218872 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.218842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d22kb\" (UniqueName: \"kubernetes.io/projected/174bb34b-9346-485f-8227-5c7f92930164-kube-api-access-d22kb\") pod \"maas-keycloak-0\" (UID: \"174bb34b-9346-485f-8227-5c7f92930164\") " pod="keycloak-system/maas-keycloak-0" Jun 12 20:22:52.227484 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.227453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d22kb\" (UniqueName: \"kubernetes.io/projected/174bb34b-9346-485f-8227-5c7f92930164-kube-api-access-d22kb\") pod \"maas-keycloak-0\" (UID: \"174bb34b-9346-485f-8227-5c7f92930164\") " pod="keycloak-system/maas-keycloak-0" Jun 12 20:22:52.351557 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.351526 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 20:22:52.491642 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.491611 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 20:22:52.492837 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:22:52.492809 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174bb34b_9346_485f_8227_5c7f92930164.slice/crio-dab325319e9ce372801cc9fff47dd69acded6be3af95a375deb080c25a9d9350 WatchSource:0}: Error finding container dab325319e9ce372801cc9fff47dd69acded6be3af95a375deb080c25a9d9350: Status 404 returned error can't find the container with id dab325319e9ce372801cc9fff47dd69acded6be3af95a375deb080c25a9d9350 Jun 12 20:22:52.782219 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:52.782129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"174bb34b-9346-485f-8227-5c7f92930164","Type":"ContainerStarted","Data":"dab325319e9ce372801cc9fff47dd69acded6be3af95a375deb080c25a9d9350"} Jun 12 20:22:57.818314 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:57.818255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"174bb34b-9346-485f-8227-5c7f92930164","Type":"ContainerStarted","Data":"b43d62a6a2142a0cf293fec1094043060014a7f49da2d98d97f214a2f2efaa93"} Jun 12 20:22:57.837917 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:57.837861 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.92926048 podStartE2EDuration="5.837846585s" totalImagesPullingTime="4.908586105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:22:57.835890181 +0000 UTC m=+808.123396963" watchObservedRunningTime="2026-06-12 20:22:57.837846585 +0000 UTC m=+808.125353346" Jun 12 20:22:58.351978 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:58.351941 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 20:22:58.353547 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:58.353504 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:22:59.352423 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:22:59.352369 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:00.352175 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:00.352136 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:01.352076 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:01.352024 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:02.352413 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:02.352373 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 20:23:02.353116 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:02.353002 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:03.352225 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:03.352175 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:04.353035 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:04.352983 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:05.352019 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:05.351971 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:06.352451 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:06.352407 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:07.352584 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:07.352525 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:08.352257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:08.352195 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:09.352442 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:09.352390 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 12 20:23:10.455088 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:10.455050 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 20:23:10.469045 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:10.468996 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 20:23:20.461733 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:20.461696 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 20:23:21.113208 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:21.113172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:23:22.267270 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:22.267234 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:23:27.390576 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.390541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:23:27.417129 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.417097 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fb5fb4cc6-4sqn8"] Jun 12 20:23:27.421588 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.421570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:27.424273 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.424254 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 20:23:27.424883 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.424865 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qs5p9\"" Jun 12 20:23:27.425255 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.425242 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 20:23:27.432943 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.432921 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fb5fb4cc6-4sqn8"] Jun 12 20:23:27.469515 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.469478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da2c835d-4c38-422d-87f3-38cc0e13548a-webhook-cert\") pod \"maas-controller-fb5fb4cc6-4sqn8\" (UID: \"da2c835d-4c38-422d-87f3-38cc0e13548a\") " pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:27.469669 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.469589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h9fp\" (UniqueName: \"kubernetes.io/projected/da2c835d-4c38-422d-87f3-38cc0e13548a-kube-api-access-7h9fp\") pod \"maas-controller-fb5fb4cc6-4sqn8\" (UID: \"da2c835d-4c38-422d-87f3-38cc0e13548a\") " pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:27.484746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.484716 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:23:27.570357 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.570316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da2c835d-4c38-422d-87f3-38cc0e13548a-webhook-cert\") pod \"maas-controller-fb5fb4cc6-4sqn8\" (UID: \"da2c835d-4c38-422d-87f3-38cc0e13548a\") " pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:27.570556 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.570397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h9fp\" (UniqueName: \"kubernetes.io/projected/da2c835d-4c38-422d-87f3-38cc0e13548a-kube-api-access-7h9fp\") pod \"maas-controller-fb5fb4cc6-4sqn8\" (UID: \"da2c835d-4c38-422d-87f3-38cc0e13548a\") " pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:27.573061 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.573033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da2c835d-4c38-422d-87f3-38cc0e13548a-webhook-cert\") pod \"maas-controller-fb5fb4cc6-4sqn8\" (UID: \"da2c835d-4c38-422d-87f3-38cc0e13548a\") " pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:27.581984 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.581947 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:23:27.584333 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.584309 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9464dbdb4-8hkzj"] Jun 12 20:23:27.584573 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.584556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h9fp\" (UniqueName: \"kubernetes.io/projected/da2c835d-4c38-422d-87f3-38cc0e13548a-kube-api-access-7h9fp\") pod \"maas-controller-fb5fb4cc6-4sqn8\" (UID: \"da2c835d-4c38-422d-87f3-38cc0e13548a\") " pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:27.588198 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.588181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:27.595831 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.595812 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9464dbdb4-8hkzj"] Jun 12 20:23:27.640460 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.640434 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:23:27.671692 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.671628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m85ln\" (UniqueName: \"kubernetes.io/projected/1a722393-1009-4b9e-aa0d-cafd083dd63b-kube-api-access-m85ln\") pod \"maas-controller-9464dbdb4-8hkzj\" (UID: \"1a722393-1009-4b9e-aa0d-cafd083dd63b\") " pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:27.671692 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.671681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a722393-1009-4b9e-aa0d-cafd083dd63b-webhook-cert\") pod \"maas-controller-9464dbdb4-8hkzj\" (UID: \"1a722393-1009-4b9e-aa0d-cafd083dd63b\") " pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:27.733686 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.733653 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:27.773100 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.773059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m85ln\" (UniqueName: \"kubernetes.io/projected/1a722393-1009-4b9e-aa0d-cafd083dd63b-kube-api-access-m85ln\") pod \"maas-controller-9464dbdb4-8hkzj\" (UID: \"1a722393-1009-4b9e-aa0d-cafd083dd63b\") " pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:27.773283 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.773173 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a722393-1009-4b9e-aa0d-cafd083dd63b-webhook-cert\") pod \"maas-controller-9464dbdb4-8hkzj\" (UID: \"1a722393-1009-4b9e-aa0d-cafd083dd63b\") " pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:27.776333 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.776306 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a722393-1009-4b9e-aa0d-cafd083dd63b-webhook-cert\") pod \"maas-controller-9464dbdb4-8hkzj\" (UID: \"1a722393-1009-4b9e-aa0d-cafd083dd63b\") " pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:27.781637 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.781596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m85ln\" (UniqueName: \"kubernetes.io/projected/1a722393-1009-4b9e-aa0d-cafd083dd63b-kube-api-access-m85ln\") pod \"maas-controller-9464dbdb4-8hkzj\" (UID: \"1a722393-1009-4b9e-aa0d-cafd083dd63b\") " pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:27.875300 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.875268 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fb5fb4cc6-4sqn8"] Jun 12 20:23:27.906970 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:27.906934 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:28.046511 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:28.046483 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9464dbdb4-8hkzj"] Jun 12 20:23:28.047377 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:23:28.047348 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a722393_1009_4b9e_aa0d_cafd083dd63b.slice/crio-8d80df995db0e4e01c4168baa234d2562fe5efe92fb29b538a8c206facfc3a3e WatchSource:0}: Error finding container 8d80df995db0e4e01c4168baa234d2562fe5efe92fb29b538a8c206facfc3a3e: Status 404 returned error can't find the container with id 8d80df995db0e4e01c4168baa234d2562fe5efe92fb29b538a8c206facfc3a3e Jun 12 20:23:28.050531 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:28.050504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" event={"ID":"da2c835d-4c38-422d-87f3-38cc0e13548a","Type":"ContainerStarted","Data":"8a0b5c49317b8eeb9f1fa44bae06c986ef196db7ffe933de96c59c8a1c40d739"} Jun 12 20:23:29.066037 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:29.065994 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" event={"ID":"1a722393-1009-4b9e-aa0d-cafd083dd63b","Type":"ContainerStarted","Data":"8d80df995db0e4e01c4168baa234d2562fe5efe92fb29b538a8c206facfc3a3e"} Jun 12 20:23:30.609980 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:30.609954 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 20:23:30.879015 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:30.878923 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:23:31.037014 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:31.036981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:23:31.084693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:31.084658 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" event={"ID":"da2c835d-4c38-422d-87f3-38cc0e13548a","Type":"ContainerStarted","Data":"9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd"} Jun 12 20:23:31.084926 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:31.084786 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:31.086335 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:31.086306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" event={"ID":"1a722393-1009-4b9e-aa0d-cafd083dd63b","Type":"ContainerStarted","Data":"34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd"} Jun 12 20:23:31.086478 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:31.086419 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:31.143817 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:31.143691 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" podStartSLOduration=1.402497527 podStartE2EDuration="4.143675885s" totalImagesPullingTime="2.741178358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:23:31.140003834 +0000 UTC m=+841.427510596" watchObservedRunningTime="2026-06-12 20:23:31.143675885 +0000 UTC m=+841.431182647" Jun 12 20:23:31.193029 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:31.192972 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" podStartSLOduration=1.6347776029999999 podStartE2EDuration="4.192955884s" totalImagesPullingTime="2.558178281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:23:31.188991062 +0000 UTC m=+841.476497825" watchObservedRunningTime="2026-06-12 20:23:31.192955884 +0000 UTC m=+841.480462646" Jun 12 20:23:42.098709 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.098680 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:23:42.099193 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.098749 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:42.161798 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.161743 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fb5fb4cc6-4sqn8"] Jun 12 20:23:42.161988 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.161964 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" podUID="da2c835d-4c38-422d-87f3-38cc0e13548a" containerName="manager" containerID="cri-o://9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd" gracePeriod=30 Jun 12 20:23:42.417095 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.417069 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:42.512029 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.511999 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h9fp\" (UniqueName: \"kubernetes.io/projected/da2c835d-4c38-422d-87f3-38cc0e13548a-kube-api-access-7h9fp\") pod \"da2c835d-4c38-422d-87f3-38cc0e13548a\" (UID: \"da2c835d-4c38-422d-87f3-38cc0e13548a\") " Jun 12 20:23:42.512224 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.512040 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da2c835d-4c38-422d-87f3-38cc0e13548a-webhook-cert\") pod \"da2c835d-4c38-422d-87f3-38cc0e13548a\" (UID: \"da2c835d-4c38-422d-87f3-38cc0e13548a\") " Jun 12 20:23:42.514336 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.514311 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2c835d-4c38-422d-87f3-38cc0e13548a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "da2c835d-4c38-422d-87f3-38cc0e13548a" (UID: "da2c835d-4c38-422d-87f3-38cc0e13548a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:23:42.514420 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.514398 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2c835d-4c38-422d-87f3-38cc0e13548a-kube-api-access-7h9fp" (OuterVolumeSpecName: "kube-api-access-7h9fp") pod "da2c835d-4c38-422d-87f3-38cc0e13548a" (UID: "da2c835d-4c38-422d-87f3-38cc0e13548a"). InnerVolumeSpecName "kube-api-access-7h9fp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:23:42.613182 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.613141 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h9fp\" (UniqueName: \"kubernetes.io/projected/da2c835d-4c38-422d-87f3-38cc0e13548a-kube-api-access-7h9fp\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:23:42.613182 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:42.613178 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da2c835d-4c38-422d-87f3-38cc0e13548a-webhook-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:23:43.156925 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:43.156889 2578 generic.go:356] "Generic (PLEG): container finished" podID="da2c835d-4c38-422d-87f3-38cc0e13548a" containerID="9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd" exitCode=0 Jun 12 20:23:43.157316 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:43.156952 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" Jun 12 20:23:43.157316 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:43.156972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" event={"ID":"da2c835d-4c38-422d-87f3-38cc0e13548a","Type":"ContainerDied","Data":"9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd"} Jun 12 20:23:43.157316 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:43.157072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb5fb4cc6-4sqn8" event={"ID":"da2c835d-4c38-422d-87f3-38cc0e13548a","Type":"ContainerDied","Data":"8a0b5c49317b8eeb9f1fa44bae06c986ef196db7ffe933de96c59c8a1c40d739"} Jun 12 20:23:43.157316 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:43.157100 2578 scope.go:117] "RemoveContainer" containerID="9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd" Jun 12 20:23:43.169371 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:43.169193 2578 scope.go:117] "RemoveContainer" containerID="9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd" Jun 12 20:23:43.169549 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:23:43.169529 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd\": container with ID starting with 9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd not found: ID does not exist" containerID="9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd" Jun 12 20:23:43.169598 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:43.169559 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd"} err="failed to get container status \"9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd\": rpc error: code = NotFound desc = could not find container \"9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd\": container with ID starting with 9383db9640d214ed39f83f1bca3acdbcebe72581bb19314331846f500d5bf1fd not found: ID does not exist" Jun 12 20:23:43.193779 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:43.193734 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fb5fb4cc6-4sqn8"] Jun 12 20:23:43.197379 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:43.197353 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fb5fb4cc6-4sqn8"] Jun 12 20:23:44.168742 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:23:44.168710 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2c835d-4c38-422d-87f3-38cc0e13548a" path="/var/lib/kubelet/pods/da2c835d-4c38-422d-87f3-38cc0e13548a/volumes" Jun 12 20:24:01.981976 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:01.981942 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:24:02.029328 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.029297 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6fd6c74797-ssrll"] Jun 12 20:24:02.029798 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.029782 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2c835d-4c38-422d-87f3-38cc0e13548a" containerName="manager" Jun 12 20:24:02.029852 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.029800 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2c835d-4c38-422d-87f3-38cc0e13548a" containerName="manager" Jun 12 20:24:02.029889 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.029865 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="da2c835d-4c38-422d-87f3-38cc0e13548a" containerName="manager" Jun 12 20:24:02.033104 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.033089 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.036183 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.036159 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 12 20:24:02.037504 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.037480 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qh4rz\"" Jun 12 20:24:02.044247 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.044226 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6fd6c74797-ssrll"] Jun 12 20:24:02.083965 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.083932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/575f916a-f7ca-4884-a7d0-05cac436ba6a-maas-api-tls\") pod \"maas-api-6fd6c74797-ssrll\" (UID: \"575f916a-f7ca-4884-a7d0-05cac436ba6a\") " pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.084133 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.083992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/575f916a-f7ca-4884-a7d0-05cac436ba6a-openshift-service-ca\") pod \"maas-api-6fd6c74797-ssrll\" (UID: \"575f916a-f7ca-4884-a7d0-05cac436ba6a\") " pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.084133 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.084077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzkqw\" (UniqueName: \"kubernetes.io/projected/575f916a-f7ca-4884-a7d0-05cac436ba6a-kube-api-access-mzkqw\") pod \"maas-api-6fd6c74797-ssrll\" (UID: \"575f916a-f7ca-4884-a7d0-05cac436ba6a\") " pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.090712 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.090672 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:24:02.185467 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.185432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/575f916a-f7ca-4884-a7d0-05cac436ba6a-maas-api-tls\") pod \"maas-api-6fd6c74797-ssrll\" (UID: \"575f916a-f7ca-4884-a7d0-05cac436ba6a\") " pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.185652 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.185506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/575f916a-f7ca-4884-a7d0-05cac436ba6a-openshift-service-ca\") pod \"maas-api-6fd6c74797-ssrll\" (UID: \"575f916a-f7ca-4884-a7d0-05cac436ba6a\") " pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.185652 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.185562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzkqw\" (UniqueName: \"kubernetes.io/projected/575f916a-f7ca-4884-a7d0-05cac436ba6a-kube-api-access-mzkqw\") pod \"maas-api-6fd6c74797-ssrll\" (UID: \"575f916a-f7ca-4884-a7d0-05cac436ba6a\") " pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.186240 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.186171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/575f916a-f7ca-4884-a7d0-05cac436ba6a-openshift-service-ca\") pod \"maas-api-6fd6c74797-ssrll\" (UID: \"575f916a-f7ca-4884-a7d0-05cac436ba6a\") " pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.187972 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.187950 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/575f916a-f7ca-4884-a7d0-05cac436ba6a-maas-api-tls\") pod \"maas-api-6fd6c74797-ssrll\" (UID: \"575f916a-f7ca-4884-a7d0-05cac436ba6a\") " pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.194587 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.194565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzkqw\" (UniqueName: \"kubernetes.io/projected/575f916a-f7ca-4884-a7d0-05cac436ba6a-kube-api-access-mzkqw\") pod \"maas-api-6fd6c74797-ssrll\" (UID: \"575f916a-f7ca-4884-a7d0-05cac436ba6a\") " pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.343989 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.343949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:02.419809 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.419739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:24:02.515474 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:24:02.515444 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575f916a_f7ca_4884_a7d0_05cac436ba6a.slice/crio-5810d43d7690220d962c868b553b109dbc7b7974e3f2ab04143d884d0afb7c62 WatchSource:0}: Error finding container 5810d43d7690220d962c868b553b109dbc7b7974e3f2ab04143d884d0afb7c62: Status 404 returned error can't find the container with id 5810d43d7690220d962c868b553b109dbc7b7974e3f2ab04143d884d0afb7c62 Jun 12 20:24:02.515612 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.515514 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6fd6c74797-ssrll"] Jun 12 20:24:02.525469 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.525443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:24:02.553201 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.553165 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-6tsnq"] Jun 12 20:24:02.557980 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.557957 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" Jun 12 20:24:02.560926 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.560904 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xlnnd\"" Jun 12 20:24:02.561118 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.561101 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 20:24:02.567675 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.567471 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-6tsnq"] Jun 12 20:24:02.590267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.590226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sdhp\" (UniqueName: \"kubernetes.io/projected/69a153de-8bef-43ec-97cd-17b2923b5b08-kube-api-access-5sdhp\") pod \"payload-processing-699b6cd6c-6tsnq\" (UID: \"69a153de-8bef-43ec-97cd-17b2923b5b08\") " pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" Jun 12 20:24:02.691747 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.691658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sdhp\" (UniqueName: \"kubernetes.io/projected/69a153de-8bef-43ec-97cd-17b2923b5b08-kube-api-access-5sdhp\") pod \"payload-processing-699b6cd6c-6tsnq\" (UID: \"69a153de-8bef-43ec-97cd-17b2923b5b08\") " pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" Jun 12 20:24:02.700022 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.699998 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sdhp\" (UniqueName: \"kubernetes.io/projected/69a153de-8bef-43ec-97cd-17b2923b5b08-kube-api-access-5sdhp\") pod \"payload-processing-699b6cd6c-6tsnq\" (UID: \"69a153de-8bef-43ec-97cd-17b2923b5b08\") " pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" Jun 12 20:24:02.872033 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:02.871996 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" Jun 12 20:24:03.021802 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:03.021773 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-6tsnq"] Jun 12 20:24:03.022735 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:24:03.022709 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a153de_8bef_43ec_97cd_17b2923b5b08.slice/crio-b412644c41e7a1a52b461694aedb72db26c8747ab374af000af90b1f8f8c0172 WatchSource:0}: Error finding container b412644c41e7a1a52b461694aedb72db26c8747ab374af000af90b1f8f8c0172: Status 404 returned error can't find the container with id b412644c41e7a1a52b461694aedb72db26c8747ab374af000af90b1f8f8c0172 Jun 12 20:24:03.275966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:03.275869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fd6c74797-ssrll" event={"ID":"575f916a-f7ca-4884-a7d0-05cac436ba6a","Type":"ContainerStarted","Data":"5810d43d7690220d962c868b553b109dbc7b7974e3f2ab04143d884d0afb7c62"} Jun 12 20:24:03.277455 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:03.277407 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" event={"ID":"69a153de-8bef-43ec-97cd-17b2923b5b08","Type":"ContainerStarted","Data":"b412644c41e7a1a52b461694aedb72db26c8747ab374af000af90b1f8f8c0172"} Jun 12 20:24:06.298981 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:06.298940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" event={"ID":"69a153de-8bef-43ec-97cd-17b2923b5b08","Type":"ContainerStarted","Data":"c0835691cc1a1e91f6a6eaadd918e6b390baaa9eaa00fde975c24a52d1d9f940"} Jun 12 20:24:06.299467 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:06.299098 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" Jun 12 20:24:06.300658 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:06.300631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fd6c74797-ssrll" event={"ID":"575f916a-f7ca-4884-a7d0-05cac436ba6a","Type":"ContainerStarted","Data":"bfe50099836d0da4bbc5faf37d94be1e0afea547a4800e605bc5b0f103d326f3"} Jun 12 20:24:06.300801 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:06.300749 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:06.316401 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:06.316360 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" podStartSLOduration=1.863819242 podStartE2EDuration="4.31634727s" totalImagesPullingTime="2.452528028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:24:06.315048401 +0000 UTC m=+876.602555165" watchObservedRunningTime="2026-06-12 20:24:06.31634727 +0000 UTC m=+876.603854031" Jun 12 20:24:06.335400 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:06.335351 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6fd6c74797-ssrll" podStartSLOduration=1.423326303 podStartE2EDuration="4.335336895s" totalImagesPullingTime="2.912010592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:24:06.332820854 +0000 UTC m=+876.620327615" watchObservedRunningTime="2026-06-12 20:24:06.335336895 +0000 UTC m=+876.622843656" Jun 12 20:24:12.311702 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:12.311673 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6fd6c74797-ssrll" Jun 12 20:24:13.533505 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:13.533466 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 20:24:13.533945 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:13.533685 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" containerID="cri-o://b43d62a6a2142a0cf293fec1094043060014a7f49da2d98d97f214a2f2efaa93" gracePeriod=30 Jun 12 20:24:15.353316 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:15.353284 2578 generic.go:356] "Generic (PLEG): container finished" podID="174bb34b-9346-485f-8227-5c7f92930164" containerID="b43d62a6a2142a0cf293fec1094043060014a7f49da2d98d97f214a2f2efaa93" exitCode=143 Jun 12 20:24:15.353688 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:15.353356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"174bb34b-9346-485f-8227-5c7f92930164","Type":"ContainerDied","Data":"b43d62a6a2142a0cf293fec1094043060014a7f49da2d98d97f214a2f2efaa93"} Jun 12 20:24:15.585074 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:15.585049 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:15.717092 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:15.716990 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d22kb\" (UniqueName: \"kubernetes.io/projected/174bb34b-9346-485f-8227-5c7f92930164-kube-api-access-d22kb\") pod \"174bb34b-9346-485f-8227-5c7f92930164\" (UID: \"174bb34b-9346-485f-8227-5c7f92930164\") " Jun 12 20:24:15.719323 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:15.719292 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/174bb34b-9346-485f-8227-5c7f92930164-kube-api-access-d22kb" (OuterVolumeSpecName: "kube-api-access-d22kb") pod "174bb34b-9346-485f-8227-5c7f92930164" (UID: "174bb34b-9346-485f-8227-5c7f92930164"). InnerVolumeSpecName "kube-api-access-d22kb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:24:15.818412 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:15.818370 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d22kb\" (UniqueName: \"kubernetes.io/projected/174bb34b-9346-485f-8227-5c7f92930164-kube-api-access-d22kb\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:24:16.361251 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.361220 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:16.361723 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.361277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"174bb34b-9346-485f-8227-5c7f92930164","Type":"ContainerDied","Data":"dab325319e9ce372801cc9fff47dd69acded6be3af95a375deb080c25a9d9350"} Jun 12 20:24:16.361723 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.361335 2578 scope.go:117] "RemoveContainer" containerID="b43d62a6a2142a0cf293fec1094043060014a7f49da2d98d97f214a2f2efaa93" Jun 12 20:24:16.381092 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.381061 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 20:24:16.385521 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.385497 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 20:24:16.408178 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.408155 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 20:24:16.408632 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.408614 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" Jun 12 20:24:16.408717 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.408633 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" Jun 12 20:24:16.408795 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.408743 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="174bb34b-9346-485f-8227-5c7f92930164" containerName="keycloak" Jun 12 20:24:16.413368 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.413350 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:16.416273 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.416249 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 20:24:16.416552 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.416524 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 20:24:16.416746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.416728 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 20:24:16.416913 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.416891 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 12 20:24:16.417487 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.417462 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-l9vll\"" Jun 12 20:24:16.427684 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.427611 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 20:24:16.526259 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.526218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/3a7bbb1c-0f64-41dd-baab-b5f9d158a094-test-realms\") pod \"maas-keycloak-0\" (UID: \"3a7bbb1c-0f64-41dd-baab-b5f9d158a094\") " pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:16.526437 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.526267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stz4n\" (UniqueName: \"kubernetes.io/projected/3a7bbb1c-0f64-41dd-baab-b5f9d158a094-kube-api-access-stz4n\") pod \"maas-keycloak-0\" (UID: \"3a7bbb1c-0f64-41dd-baab-b5f9d158a094\") " pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:16.627445 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.627411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stz4n\" (UniqueName: \"kubernetes.io/projected/3a7bbb1c-0f64-41dd-baab-b5f9d158a094-kube-api-access-stz4n\") pod \"maas-keycloak-0\" (UID: \"3a7bbb1c-0f64-41dd-baab-b5f9d158a094\") " pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:16.627583 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.627509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/3a7bbb1c-0f64-41dd-baab-b5f9d158a094-test-realms\") pod \"maas-keycloak-0\" (UID: \"3a7bbb1c-0f64-41dd-baab-b5f9d158a094\") " pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:16.628261 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.628244 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/3a7bbb1c-0f64-41dd-baab-b5f9d158a094-test-realms\") pod \"maas-keycloak-0\" (UID: \"3a7bbb1c-0f64-41dd-baab-b5f9d158a094\") " pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:16.636125 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.636088 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stz4n\" (UniqueName: \"kubernetes.io/projected/3a7bbb1c-0f64-41dd-baab-b5f9d158a094-kube-api-access-stz4n\") pod \"maas-keycloak-0\" (UID: \"3a7bbb1c-0f64-41dd-baab-b5f9d158a094\") " pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:16.730598 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.730510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:16.876839 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:24:16.876805 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7bbb1c_0f64_41dd_baab_b5f9d158a094.slice/crio-6bcd89a8aeeac7bbe56d41bdaa6e867f97afe4deb62963e6ef56c3a9f0f75dcb WatchSource:0}: Error finding container 6bcd89a8aeeac7bbe56d41bdaa6e867f97afe4deb62963e6ef56c3a9f0f75dcb: Status 404 returned error can't find the container with id 6bcd89a8aeeac7bbe56d41bdaa6e867f97afe4deb62963e6ef56c3a9f0f75dcb Jun 12 20:24:16.876980 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:16.876880 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 20:24:17.308854 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:17.308828 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-6tsnq" Jun 12 20:24:17.372794 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:17.372741 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3a7bbb1c-0f64-41dd-baab-b5f9d158a094","Type":"ContainerStarted","Data":"0841ca926e8aee05a27ff97951e516d8405eb4f095347fcb18be7064e21fb087"} Jun 12 20:24:17.373243 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:17.372820 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3a7bbb1c-0f64-41dd-baab-b5f9d158a094","Type":"ContainerStarted","Data":"6bcd89a8aeeac7bbe56d41bdaa6e867f97afe4deb62963e6ef56c3a9f0f75dcb"} Jun 12 20:24:17.402802 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:17.402728 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.069503066 podStartE2EDuration="1.402710869s" totalImagesPullingTime="333.207803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:24:17.401954981 +0000 UTC m=+887.689461764" watchObservedRunningTime="2026-06-12 20:24:17.402710869 +0000 UTC m=+887.690217632" Jun 12 20:24:17.731259 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:17.731162 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:17.732478 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:17.732447 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:18.172373 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:18.172328 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="174bb34b-9346-485f-8227-5c7f92930164" path="/var/lib/kubelet/pods/174bb34b-9346-485f-8227-5c7f92930164/volumes" Jun 12 20:24:18.731492 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:18.731438 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:19.731861 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:19.731806 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:20.732035 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:20.731977 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:21.731157 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:21.731089 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:22.732109 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:22.731619 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:23.731901 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:23.731845 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:24.731296 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:24.731245 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:25.732037 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:25.731990 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:26.731345 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:26.731294 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:26.731562 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:26.731341 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:27.731421 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:27.731368 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:28.732015 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:28.731967 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:29.731189 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:29.731142 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 12 20:24:30.196865 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:30.196835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:24:30.204106 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:30.204080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:24:30.208943 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:30.208919 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:24:30.215422 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:30.215401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:24:30.853790 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:30.853724 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:30.871663 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:30.871617 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="3a7bbb1c-0f64-41dd-baab-b5f9d158a094" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 20:24:35.268550 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:35.268511 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:24:38.238048 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:38.237995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:24:38.324743 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:38.324691 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:24:40.861093 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:40.861062 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 20:24:53.896188 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:53.896143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:24:53.987726 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:53.987689 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:24:58.282815 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:24:58.282776 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:25:11.780175 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:11.780143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:25:25.759830 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:25.759750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:25:32.864229 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:32.864182 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:25:38.727748 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.727717 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr"] Jun 12 20:25:38.731633 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.731610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.735074 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.735038 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t9mdh\"" Jun 12 20:25:38.735206 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.735033 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 20:25:38.735206 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.735037 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 20:25:38.735206 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.735044 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 12 20:25:38.743354 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.743322 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr"] Jun 12 20:25:38.753828 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.753804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:25:38.786394 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.786371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.786524 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.786447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f869b0fe-59f5-4646-b7df-63ab7aa60db8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.786524 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.786468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.786524 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.786485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccwjd\" (UniqueName: \"kubernetes.io/projected/f869b0fe-59f5-4646-b7df-63ab7aa60db8-kube-api-access-ccwjd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.786524 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.786501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.786703 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.786582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.888006 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.887975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f869b0fe-59f5-4646-b7df-63ab7aa60db8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.888006 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.888011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.888241 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.888032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccwjd\" (UniqueName: \"kubernetes.io/projected/f869b0fe-59f5-4646-b7df-63ab7aa60db8-kube-api-access-ccwjd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.888241 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.888054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.888241 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.888096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.888241 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.888126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.888487 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.888460 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.888557 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.888494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.888621 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.888568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.890856 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.890828 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f869b0fe-59f5-4646-b7df-63ab7aa60db8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.890988 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.890963 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f869b0fe-59f5-4646-b7df-63ab7aa60db8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:38.895828 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:38.895797 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccwjd\" (UniqueName: \"kubernetes.io/projected/f869b0fe-59f5-4646-b7df-63ab7aa60db8-kube-api-access-ccwjd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lccpr\" (UID: \"f869b0fe-59f5-4646-b7df-63ab7aa60db8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:39.045233 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:39.045140 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:39.188210 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:39.188171 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr"] Jun 12 20:25:39.189834 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:25:39.189809 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf869b0fe_59f5_4646_b7df_63ab7aa60db8.slice/crio-52ba306efb1c7d855e5fcfa9e5898826baca1649b9a2f8b405f39fba49851eaa WatchSource:0}: Error finding container 52ba306efb1c7d855e5fcfa9e5898826baca1649b9a2f8b405f39fba49851eaa: Status 404 returned error can't find the container with id 52ba306efb1c7d855e5fcfa9e5898826baca1649b9a2f8b405f39fba49851eaa Jun 12 20:25:39.192051 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:39.192032 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 20:25:39.938217 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:39.938153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" event={"ID":"f869b0fe-59f5-4646-b7df-63ab7aa60db8","Type":"ContainerStarted","Data":"52ba306efb1c7d855e5fcfa9e5898826baca1649b9a2f8b405f39fba49851eaa"} Jun 12 20:25:42.848580 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:42.848542 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:25:43.967331 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:43.967289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" event={"ID":"f869b0fe-59f5-4646-b7df-63ab7aa60db8","Type":"ContainerStarted","Data":"6b35f15a6901153406c999490b565f950a2a6d8860ec92dbb14ac12f42353a52"} Jun 12 20:25:45.982442 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:45.982407 2578 generic.go:356] "Generic (PLEG): container finished" podID="f869b0fe-59f5-4646-b7df-63ab7aa60db8" containerID="6b35f15a6901153406c999490b565f950a2a6d8860ec92dbb14ac12f42353a52" exitCode=0 Jun 12 20:25:45.982822 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:45.982483 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" event={"ID":"f869b0fe-59f5-4646-b7df-63ab7aa60db8","Type":"ContainerDied","Data":"6b35f15a6901153406c999490b565f950a2a6d8860ec92dbb14ac12f42353a52"} Jun 12 20:25:47.997170 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:47.997080 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" event={"ID":"f869b0fe-59f5-4646-b7df-63ab7aa60db8","Type":"ContainerStarted","Data":"a7e16de0fdc15f2bbf2bad0c8c3b24c6342cc714335e24f422f3c5e7ae0414e2"} Jun 12 20:25:48.016335 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:48.016283 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" podStartSLOduration=2.848473031 podStartE2EDuration="10.01626605s" totalImagesPullingTime="5.343727248s" totalInitContainerRuntime="1.824065771s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:25:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:25:48.01492745 +0000 UTC m=+978.302434231" watchObservedRunningTime="2026-06-12 20:25:48.01626605 +0000 UTC m=+978.303772806" Jun 12 20:25:49.045540 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:49.045502 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:49.045966 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:49.045564 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:49.058314 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:49.058289 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:25:50.019423 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:25:50.019391 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lccpr" Jun 12 20:26:37.368095 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:26:37.368055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:26:37.467483 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:26:37.467446 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:26:38.445819 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:26:38.445781 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:26:38.546225 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:26:38.546189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:27:18.318843 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:27:18.318736 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:27:53.195447 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:27:53.195415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:28:04.825237 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:04.825199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:28:04.918372 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:04.918338 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9464dbdb4-8hkzj"] Jun 12 20:28:04.918571 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:04.918544 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" podUID="1a722393-1009-4b9e-aa0d-cafd083dd63b" containerName="manager" containerID="cri-o://34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd" gracePeriod=30 Jun 12 20:28:05.184928 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.184900 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:28:05.308447 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.308413 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m85ln\" (UniqueName: \"kubernetes.io/projected/1a722393-1009-4b9e-aa0d-cafd083dd63b-kube-api-access-m85ln\") pod \"1a722393-1009-4b9e-aa0d-cafd083dd63b\" (UID: \"1a722393-1009-4b9e-aa0d-cafd083dd63b\") " Jun 12 20:28:05.308642 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.308492 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a722393-1009-4b9e-aa0d-cafd083dd63b-webhook-cert\") pod \"1a722393-1009-4b9e-aa0d-cafd083dd63b\" (UID: \"1a722393-1009-4b9e-aa0d-cafd083dd63b\") " Jun 12 20:28:05.310723 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.310692 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a722393-1009-4b9e-aa0d-cafd083dd63b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1a722393-1009-4b9e-aa0d-cafd083dd63b" (UID: "1a722393-1009-4b9e-aa0d-cafd083dd63b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:28:05.310865 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.310749 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a722393-1009-4b9e-aa0d-cafd083dd63b-kube-api-access-m85ln" (OuterVolumeSpecName: "kube-api-access-m85ln") pod "1a722393-1009-4b9e-aa0d-cafd083dd63b" (UID: "1a722393-1009-4b9e-aa0d-cafd083dd63b"). InnerVolumeSpecName "kube-api-access-m85ln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:28:05.409816 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.409694 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a722393-1009-4b9e-aa0d-cafd083dd63b-webhook-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:28:05.409816 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.409732 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m85ln\" (UniqueName: \"kubernetes.io/projected/1a722393-1009-4b9e-aa0d-cafd083dd63b-kube-api-access-m85ln\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:28:05.837814 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.837774 2578 generic.go:356] "Generic (PLEG): container finished" podID="1a722393-1009-4b9e-aa0d-cafd083dd63b" containerID="34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd" exitCode=0 Jun 12 20:28:05.837814 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.837810 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" Jun 12 20:28:05.838305 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.837853 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" event={"ID":"1a722393-1009-4b9e-aa0d-cafd083dd63b","Type":"ContainerDied","Data":"34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd"} Jun 12 20:28:05.838305 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.837909 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9464dbdb4-8hkzj" event={"ID":"1a722393-1009-4b9e-aa0d-cafd083dd63b","Type":"ContainerDied","Data":"8d80df995db0e4e01c4168baa234d2562fe5efe92fb29b538a8c206facfc3a3e"} Jun 12 20:28:05.838305 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.837935 2578 scope.go:117] "RemoveContainer" containerID="34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd" Jun 12 20:28:05.848018 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.848001 2578 scope.go:117] "RemoveContainer" containerID="34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd" Jun 12 20:28:05.848266 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:28:05.848250 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd\": container with ID starting with 34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd not found: ID does not exist" containerID="34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd" Jun 12 20:28:05.848334 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.848272 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd"} err="failed to get container status \"34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd\": rpc error: code = NotFound desc = could not find container \"34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd\": container with ID starting with 34d5a214d17f12fc872245322aa264f112aa3c8a6e427df1283a2c064c9154dd not found: ID does not exist" Jun 12 20:28:05.859686 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.859665 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9464dbdb4-8hkzj"] Jun 12 20:28:05.864567 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:05.864547 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9464dbdb4-8hkzj"] Jun 12 20:28:06.170469 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.170392 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a722393-1009-4b9e-aa0d-cafd083dd63b" path="/var/lib/kubelet/pods/1a722393-1009-4b9e-aa0d-cafd083dd63b/volumes" Jun 12 20:28:06.507411 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.507323 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:28:06.623573 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.623537 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9464dbdb4-gxt62"] Jun 12 20:28:06.623983 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.623970 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a722393-1009-4b9e-aa0d-cafd083dd63b" containerName="manager" Jun 12 20:28:06.624034 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.623985 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a722393-1009-4b9e-aa0d-cafd083dd63b" containerName="manager" Jun 12 20:28:06.624069 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.624058 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a722393-1009-4b9e-aa0d-cafd083dd63b" containerName="manager" Jun 12 20:28:06.628433 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.628412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:06.631739 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.631718 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 20:28:06.631874 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.631749 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 20:28:06.631874 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.631843 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qs5p9\"" Jun 12 20:28:06.637840 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.637818 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9464dbdb4-gxt62"] Jun 12 20:28:06.821751 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.821719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07a11e39-a7cf-465c-8233-6c7bb55ed44d-webhook-cert\") pod \"maas-controller-9464dbdb4-gxt62\" (UID: \"07a11e39-a7cf-465c-8233-6c7bb55ed44d\") " pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:06.821939 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.821916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2c4x\" (UniqueName: \"kubernetes.io/projected/07a11e39-a7cf-465c-8233-6c7bb55ed44d-kube-api-access-j2c4x\") pod \"maas-controller-9464dbdb4-gxt62\" (UID: \"07a11e39-a7cf-465c-8233-6c7bb55ed44d\") " pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:06.923010 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.922971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07a11e39-a7cf-465c-8233-6c7bb55ed44d-webhook-cert\") pod \"maas-controller-9464dbdb4-gxt62\" (UID: \"07a11e39-a7cf-465c-8233-6c7bb55ed44d\") " pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:06.923470 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.923084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2c4x\" (UniqueName: \"kubernetes.io/projected/07a11e39-a7cf-465c-8233-6c7bb55ed44d-kube-api-access-j2c4x\") pod \"maas-controller-9464dbdb4-gxt62\" (UID: \"07a11e39-a7cf-465c-8233-6c7bb55ed44d\") " pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:06.925623 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.925598 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07a11e39-a7cf-465c-8233-6c7bb55ed44d-webhook-cert\") pod \"maas-controller-9464dbdb4-gxt62\" (UID: \"07a11e39-a7cf-465c-8233-6c7bb55ed44d\") " pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:06.931126 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.931106 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2c4x\" (UniqueName: \"kubernetes.io/projected/07a11e39-a7cf-465c-8233-6c7bb55ed44d-kube-api-access-j2c4x\") pod \"maas-controller-9464dbdb4-gxt62\" (UID: \"07a11e39-a7cf-465c-8233-6c7bb55ed44d\") " pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:06.939971 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:06.939949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:07.077971 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:07.077939 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9464dbdb4-gxt62"] Jun 12 20:28:07.079265 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:28:07.079224 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a11e39_a7cf_465c_8233_6c7bb55ed44d.slice/crio-2171327e92b3d1463d2076ec68430c560a45949f0ee42a8724ebf8ea9d978ca3 WatchSource:0}: Error finding container 2171327e92b3d1463d2076ec68430c560a45949f0ee42a8724ebf8ea9d978ca3: Status 404 returned error can't find the container with id 2171327e92b3d1463d2076ec68430c560a45949f0ee42a8724ebf8ea9d978ca3 Jun 12 20:28:07.860931 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:07.860891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9464dbdb4-gxt62" event={"ID":"07a11e39-a7cf-465c-8233-6c7bb55ed44d","Type":"ContainerStarted","Data":"9145ba6f2b48489a71087fad14af170e26fa4037b52344ab52366f52f575449f"} Jun 12 20:28:07.861110 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:07.860947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9464dbdb4-gxt62" event={"ID":"07a11e39-a7cf-465c-8233-6c7bb55ed44d","Type":"ContainerStarted","Data":"2171327e92b3d1463d2076ec68430c560a45949f0ee42a8724ebf8ea9d978ca3"} Jun 12 20:28:07.861110 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:07.860969 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:07.880292 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:07.880241 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9464dbdb4-gxt62" podStartSLOduration=1.277259261 podStartE2EDuration="1.88022476s" totalImagesPullingTime="602.965499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:28:07.877889195 +0000 UTC m=+1118.165395964" watchObservedRunningTime="2026-06-12 20:28:07.88022476 +0000 UTC m=+1118.167731524" Jun 12 20:28:11.140607 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:11.140555 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:28:18.874205 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:18.874176 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9464dbdb4-gxt62" Jun 12 20:28:46.379068 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:46.379026 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:28:47.404272 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:47.404237 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:28:54.881790 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:28:54.881731 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:29:01.033724 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:01.033682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:29:01.133560 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:01.133530 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:29:30.252733 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:30.252706 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:29:30.260457 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:30.260433 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:29:30.260687 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:30.260668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:29:30.268200 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:30.268183 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:29:31.328737 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:31.328705 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:29:33.292448 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:33.292415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:29:33.385942 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:33.385908 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:29:57.319582 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:29:57.319524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:00.145678 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:00.145641 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688270-qbkgf"] Jun 12 20:30:00.149175 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:00.149160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" Jun 12 20:30:00.171967 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:00.171942 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688270-qbkgf"] Jun 12 20:30:00.252509 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:00.252470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42cjq\" (UniqueName: \"kubernetes.io/projected/56ed2629-a296-4540-bd83-f2b8a87844a9-kube-api-access-42cjq\") pod \"maas-api-key-cleanup-29688270-qbkgf\" (UID: \"56ed2629-a296-4540-bd83-f2b8a87844a9\") " pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" Jun 12 20:30:00.354020 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:00.353980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42cjq\" (UniqueName: \"kubernetes.io/projected/56ed2629-a296-4540-bd83-f2b8a87844a9-kube-api-access-42cjq\") pod \"maas-api-key-cleanup-29688270-qbkgf\" (UID: \"56ed2629-a296-4540-bd83-f2b8a87844a9\") " pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" Jun 12 20:30:00.363053 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:00.363022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42cjq\" (UniqueName: \"kubernetes.io/projected/56ed2629-a296-4540-bd83-f2b8a87844a9-kube-api-access-42cjq\") pod \"maas-api-key-cleanup-29688270-qbkgf\" (UID: \"56ed2629-a296-4540-bd83-f2b8a87844a9\") " pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" Jun 12 20:30:00.459444 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:00.459363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" Jun 12 20:30:00.598353 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:00.598324 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688270-qbkgf"] Jun 12 20:30:00.599655 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:30:00.599626 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ed2629_a296_4540_bd83_f2b8a87844a9.slice/crio-dae70b7c7f3483db2929940216e771826483b0e4ef035dca43305d3cc002e25b WatchSource:0}: Error finding container dae70b7c7f3483db2929940216e771826483b0e4ef035dca43305d3cc002e25b: Status 404 returned error can't find the container with id dae70b7c7f3483db2929940216e771826483b0e4ef035dca43305d3cc002e25b Jun 12 20:30:01.592693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:01.592661 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" event={"ID":"56ed2629-a296-4540-bd83-f2b8a87844a9","Type":"ContainerStarted","Data":"dae70b7c7f3483db2929940216e771826483b0e4ef035dca43305d3cc002e25b"} Jun 12 20:30:03.176972 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:03.176937 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:03.283654 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:03.283598 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:03.404704 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:03.404625 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:03.575184 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:03.575148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:03.609078 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:03.609038 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" event={"ID":"56ed2629-a296-4540-bd83-f2b8a87844a9","Type":"ContainerStarted","Data":"206799f78eb0d36d4c5d0afd0cf058919de149425b97b58437d70380f1ff598e"} Jun 12 20:30:03.632193 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:03.632138 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" podStartSLOduration=1.470540559 podStartE2EDuration="3.632121648s" totalImagesPullingTime="2.161581089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:30:03.62902528 +0000 UTC m=+1233.916532041" watchObservedRunningTime="2026-06-12 20:30:03.632121648 +0000 UTC m=+1233.919628410" Jun 12 20:30:03.654892 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:03.654797 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:04.616832 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:04.616790 2578 generic.go:356] "Generic (PLEG): container finished" podID="56ed2629-a296-4540-bd83-f2b8a87844a9" containerID="206799f78eb0d36d4c5d0afd0cf058919de149425b97b58437d70380f1ff598e" exitCode=0 Jun 12 20:30:04.617246 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:04.616889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" event={"ID":"56ed2629-a296-4540-bd83-f2b8a87844a9","Type":"ContainerDied","Data":"206799f78eb0d36d4c5d0afd0cf058919de149425b97b58437d70380f1ff598e"} Jun 12 20:30:05.762502 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:05.762475 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" Jun 12 20:30:05.907998 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:05.907886 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42cjq\" (UniqueName: \"kubernetes.io/projected/56ed2629-a296-4540-bd83-f2b8a87844a9-kube-api-access-42cjq\") pod \"56ed2629-a296-4540-bd83-f2b8a87844a9\" (UID: \"56ed2629-a296-4540-bd83-f2b8a87844a9\") " Jun 12 20:30:05.910181 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:05.910151 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56ed2629-a296-4540-bd83-f2b8a87844a9-kube-api-access-42cjq" (OuterVolumeSpecName: "kube-api-access-42cjq") pod "56ed2629-a296-4540-bd83-f2b8a87844a9" (UID: "56ed2629-a296-4540-bd83-f2b8a87844a9"). InnerVolumeSpecName "kube-api-access-42cjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:30:06.009283 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:06.009249 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42cjq\" (UniqueName: \"kubernetes.io/projected/56ed2629-a296-4540-bd83-f2b8a87844a9-kube-api-access-42cjq\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:30:06.630143 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:06.630112 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" Jun 12 20:30:06.630143 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:06.630117 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688270-qbkgf" event={"ID":"56ed2629-a296-4540-bd83-f2b8a87844a9","Type":"ContainerDied","Data":"dae70b7c7f3483db2929940216e771826483b0e4ef035dca43305d3cc002e25b"} Jun 12 20:30:06.630353 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:06.630170 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dae70b7c7f3483db2929940216e771826483b0e4ef035dca43305d3cc002e25b" Jun 12 20:30:20.207837 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:20.207726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:20.324722 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:20.324687 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:20.431839 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:20.431809 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:26.196709 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:26.196667 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:26.266216 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:26.266184 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:34.347525 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:34.347486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:34.446729 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:34.446691 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:34.546938 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:34.546902 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:34.669722 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:34.669629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:51.179688 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:51.179652 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:51.313391 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:51.313342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:51.416237 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:51.416204 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:57.558325 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:57.558285 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:30:57.626339 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:30:57.626304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:16.024387 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:16.024332 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:16.126161 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:16.126130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:16.222696 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:16.222660 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:22.198354 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:22.198317 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:22.276664 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:22.276634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:22.366051 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:22.365992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:22.459437 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:22.459359 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:22.566161 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:22.566126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:28.495437 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:28.495392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:28.597011 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:28.596979 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:31:49.584641 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:31:49.584543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:34:30.298035 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:34:30.298009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:34:30.306976 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:34:30.306950 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:34:30.306976 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:34:30.306964 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:34:30.318727 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:34:30.318707 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:34:42.525417 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:34:42.525354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:37:07.465784 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:37:07.465737 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:37:07.551057 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:37:07.551024 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:38:15.789488 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:15.789390 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x"] Jun 12 20:38:15.790378 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:15.789670 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" podUID="6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e" containerName="manager" containerID="cri-o://abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e" gracePeriod=10 Jun 12 20:38:16.055976 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.055917 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:38:16.119870 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.119841 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlpwz\" (UniqueName: \"kubernetes.io/projected/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-kube-api-access-hlpwz\") pod \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\" (UID: \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\") " Jun 12 20:38:16.120046 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.119902 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-extensions-socket-volume\") pod \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\" (UID: \"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e\") " Jun 12 20:38:16.120312 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.120283 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e" (UID: "6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:38:16.122188 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.122162 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-kube-api-access-hlpwz" (OuterVolumeSpecName: "kube-api-access-hlpwz") pod "6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e" (UID: "6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e"). InnerVolumeSpecName "kube-api-access-hlpwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:38:16.221192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.221149 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlpwz\" (UniqueName: \"kubernetes.io/projected/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-kube-api-access-hlpwz\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:38:16.221192 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.221182 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e-extensions-socket-volume\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:38:16.608534 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.608499 2578 generic.go:356] "Generic (PLEG): container finished" podID="6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e" containerID="abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e" exitCode=0 Jun 12 20:38:16.608734 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.608544 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" Jun 12 20:38:16.608734 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.608589 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" event={"ID":"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e","Type":"ContainerDied","Data":"abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e"} Jun 12 20:38:16.608734 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.608643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x" event={"ID":"6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e","Type":"ContainerDied","Data":"a6472a9e31e6434c8f77174c39e0778c6483d3ca4735551e1018a30f9eed1f11"} Jun 12 20:38:16.608734 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.608668 2578 scope.go:117] "RemoveContainer" containerID="abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e" Jun 12 20:38:16.618638 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.618619 2578 scope.go:117] "RemoveContainer" containerID="abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e" Jun 12 20:38:16.618985 ip-10-0-136-62 kubenswrapper[2578]: E0612 20:38:16.618962 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e\": container with ID starting with abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e not found: ID does not exist" containerID="abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e" Jun 12 20:38:16.619073 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.618989 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e"} err="failed to get container status \"abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e\": rpc error: code = NotFound desc = could not find container \"abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e\": container with ID starting with abbfe224cc784a2407c6e1e5fabd7ddf6837347ac9589c30937824a879163b8e not found: ID does not exist" Jun 12 20:38:16.633257 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.633218 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x"] Jun 12 20:38:16.636408 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:16.636385 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r275x"] Jun 12 20:38:18.169659 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:38:18.169623 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e" path="/var/lib/kubelet/pods/6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e/volumes" Jun 12 20:39:16.993079 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:16.993042 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2"] Jun 12 20:39:16.993561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:16.993474 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e" containerName="manager" Jun 12 20:39:16.993561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:16.993486 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e" containerName="manager" Jun 12 20:39:16.993561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:16.993495 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ed2629-a296-4540-bd83-f2b8a87844a9" containerName="cleanup" Jun 12 20:39:16.993561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:16.993501 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ed2629-a296-4540-bd83-f2b8a87844a9" containerName="cleanup" Jun 12 20:39:16.993693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:16.993579 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0ea40f-dbf0-4b55-9191-2ec80f8dd93e" containerName="manager" Jun 12 20:39:16.993693 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:16.993589 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ed2629-a296-4540-bd83-f2b8a87844a9" containerName="cleanup" Jun 12 20:39:16.996740 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:16.996725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:16.999364 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:16.999348 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-skmxt\"" Jun 12 20:39:17.014682 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.014655 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2"] Jun 12 20:39:17.082327 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.082290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf45d\" (UniqueName: \"kubernetes.io/projected/04f796c7-f7cb-4f85-8187-52e60e3cb440-kube-api-access-tf45d\") pod \"kuadrant-operator-controller-manager-86878c769f-z4kk2\" (UID: \"04f796c7-f7cb-4f85-8187-52e60e3cb440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:17.082511 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.082356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04f796c7-f7cb-4f85-8187-52e60e3cb440-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z4kk2\" (UID: \"04f796c7-f7cb-4f85-8187-52e60e3cb440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:17.183579 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.183545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04f796c7-f7cb-4f85-8187-52e60e3cb440-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z4kk2\" (UID: \"04f796c7-f7cb-4f85-8187-52e60e3cb440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:17.183804 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.183637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf45d\" (UniqueName: \"kubernetes.io/projected/04f796c7-f7cb-4f85-8187-52e60e3cb440-kube-api-access-tf45d\") pod \"kuadrant-operator-controller-manager-86878c769f-z4kk2\" (UID: \"04f796c7-f7cb-4f85-8187-52e60e3cb440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:17.184021 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.183999 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04f796c7-f7cb-4f85-8187-52e60e3cb440-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z4kk2\" (UID: \"04f796c7-f7cb-4f85-8187-52e60e3cb440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:17.200119 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.200093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf45d\" (UniqueName: \"kubernetes.io/projected/04f796c7-f7cb-4f85-8187-52e60e3cb440-kube-api-access-tf45d\") pod \"kuadrant-operator-controller-manager-86878c769f-z4kk2\" (UID: \"04f796c7-f7cb-4f85-8187-52e60e3cb440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:17.307100 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.307006 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:17.483165 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.483132 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2"] Jun 12 20:39:17.982747 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.982624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" event={"ID":"04f796c7-f7cb-4f85-8187-52e60e3cb440","Type":"ContainerStarted","Data":"6068663f6660c2ec10e56b6079d5078c95add74c1b322906cddc696c7fe4a8f2"} Jun 12 20:39:17.982747 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.982680 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" event={"ID":"04f796c7-f7cb-4f85-8187-52e60e3cb440","Type":"ContainerStarted","Data":"d51c9228378b3cd92456eb55040af10f7c0bd37583fb968f32bcbcf32e48c312"} Jun 12 20:39:17.982747 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:17.982736 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:28.991136 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:28.991103 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" Jun 12 20:39:29.014910 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:29.014850 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z4kk2" podStartSLOduration=13.01483003 podStartE2EDuration="13.01483003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:39:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:39:18.007578574 +0000 UTC m=+1788.295085354" watchObservedRunningTime="2026-06-12 20:39:29.01483003 +0000 UTC m=+1799.302336793" Jun 12 20:39:30.344126 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:30.344097 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:39:30.352176 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:30.352153 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:39:30.356948 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:30.356920 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:39:30.364398 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:39:30.364379 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:40:52.867855 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:40:52.867778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:41:16.548345 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:41:16.548306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:44:30.389633 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:44:30.389606 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:44:30.397900 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:44:30.397876 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:44:30.403833 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:44:30.403812 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:44:30.411632 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:44:30.411615 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:45:00.146722 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:00.146679 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688285-p5p76"] Jun 12 20:45:00.157489 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:00.157452 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" Jun 12 20:45:00.171554 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:00.171523 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688285-p5p76"] Jun 12 20:45:00.302518 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:00.302481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cw5j\" (UniqueName: \"kubernetes.io/projected/ba4826ea-1f32-45a7-9ee5-76e4732b4c12-kube-api-access-9cw5j\") pod \"maas-api-key-cleanup-29688285-p5p76\" (UID: \"ba4826ea-1f32-45a7-9ee5-76e4732b4c12\") " pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" Jun 12 20:45:00.403541 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:00.403455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cw5j\" (UniqueName: \"kubernetes.io/projected/ba4826ea-1f32-45a7-9ee5-76e4732b4c12-kube-api-access-9cw5j\") pod \"maas-api-key-cleanup-29688285-p5p76\" (UID: \"ba4826ea-1f32-45a7-9ee5-76e4732b4c12\") " pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" Jun 12 20:45:00.412292 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:00.412260 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cw5j\" (UniqueName: \"kubernetes.io/projected/ba4826ea-1f32-45a7-9ee5-76e4732b4c12-kube-api-access-9cw5j\") pod \"maas-api-key-cleanup-29688285-p5p76\" (UID: \"ba4826ea-1f32-45a7-9ee5-76e4732b4c12\") " pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" Jun 12 20:45:00.468236 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:00.468200 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" Jun 12 20:45:00.817078 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:00.817048 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688285-p5p76"] Jun 12 20:45:00.818431 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:45:00.818402 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4826ea_1f32_45a7_9ee5_76e4732b4c12.slice/crio-129667295f85030be60423c99edaadeac02a296bc0a96401b83a5654cab9b4a4 WatchSource:0}: Error finding container 129667295f85030be60423c99edaadeac02a296bc0a96401b83a5654cab9b4a4: Status 404 returned error can't find the container with id 129667295f85030be60423c99edaadeac02a296bc0a96401b83a5654cab9b4a4 Jun 12 20:45:01.053866 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:01.053832 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" event={"ID":"ba4826ea-1f32-45a7-9ee5-76e4732b4c12","Type":"ContainerStarted","Data":"129667295f85030be60423c99edaadeac02a296bc0a96401b83a5654cab9b4a4"} Jun 12 20:45:02.062419 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:02.062388 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba4826ea-1f32-45a7-9ee5-76e4732b4c12" containerID="26eb5920ce620c40fb2d0a03030ed695f1ce4d5e6a3635110e343588c722423b" exitCode=0 Jun 12 20:45:02.062872 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:02.062433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" event={"ID":"ba4826ea-1f32-45a7-9ee5-76e4732b4c12","Type":"ContainerDied","Data":"26eb5920ce620c40fb2d0a03030ed695f1ce4d5e6a3635110e343588c722423b"} Jun 12 20:45:03.212746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:03.212714 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" Jun 12 20:45:03.333374 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:03.333281 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cw5j\" (UniqueName: \"kubernetes.io/projected/ba4826ea-1f32-45a7-9ee5-76e4732b4c12-kube-api-access-9cw5j\") pod \"ba4826ea-1f32-45a7-9ee5-76e4732b4c12\" (UID: \"ba4826ea-1f32-45a7-9ee5-76e4732b4c12\") " Jun 12 20:45:03.335649 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:03.335623 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba4826ea-1f32-45a7-9ee5-76e4732b4c12-kube-api-access-9cw5j" (OuterVolumeSpecName: "kube-api-access-9cw5j") pod "ba4826ea-1f32-45a7-9ee5-76e4732b4c12" (UID: "ba4826ea-1f32-45a7-9ee5-76e4732b4c12"). InnerVolumeSpecName "kube-api-access-9cw5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:45:03.434592 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:03.434552 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cw5j\" (UniqueName: \"kubernetes.io/projected/ba4826ea-1f32-45a7-9ee5-76e4732b4c12-kube-api-access-9cw5j\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jun 12 20:45:04.078518 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:04.078483 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" event={"ID":"ba4826ea-1f32-45a7-9ee5-76e4732b4c12","Type":"ContainerDied","Data":"129667295f85030be60423c99edaadeac02a296bc0a96401b83a5654cab9b4a4"} Jun 12 20:45:04.078518 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:04.078502 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688285-p5p76" Jun 12 20:45:04.078729 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:04.078533 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="129667295f85030be60423c99edaadeac02a296bc0a96401b83a5654cab9b4a4" Jun 12 20:45:17.526521 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:17.526481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:45:17.632014 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:45:17.631944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:46:35.767919 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:46:35.767884 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:47:01.821778 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:47:01.821665 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:05.338043 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:05.337991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:08.638095 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:08.638060 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:32.927249 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:32.927166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:46.064225 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:46.064189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:47.673973 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:47.673936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:47.732064 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:47.732032 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:47.855599 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:47.855558 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:47.949202 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:47.949107 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:51.424433 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:51.424399 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:53.899052 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:53.899010 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:54.104925 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:54.104886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:54.200125 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:54.200041 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:48:55.586337 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:48:55.586276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:00.832676 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:00.832642 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:00.940846 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:00.940808 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:01.091044 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:01.090952 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:01.230433 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:01.230402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:01.372405 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:01.372317 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:04.450889 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:04.450850 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:07.293059 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:07.293025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:08.457258 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:08.457223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:08.558652 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:08.558615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:12.179574 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:12.179536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:14.668516 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:14.668481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:14.769490 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:14.769456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:26.559040 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:26.559010 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7476dfc89-spptl_e9658baf-abb5-4f07-bc2e-7349db068c6d/nginx/0.log" Jun 12 20:49:27.019913 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:27.019828 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6fd6c74797-ssrll_575f916a-f7ca-4884-a7d0-05cac436ba6a/maas-api/0.log" Jun 12 20:49:27.132012 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:27.131981 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688270-qbkgf_56ed2629-a296-4540-bd83-f2b8a87844a9/cleanup/0.log" Jun 12 20:49:27.236485 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:27.236453 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688285-p5p76_ba4826ea-1f32-45a7-9ee5-76e4732b4c12/cleanup/0.log" Jun 12 20:49:27.352898 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:27.352849 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9464dbdb4-gxt62_07a11e39-a7cf-465c-8233-6c7bb55ed44d/manager/0.log" Jun 12 20:49:27.688003 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:27.687927 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68bb89b4d-hfgkd_0fd67d75-aff3-4cb6-b513-474c7db52288/manager/0.log" Jun 12 20:49:27.696333 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:27.696308 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68bb89b4d-hfgkd_0fd67d75-aff3-4cb6-b513-474c7db52288/copy-manifests/0.log" Jun 12 20:49:28.797651 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:28.797618 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl_0e96668c-80aa-416f-8de3-cf9cf1816658/util/0.log" Jun 12 20:49:28.805444 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:28.805419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl_0e96668c-80aa-416f-8de3-cf9cf1816658/pull/0.log" Jun 12 20:49:28.812284 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:28.812257 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl_0e96668c-80aa-416f-8de3-cf9cf1816658/extract/0.log" Jun 12 20:49:28.925786 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:28.925745 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b_0eff3b0f-0279-4b5f-bf42-039c127fbf27/pull/0.log" Jun 12 20:49:28.934089 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:28.934069 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b_0eff3b0f-0279-4b5f-bf42-039c127fbf27/extract/0.log" Jun 12 20:49:28.940357 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:28.940339 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b_0eff3b0f-0279-4b5f-bf42-039c127fbf27/util/0.log" Jun 12 20:49:29.050052 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.049972 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n_45d0351b-56f8-4804-856c-d9ac0c465d0b/pull/0.log" Jun 12 20:49:29.056739 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.056713 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n_45d0351b-56f8-4804-856c-d9ac0c465d0b/extract/0.log" Jun 12 20:49:29.063152 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.063129 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n_45d0351b-56f8-4804-856c-d9ac0c465d0b/util/0.log" Jun 12 20:49:29.173107 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.173073 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5_02ad858b-13e8-41f9-a7c8-11f115cc11d7/util/0.log" Jun 12 20:49:29.180163 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.180136 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5_02ad858b-13e8-41f9-a7c8-11f115cc11d7/pull/0.log" Jun 12 20:49:29.186906 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.186887 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5_02ad858b-13e8-41f9-a7c8-11f115cc11d7/extract/0.log" Jun 12 20:49:29.528314 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.528284 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5j8tm_e8b8126c-6a5e-4d46-a515-84e562c72a3e/manager/0.log" Jun 12 20:49:29.636349 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.636318 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-44tb6_166143a2-d29c-48a3-959e-16015c5c1713/kuadrant-console-plugin/0.log" Jun 12 20:49:29.743715 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.743682 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t6qcx_bc4e6016-3e33-403d-8355-e74679e34f25/registry-server/0.log" Jun 12 20:49:29.865786 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:29.865746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z4kk2_04f796c7-f7cb-4f85-8187-52e60e3cb440/manager/0.log" Jun 12 20:49:30.111954 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:30.111925 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mx5cj_92355527-6f06-4759-aa4e-32b68f11c113/manager/0.log" Jun 12 20:49:30.431651 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:30.431549 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:49:30.439668 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:30.439399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:49:30.447937 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:30.447917 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:49:30.453851 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:30.453835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6h5v_180a234a-680f-4ab3-babb-1d618d534ea3/istio-proxy/0.log" Jun 12 20:49:30.455514 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:30.455499 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvp87_71b619f5-f2c4-4382-8564-6025440e82f6/ovn-acl-logging/0.log" Jun 12 20:49:31.151339 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:31.151309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6tsnq_69a153de-8bef-43ec-97cd-17b2923b5b08/payload-processing/0.log" Jun 12 20:49:31.266608 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:31.266585 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c794b8896-9ksmt_151621a4-fce8-4f46-8f41-9abc14e9a492/router/0.log" Jun 12 20:49:32.078913 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:32.078882 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-lccpr_f869b0fe-59f5-4646-b7df-63ab7aa60db8/storage-initializer/0.log" Jun 12 20:49:32.085921 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:32.085894 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-lccpr_f869b0fe-59f5-4646-b7df-63ab7aa60db8/main/0.log" Jun 12 20:49:36.366489 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:36.366454 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:36.464172 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:36.464129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" limit=1024 Jun 12 20:49:39.692788 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:39.692745 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dphcx_ae075d32-600c-42cd-a2ca-69a4c4eb198c/global-pull-secret-syncer/0.log" Jun 12 20:49:39.790162 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:39.790133 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f42p9_31a14749-8dd1-454f-9b36-3893cc1f6f11/konnectivity-agent/0.log" Jun 12 20:49:39.904240 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:39.904207 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-62.ec2.internal_a61968010ad14695ef0572eaf12e5b41/haproxy/0.log" Jun 12 20:49:44.963358 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:44.963325 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl_0e96668c-80aa-416f-8de3-cf9cf1816658/extract/0.log" Jun 12 20:49:44.994072 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:44.994047 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl_0e96668c-80aa-416f-8de3-cf9cf1816658/util/0.log" Jun 12 20:49:45.020031 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.020008 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nhvl_0e96668c-80aa-416f-8de3-cf9cf1816658/pull/0.log" Jun 12 20:49:45.052152 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.052129 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b_0eff3b0f-0279-4b5f-bf42-039c127fbf27/extract/0.log" Jun 12 20:49:45.084136 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.084112 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b_0eff3b0f-0279-4b5f-bf42-039c127fbf27/util/0.log" Jun 12 20:49:45.112591 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.112568 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qgm6b_0eff3b0f-0279-4b5f-bf42-039c127fbf27/pull/0.log" Jun 12 20:49:45.141705 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.141683 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n_45d0351b-56f8-4804-856c-d9ac0c465d0b/extract/0.log" Jun 12 20:49:45.169846 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.169825 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n_45d0351b-56f8-4804-856c-d9ac0c465d0b/util/0.log" Jun 12 20:49:45.192690 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.192663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dcm6n_45d0351b-56f8-4804-856c-d9ac0c465d0b/pull/0.log" Jun 12 20:49:45.223551 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.223477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5_02ad858b-13e8-41f9-a7c8-11f115cc11d7/extract/0.log" Jun 12 20:49:45.258605 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.258583 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5_02ad858b-13e8-41f9-a7c8-11f115cc11d7/util/0.log" Jun 12 20:49:45.281277 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.281254 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sv7r5_02ad858b-13e8-41f9-a7c8-11f115cc11d7/pull/0.log" Jun 12 20:49:45.713871 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.713831 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5j8tm_e8b8126c-6a5e-4d46-a515-84e562c72a3e/manager/0.log" Jun 12 20:49:45.743011 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.742987 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-44tb6_166143a2-d29c-48a3-959e-16015c5c1713/kuadrant-console-plugin/0.log" Jun 12 20:49:45.815888 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.815853 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t6qcx_bc4e6016-3e33-403d-8355-e74679e34f25/registry-server/0.log" Jun 12 20:49:45.896611 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.896575 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z4kk2_04f796c7-f7cb-4f85-8187-52e60e3cb440/manager/0.log" Jun 12 20:49:45.996105 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:45.996014 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mx5cj_92355527-6f06-4759-aa4e-32b68f11c113/manager/0.log" Jun 12 20:49:47.680374 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:47.680295 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e/alertmanager/0.log" Jun 12 20:49:47.711444 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:47.711418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e/config-reloader/0.log" Jun 12 20:49:47.746141 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:47.746118 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e/kube-rbac-proxy-web/0.log" Jun 12 20:49:47.772943 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:47.772919 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e/kube-rbac-proxy/0.log" Jun 12 20:49:47.798660 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:47.798637 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e/kube-rbac-proxy-metric/0.log" Jun 12 20:49:47.841089 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:47.841054 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e/prom-label-proxy/0.log" Jun 12 20:49:47.871153 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:47.871129 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dd42dfa1-e12a-4cdc-b03e-bfb00d0b180e/init-config-reloader/0.log" Jun 12 20:49:47.921375 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:47.921337 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-q5fcb_755a0d15-7a20-48ab-9a45-806c3e3f5249/cluster-monitoring-operator/0.log" Jun 12 20:49:48.269857 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.269825 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lhs9q_cd69d700-ec30-40f8-b865-5ba80feecbf1/node-exporter/0.log" Jun 12 20:49:48.297989 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.297921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lhs9q_cd69d700-ec30-40f8-b865-5ba80feecbf1/kube-rbac-proxy/0.log" Jun 12 20:49:48.321504 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.321477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lhs9q_cd69d700-ec30-40f8-b865-5ba80feecbf1/init-textfile/0.log" Jun 12 20:49:48.665670 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.665643 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-2s4j6_419b3646-32a9-45c8-956b-a37898211d10/prometheus-operator-admission-webhook/0.log" Jun 12 20:49:48.698090 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.698063 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d68c985f7-jbr7k_5205dbbd-abf3-4a03-b23d-993a3f845d31/telemeter-client/0.log" Jun 12 20:49:48.723455 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.723430 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d68c985f7-jbr7k_5205dbbd-abf3-4a03-b23d-993a3f845d31/reload/0.log" Jun 12 20:49:48.757410 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.757385 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d68c985f7-jbr7k_5205dbbd-abf3-4a03-b23d-993a3f845d31/kube-rbac-proxy/0.log" Jun 12 20:49:48.791077 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.791051 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/thanos-query/0.log" Jun 12 20:49:48.815925 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.815888 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/kube-rbac-proxy-web/0.log" Jun 12 20:49:48.841225 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.841203 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/kube-rbac-proxy/0.log" Jun 12 20:49:48.863537 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.863516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/prom-label-proxy/0.log" Jun 12 20:49:48.885363 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.885337 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/kube-rbac-proxy-rules/0.log" Jun 12 20:49:48.909697 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:48.909680 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756ddf58f8-lz5rr_4183387d-c0c6-4d36-bd86-52834bc36c57/kube-rbac-proxy-metrics/0.log" Jun 12 20:49:50.073186 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.073146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-55qkf_93e94b98-02b4-40a6-8f99-7fbea15426d3/networking-console-plugin/0.log" Jun 12 20:49:50.750614 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.750576 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/1.log" Jun 12 20:49:50.755467 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.755447 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fvp5c_99327431-e243-4443-a09e-6a8f120dfb6e/console-operator/2.log" Jun 12 20:49:50.803451 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.803417 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv"] Jun 12 20:49:50.803962 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.803940 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4826ea-1f32-45a7-9ee5-76e4732b4c12" containerName="cleanup" Jun 12 20:49:50.803962 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.803963 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4826ea-1f32-45a7-9ee5-76e4732b4c12" containerName="cleanup" Jun 12 20:49:50.804129 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.804082 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba4826ea-1f32-45a7-9ee5-76e4732b4c12" containerName="cleanup" Jun 12 20:49:50.807580 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.807561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:50.810267 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.810246 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wqgjv\"/\"openshift-service-ca.crt\"" Jun 12 20:49:50.810368 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.810293 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wqgjv\"/\"kube-root-ca.crt\"" Jun 12 20:49:50.811169 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.811151 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wqgjv\"/\"default-dockercfg-d52hd\"" Jun 12 20:49:50.819189 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.819152 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv"] Jun 12 20:49:50.967561 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.967530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcj8k\" (UniqueName: \"kubernetes.io/projected/b54953ea-8e34-4290-a1cd-4da2800c6ade-kube-api-access-tcj8k\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:50.967735 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.967590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-lib-modules\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:50.967735 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.967646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-sys\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:50.967735 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.967680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-proc\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:50.967735 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:50.967713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-podres\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.068583 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.068547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj8k\" (UniqueName: \"kubernetes.io/projected/b54953ea-8e34-4290-a1cd-4da2800c6ade-kube-api-access-tcj8k\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.068743 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.068638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-lib-modules\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.068743 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.068666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-sys\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.068743 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.068696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-proc\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.068743 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.068732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-podres\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.068999 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.068794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-sys\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.068999 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.068846 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-lib-modules\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.068999 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.068850 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-proc\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.068999 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.068909 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b54953ea-8e34-4290-a1cd-4da2800c6ade-podres\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.076816 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.076797 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcj8k\" (UniqueName: \"kubernetes.io/projected/b54953ea-8e34-4290-a1cd-4da2800c6ade-kube-api-access-tcj8k\") pod \"perf-node-gather-daemonset-65chv\" (UID: \"b54953ea-8e34-4290-a1cd-4da2800c6ade\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.118746 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.118720 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.257872 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.257841 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv"] Jun 12 20:49:51.259083 ip-10-0-136-62 kubenswrapper[2578]: W0612 20:49:51.259047 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb54953ea_8e34_4290_a1cd_4da2800c6ade.slice/crio-633e2e4e41e45fab5a1198a0383a19c1e6e581273b213689375e74f07afc0704 WatchSource:0}: Error finding container 633e2e4e41e45fab5a1198a0383a19c1e6e581273b213689375e74f07afc0704: Status 404 returned error can't find the container with id 633e2e4e41e45fab5a1198a0383a19c1e6e581273b213689375e74f07afc0704 Jun 12 20:49:51.465656 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.465627 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-l8gvn_bea2f805-a6ec-4145-8574-11261b03c8c3/download-server/0.log" Jun 12 20:49:51.861180 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.861137 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" event={"ID":"b54953ea-8e34-4290-a1cd-4da2800c6ade","Type":"ContainerStarted","Data":"fc6b2d36c2cb6045e02516e7df82da57896c3bb4c2df1931ff6543c49e1f5f47"} Jun 12 20:49:51.861343 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.861200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" event={"ID":"b54953ea-8e34-4290-a1cd-4da2800c6ade","Type":"ContainerStarted","Data":"633e2e4e41e45fab5a1198a0383a19c1e6e581273b213689375e74f07afc0704"} Jun 12 20:49:51.861343 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.861282 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:51.882306 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:51.882238 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" podStartSLOduration=1.8822152920000002 podStartE2EDuration="1.882215292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:49:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:49:51.875936266 +0000 UTC m=+2422.163443029" watchObservedRunningTime="2026-06-12 20:49:51.882215292 +0000 UTC m=+2422.169722055" Jun 12 20:49:52.168125 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:52.168032 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-zl7zz_9936d2f3-3d75-4896-b2c4-46bd9565e31e/volume-data-source-validator/0.log" Jun 12 20:49:53.296412 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:53.296384 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-926pk_a86c9aa6-de6b-4296-bb91-dee632048c30/dns/0.log" Jun 12 20:49:53.320386 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:53.320355 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-926pk_a86c9aa6-de6b-4296-bb91-dee632048c30/kube-rbac-proxy/0.log" Jun 12 20:49:53.402375 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:53.402344 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9zvlx_eefdd8b6-744f-417c-b929-430ad6eaeefb/dns-node-resolver/0.log" Jun 12 20:49:53.996690 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:53.996656 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ck9f_c0eadafd-3454-437e-ab4d-4fe2fb19e0f0/node-ca/0.log" Jun 12 20:49:55.002969 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:55.002939 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6h5v_180a234a-680f-4ab3-babb-1d618d534ea3/istio-proxy/0.log" Jun 12 20:49:55.264103 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:55.264011 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6tsnq_69a153de-8bef-43ec-97cd-17b2923b5b08/payload-processing/0.log" Jun 12 20:49:55.286169 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:55.286142 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c794b8896-9ksmt_151621a4-fce8-4f46-8f41-9abc14e9a492/router/0.log" Jun 12 20:49:55.922879 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:55.922848 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6khsh_18259a15-c027-4dfc-8ad3-75f944b62ed2/serve-healthcheck-canary/0.log" Jun 12 20:49:56.604616 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:56.604591 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m45wk_74f18f5a-f287-4a27-93a0-bb78bd1a3a90/kube-rbac-proxy/0.log" Jun 12 20:49:56.626439 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:56.626418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m45wk_74f18f5a-f287-4a27-93a0-bb78bd1a3a90/exporter/0.log" Jun 12 20:49:56.651527 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:56.651504 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m45wk_74f18f5a-f287-4a27-93a0-bb78bd1a3a90/extractor/0.log" Jun 12 20:49:57.878089 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:57.878061 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-65chv" Jun 12 20:49:59.433507 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:59.433473 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7476dfc89-spptl_e9658baf-abb5-4f07-bc2e-7349db068c6d/nginx/0.log" Jun 12 20:49:59.602676 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:59.602642 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6fd6c74797-ssrll_575f916a-f7ca-4884-a7d0-05cac436ba6a/maas-api/0.log" Jun 12 20:49:59.622419 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:59.622399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688270-qbkgf_56ed2629-a296-4540-bd83-f2b8a87844a9/cleanup/0.log" Jun 12 20:49:59.647536 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:59.647509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688285-p5p76_ba4826ea-1f32-45a7-9ee5-76e4732b4c12/cleanup/0.log" Jun 12 20:49:59.724328 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:59.724242 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9464dbdb4-gxt62_07a11e39-a7cf-465c-8233-6c7bb55ed44d/manager/0.log" Jun 12 20:49:59.894138 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:59.894107 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68bb89b4d-hfgkd_0fd67d75-aff3-4cb6-b513-474c7db52288/manager/0.log" Jun 12 20:49:59.916979 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:49:59.916955 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68bb89b4d-hfgkd_0fd67d75-aff3-4cb6-b513-474c7db52288/copy-manifests/0.log" Jun 12 20:50:01.848020 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:01.847993 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-546dccc465-6j2d4_a3d997e3-ebd7-4490-8387-10889b9e4526/manager/0.log" Jun 12 20:50:04.218261 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:04.218224 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6h5v_180a234a-680f-4ab3-babb-1d618d534ea3/istio-proxy/0.log" Jun 12 20:50:04.422638 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:04.422605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6tsnq_69a153de-8bef-43ec-97cd-17b2923b5b08/payload-processing/0.log" Jun 12 20:50:04.435051 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:04.435029 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c794b8896-9ksmt_151621a4-fce8-4f46-8f41-9abc14e9a492/router/0.log" Jun 12 20:50:05.676774 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:05.676729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6h5v_180a234a-680f-4ab3-babb-1d618d534ea3/istio-proxy/0.log" Jun 12 20:50:05.901603 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:05.901571 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6tsnq_69a153de-8bef-43ec-97cd-17b2923b5b08/payload-processing/0.log" Jun 12 20:50:05.918070 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:05.918045 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c794b8896-9ksmt_151621a4-fce8-4f46-8f41-9abc14e9a492/router/0.log" Jun 12 20:50:07.648392 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:07.648360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6h5v_180a234a-680f-4ab3-babb-1d618d534ea3/istio-proxy/0.log" Jun 12 20:50:07.818223 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:07.818188 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-gdmxb_2354ab88-1000-43e7-ae40-a9340a77d2b2/kube-storage-version-migrator-operator/1.log" Jun 12 20:50:07.819157 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:07.819136 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-gdmxb_2354ab88-1000-43e7-ae40-a9340a77d2b2/kube-storage-version-migrator-operator/0.log" Jun 12 20:50:07.859557 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:07.859526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6tsnq_69a153de-8bef-43ec-97cd-17b2923b5b08/payload-processing/0.log" Jun 12 20:50:07.885827 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:07.885803 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c794b8896-9ksmt_151621a4-fce8-4f46-8f41-9abc14e9a492/router/0.log" Jun 12 20:50:09.065791 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:09.065743 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvd5_5f51744e-d49e-49d3-99b9-33a4dc47ff7f/kube-multus-additional-cni-plugins/0.log" Jun 12 20:50:09.092527 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:09.092479 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvd5_5f51744e-d49e-49d3-99b9-33a4dc47ff7f/egress-router-binary-copy/0.log" Jun 12 20:50:09.114552 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:09.114522 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvd5_5f51744e-d49e-49d3-99b9-33a4dc47ff7f/cni-plugins/0.log" Jun 12 20:50:09.137063 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:09.137037 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvd5_5f51744e-d49e-49d3-99b9-33a4dc47ff7f/bond-cni-plugin/0.log" Jun 12 20:50:09.159869 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:09.159836 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvd5_5f51744e-d49e-49d3-99b9-33a4dc47ff7f/routeoverride-cni/0.log" Jun 12 20:50:09.186943 ip-10-0-136-62 kubenswrapper[2578]: I0612 20:50:09.186919 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvd5_5f51744e-d49e-49d3-99b9-33a4dc47ff7f/whereabouts-cni-bincopy/0.log"