Jul 06 23:46:56.717629 ip-10-0-135-224 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 23:46:56.717646 ip-10-0-135-224 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 23:46:56.717656 ip-10-0-135-224 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 23:46:56.718084 ip-10-0-135-224 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 23:47:06.966127 ip-10-0-135-224 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 23:47:06.966162 ip-10-0-135-224 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 941fc91f475d424b84d840e66e684770 -- Jul 06 23:49:00.874229 ip-10-0-135-224 systemd[1]: Starting Kubernetes Kubelet... Jul 06 23:49:01.256045 ip-10-0-135-224 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:49:01.256045 ip-10-0-135-224 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 23:49:01.256045 ip-10-0-135-224 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:49:01.256045 ip-10-0-135-224 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 23:49:01.256045 ip-10-0-135-224 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:49:01.257559 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.257464 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 23:49:01.264991 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.264952 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:49:01.264991 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.264977 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:49:01.264991 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.264983 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:49:01.264991 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.264987 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:49:01.264991 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.264993 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:49:01.264991 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.264997 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:49:01.264991 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265001 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:49:01.264991 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265005 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265009 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265013 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265017 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265021 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265024 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265028 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265032 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265036 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265039 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265043 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265046 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265050 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265053 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265057 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265061 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265065 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265069 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265075 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:49:01.265441 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265080 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265085 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265089 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265092 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265097 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265108 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265112 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265117 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265121 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265125 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265129 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265133 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265137 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265141 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265146 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265150 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265154 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265158 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265162 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265167 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:49:01.266217 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265171 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265176 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265180 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265184 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265188 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265192 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265196 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265201 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265206 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265210 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265214 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265219 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265222 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265228 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265232 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265237 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265241 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265245 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265250 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265254 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:49:01.267104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265259 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265265 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265270 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265274 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265278 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265283 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265287 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265292 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265296 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265303 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265309 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265315 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265320 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265324 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265328 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265332 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265337 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265343 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265347 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265351 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:49:01.267938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265355 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265359 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265363 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265368 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265372 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265378 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265383 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265388 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265392 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265396 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265400 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265404 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.265409 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266649 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266660 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266664 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266668 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266675 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266679 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:49:01.268786 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266684 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266689 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266693 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266697 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266701 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266706 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266710 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266714 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266719 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266723 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266730 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266737 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266742 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266747 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266752 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266756 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266761 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266765 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266770 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:49:01.269656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266774 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266778 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266782 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266787 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266791 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266795 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266801 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266805 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266812 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266817 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266822 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266826 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266830 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266835 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266840 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266844 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266848 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266852 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266856 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:49:01.270264 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266860 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266884 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266889 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266893 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266897 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266903 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266909 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266913 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266918 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266921 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266926 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266930 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266935 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266939 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266943 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266947 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266952 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266956 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266960 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266965 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:49:01.270827 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266970 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266974 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266978 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266982 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266987 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266991 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.266996 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267001 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267005 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267009 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267014 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267018 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267022 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267029 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267033 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267037 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267041 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267047 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267053 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:49:01.271416 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267058 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267062 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267066 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267071 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267076 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267081 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267085 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267089 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267094 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267098 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267102 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267107 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267111 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267115 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267118 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267122 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267761 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267770 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267775 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267782 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:49:01.271889 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267787 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267791 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267796 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267800 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267804 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267808 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267813 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267817 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267821 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267828 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267834 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267839 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267848 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267853 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267858 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267884 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267890 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267894 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267898 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:49:01.272392 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267902 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267905 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267910 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267914 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267919 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267923 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267927 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267931 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267935 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267939 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267943 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267947 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267953 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267956 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267960 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267964 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267970 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267974 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267978 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267984 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:49:01.272884 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267989 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267994 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.267998 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268002 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268007 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268010 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268017 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268021 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268025 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268030 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268034 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268039 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268043 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268047 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268051 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268055 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268059 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268063 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268073 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268078 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:49:01.273363 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268083 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268087 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268092 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268097 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268104 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268108 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268113 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268117 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268121 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268125 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268129 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268133 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268138 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268142 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268146 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268150 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268154 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268158 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268162 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268167 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:49:01.273841 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268171 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268176 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268181 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268185 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268189 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268194 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268198 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268202 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268206 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268210 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268214 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268218 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268222 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268226 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268230 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.268234 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268341 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268352 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268363 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268369 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 23:49:01.274356 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268376 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268381 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268388 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268395 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268400 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268409 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268415 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268420 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268425 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268429 2584 flags.go:64] FLAG: --cgroup-root="" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268434 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268439 2584 flags.go:64] FLAG: --client-ca-file="" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268445 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268450 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268456 2584 flags.go:64] FLAG: --cluster-domain="" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268460 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268466 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268471 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268477 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268483 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268488 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268493 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268498 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268503 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 06 23:49:01.274920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268508 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268512 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268517 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268522 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268530 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268535 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268540 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268545 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268550 2584 flags.go:64] FLAG: --enable-server="true" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268554 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268562 2584 flags.go:64] FLAG: --event-burst="100" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268567 2584 flags.go:64] FLAG: --event-qps="50" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268574 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268579 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268584 2584 flags.go:64] FLAG: --eviction-hard="" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268590 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268594 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268599 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268604 2584 flags.go:64] FLAG: --eviction-soft="" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268609 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268614 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268619 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268624 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268630 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268634 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 23:49:01.275495 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268639 2584 flags.go:64] FLAG: --feature-gates="" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268645 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268650 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268656 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268660 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268665 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268670 2584 flags.go:64] FLAG: --help="false" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268675 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268680 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268685 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268690 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268698 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268704 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268708 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268713 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268717 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268722 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268726 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268731 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268737 2584 flags.go:64] FLAG: --kube-reserved="" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268742 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268746 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268751 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268755 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 23:49:01.276221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268760 2584 flags.go:64] FLAG: --lock-file="" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268764 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268769 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268774 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268782 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268788 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268793 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268797 2584 flags.go:64] FLAG: --logging-format="text" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268801 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268806 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268810 2584 flags.go:64] FLAG: --manifest-url="" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268815 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268822 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268827 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268834 2584 flags.go:64] FLAG: --max-pods="110" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268839 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268844 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268849 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268854 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268861 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268884 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268889 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268902 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268907 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268912 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 23:49:01.276798 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268917 2584 flags.go:64] FLAG: --pod-cidr="" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268921 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268932 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268937 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268942 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268946 2584 flags.go:64] FLAG: --port="10250" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268951 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268956 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f55cf8526fb558e6" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268961 2584 flags.go:64] FLAG: --qos-reserved="" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268966 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268970 2584 flags.go:64] FLAG: --register-node="true" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268975 2584 flags.go:64] FLAG: --register-with-taints="" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268981 2584 flags.go:64] FLAG: --registry-burst="10" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268986 2584 flags.go:64] FLAG: --registry-qps="5" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268991 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.268995 2584 flags.go:64] FLAG: --reserved-memory="" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269001 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269006 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269011 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269016 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269020 2584 flags.go:64] FLAG: --runonce="false" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269025 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269030 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269035 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269039 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 23:49:01.277433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269044 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269048 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269055 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269060 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269064 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269069 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269073 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269078 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269083 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269090 2584 flags.go:64] FLAG: --system-cgroups="" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269095 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269103 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269108 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269112 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269120 2584 flags.go:64] FLAG: --tls-min-version="" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269124 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269128 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269133 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269138 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269143 2584 flags.go:64] FLAG: --v="2" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269150 2584 flags.go:64] FLAG: --version="false" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269157 2584 flags.go:64] FLAG: --vmodule="" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269163 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.269168 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269369 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:49:01.278071 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269376 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269381 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269386 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269391 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269395 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269399 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269404 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269409 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269413 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269419 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269424 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269428 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269432 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269436 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269441 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269445 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269451 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269455 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269460 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269464 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:49:01.278738 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269468 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269472 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269477 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269481 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269485 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269489 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269494 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269498 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269502 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269507 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269511 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269515 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269520 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269524 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269528 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269532 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269536 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269540 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269544 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269548 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:49:01.279252 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269552 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269558 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269563 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269567 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269571 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269575 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269580 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269584 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269590 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269594 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269598 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269603 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269607 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269611 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269615 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269620 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269624 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269628 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269632 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:49:01.279746 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269636 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269640 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269644 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269649 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269653 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269657 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269661 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269665 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269669 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269674 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269678 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269682 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269686 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269690 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269696 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269700 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269705 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269709 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269713 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269717 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:49:01.280282 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269721 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269727 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269732 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269739 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269745 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269750 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269756 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269761 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269765 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269769 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269774 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269779 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269783 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269787 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269791 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269798 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269806 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269812 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:49:01.280757 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.269817 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.270346 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.277441 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.277462 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.278154 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.278161 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278224 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278230 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278233 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278237 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278240 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278243 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278246 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278248 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278251 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:49:01.281212 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278254 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278258 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278261 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278263 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278266 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278269 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278271 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278274 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278276 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278279 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278281 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278284 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278287 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278289 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278292 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278294 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278297 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278299 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278302 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278304 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:49:01.281591 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278314 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278317 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278320 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278322 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278325 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278328 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278330 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278333 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278335 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278338 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278341 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278343 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278346 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278348 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278351 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278354 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278356 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278358 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278361 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278363 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:49:01.282096 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278366 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278368 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278371 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278374 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278378 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278383 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278385 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278388 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278390 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278393 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278396 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278399 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278402 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278412 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278416 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278419 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278421 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278424 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278427 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:49:01.282605 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278430 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278433 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278436 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278439 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278441 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278444 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278446 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278449 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278451 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278454 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278456 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278459 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278461 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278464 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278466 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278469 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278471 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278475 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278477 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278480 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:49:01.283177 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278482 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278485 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278487 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278490 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278493 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278496 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278498 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278514 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278520 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278523 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278525 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.278531 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278677 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278682 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278685 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:49:01.283656 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278688 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278691 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278694 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278697 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278700 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278702 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278705 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278708 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278710 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278713 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278715 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278718 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278720 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278723 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278725 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278728 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278731 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278733 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278736 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278739 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278741 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:49:01.284051 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278744 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278747 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278750 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278753 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278768 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278770 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278773 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278776 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278778 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278781 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278783 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278786 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278789 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278791 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278794 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278796 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278798 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278801 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278803 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278806 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:49:01.284550 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278808 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278811 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278813 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278816 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278818 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278821 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278824 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278827 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278829 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278832 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278834 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278837 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278839 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278842 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278845 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278849 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278853 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278863 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278888 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:49:01.285034 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278891 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278894 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278897 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278900 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278903 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278905 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278908 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278910 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278913 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278915 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278918 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278920 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278923 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278926 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278928 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278931 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278933 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278936 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278939 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:49:01.285496 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278941 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278944 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278946 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278949 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278951 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278954 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278956 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278959 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278962 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278965 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278967 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278970 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278978 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278981 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278983 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278987 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:49:01.285975 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:01.278990 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:49:01.286425 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.278995 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:49:01.286425 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.279140 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 23:49:01.286425 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.281412 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 23:49:01.286425 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.282791 2584 server.go:1019] "Starting client certificate rotation" Jul 06 23:49:01.286425 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.282920 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:49:01.286425 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.282964 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:49:01.286425 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.285557 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:49:01.288919 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.288895 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:49:01.298193 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.298175 2584 log.go:25] "Validated CRI v1 runtime API" Jul 06 23:49:01.300306 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.300293 2584 log.go:25] "Validated CRI v1 image API" Jul 06 23:49:01.303426 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.303406 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 23:49:01.307386 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.307359 2584 fs.go:135] Filesystem UUIDs: map[5cfcd890-af1e-46b0-80e1-a45113d696d5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a5237eed-05ff-4b9e-9b36-d6d6dce4577f:/dev/nvme0n1p4] Jul 06 23:49:01.307466 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.307388 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 23:49:01.313795 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.313775 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:49:01.313948 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.313775 2584 manager.go:216] Machine: {Timestamp:2026-07-06 23:49:01.311581513 +0000 UTC m=+0.312059269 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097597 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bbd78a294810d25a110b954a2e428 SystemUUID:ec2bbd78-a294-810d-25a1-10b954a2e428 BootID:941fc91f-475d-424b-84d8-40e66e684770 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:22:f3:cb:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:22:f3:cb:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:02:6f:99:c5:aa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 23:49:01.314033 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.313952 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 23:49:01.314069 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.314050 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 23:49:01.318656 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.318620 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 23:49:01.318811 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.318660 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 23:49:01.319374 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.319363 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 23:49:01.319410 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.319377 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 23:49:01.319410 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.319385 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:49:01.319831 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.319821 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:49:01.320968 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.320958 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 23:49:01.324983 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.324972 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:49:01.325137 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.325128 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 23:49:01.325177 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.325166 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 06 23:49:01.325221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.325183 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 23:49:01.325221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.325207 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 23:49:01.325326 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.325221 2584 kubelet.go:398] "Adding apiserver pod source" Jul 06 23:49:01.325326 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.325243 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 23:49:01.325713 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.325701 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:49:01.325750 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.325722 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:49:01.327936 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.327920 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 23:49:01.331692 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.331669 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 23:49:01.331759 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.331722 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 23:49:01.332750 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332733 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332755 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332762 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332768 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332776 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332782 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332791 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332796 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332802 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332808 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 23:49:01.332812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332816 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 23:49:01.333134 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.332821 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 23:49:01.333903 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.333890 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 23:49:01.333903 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.333900 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 23:49:01.336815 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.336796 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 23:49:01.336902 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.336825 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 23:49:01.336902 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.336834 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 23:49:01.337433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.337421 2584 server.go:1268] "Started kubelet" Jul 06 23:49:01.337530 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.337490 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 23:49:01.337585 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.337513 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 23:49:01.337636 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.337587 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 23:49:01.338188 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.338168 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ls86w" Jul 06 23:49:01.338387 ip-10-0-135-224 systemd[1]: Started Kubernetes Kubelet. Jul 06 23:49:01.339565 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.339536 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 23:49:01.339726 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.339711 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 06 23:49:01.342788 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.342769 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 23:49:01.345635 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.345617 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 23:49:01.345788 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.345638 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 23:49:01.345788 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.345701 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:01.346226 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.346212 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 23:49:01.346337 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.346234 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 23:49:01.346415 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.346406 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 23:49:01.346598 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.345235 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-224.ec2.internal.18bfd83eb7553ad9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-224.ec2.internal,UID:ip-10-0-135-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-224.ec2.internal,},FirstTimestamp:2026-07-06 23:49:01.337393881 +0000 UTC m=+0.337871615,LastTimestamp:2026-07-06 23:49:01.337393881 +0000 UTC m=+0.337871615,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-224.ec2.internal,}" Jul 06 23:49:01.347469 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.346861 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ls86w" Jul 06 23:49:01.347543 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.347522 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 06 23:49:01.347543 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.347534 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 06 23:49:01.348351 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.348334 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 23:49:01.348443 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.348434 2584 factory.go:55] Registering systemd factory Jul 06 23:49:01.348505 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.348498 2584 factory.go:223] Registration of the systemd container factory successfully Jul 06 23:49:01.348955 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.348935 2584 factory.go:153] Registering CRI-O factory Jul 06 23:49:01.348955 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.348958 2584 factory.go:223] Registration of the crio container factory successfully Jul 06 23:49:01.349096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.348987 2584 factory.go:103] Registering Raw factory Jul 06 23:49:01.349096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.349002 2584 manager.go:1196] Started watching for new ooms in manager Jul 06 23:49:01.349533 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.349515 2584 manager.go:349] Starting recovery of all containers Jul 06 23:49:01.351241 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.351209 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 23:49:01.351344 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.351248 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 23:49:01.362479 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.362326 2584 manager.go:354] Recovery completed Jul 06 23:49:01.366831 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.366819 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:49:01.369650 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.369623 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:49:01.369650 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.369653 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:49:01.369765 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.369663 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:49:01.370283 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.370268 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:49:01.370358 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.370272 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 23:49:01.370358 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.370326 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 23:49:01.370358 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.370346 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:49:01.371036 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.371011 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:49:01.371036 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.371040 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:49:01.371146 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.371050 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:49:01.372603 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.372592 2584 policy_none.go:49] "None policy: Start" Jul 06 23:49:01.372644 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.372608 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 23:49:01.372644 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.372619 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 23:49:01.374612 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.374602 2584 policy_none.go:47] "Start" Jul 06 23:49:01.416553 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.416534 2584 manager.go:337] "Starting Device Plugin manager" Jul 06 23:49:01.416672 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.416583 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 23:49:01.416672 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.416593 2584 server.go:87] "Starting device plugin registration server" Jul 06 23:49:01.416940 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.416925 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 23:49:01.417009 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.416942 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 23:49:01.417059 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.417026 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 23:49:01.417116 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.417104 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 23:49:01.417116 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.417116 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 23:49:01.417702 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.417683 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 23:49:01.417827 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.417737 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:01.479402 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.479364 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 23:49:01.481597 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.480712 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 23:49:01.481597 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.480749 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 23:49:01.481597 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.480778 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 23:49:01.481597 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.480811 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 23:49:01.483358 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.483331 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:49:01.517607 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.517521 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:49:01.518589 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.518573 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:49:01.518648 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.518605 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:49:01.518648 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.518617 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:49:01.518648 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.518641 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.526615 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.526598 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.526662 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.526623 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-224.ec2.internal\": node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:01.539759 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.539732 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:01.581155 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.581121 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal"] Jul 06 23:49:01.581307 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.581200 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:49:01.582250 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.582235 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:49:01.582306 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.582266 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:49:01.582306 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.582276 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:49:01.584595 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.584583 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:49:01.584716 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.584700 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.584762 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.584736 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:49:01.585405 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.585386 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:49:01.585405 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.585408 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:49:01.585574 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.585418 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:49:01.585574 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.585439 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:49:01.585574 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.585466 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:49:01.585574 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.585480 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:49:01.587695 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.587680 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.587788 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.587705 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:49:01.588427 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.588411 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:49:01.588535 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.588441 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:49:01.588535 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.588455 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:49:01.611604 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.611576 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-224.ec2.internal\" not found" node="ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.616080 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.616059 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-224.ec2.internal\" not found" node="ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.640338 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.640306 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:01.649719 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.649691 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06a9ea5475b6b02a29732a9404f2a151-config\") pod \"kube-apiserver-proxy-ip-10-0-135-224.ec2.internal\" (UID: \"06a9ea5475b6b02a29732a9404f2a151\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.649800 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.649739 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de52c8741c2ba60276b0eaf0767f828b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal\" (UID: \"de52c8741c2ba60276b0eaf0767f828b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.649800 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.649767 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de52c8741c2ba60276b0eaf0767f828b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal\" (UID: \"de52c8741c2ba60276b0eaf0767f828b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.740628 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.740582 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:01.749978 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.749947 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de52c8741c2ba60276b0eaf0767f828b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal\" (UID: \"de52c8741c2ba60276b0eaf0767f828b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.750096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.749985 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06a9ea5475b6b02a29732a9404f2a151-config\") pod \"kube-apiserver-proxy-ip-10-0-135-224.ec2.internal\" (UID: \"06a9ea5475b6b02a29732a9404f2a151\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.750096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.750011 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de52c8741c2ba60276b0eaf0767f828b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal\" (UID: \"de52c8741c2ba60276b0eaf0767f828b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.750096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.750044 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de52c8741c2ba60276b0eaf0767f828b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal\" (UID: \"de52c8741c2ba60276b0eaf0767f828b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.750096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.750055 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06a9ea5475b6b02a29732a9404f2a151-config\") pod \"kube-apiserver-proxy-ip-10-0-135-224.ec2.internal\" (UID: \"06a9ea5475b6b02a29732a9404f2a151\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.750096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.750046 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de52c8741c2ba60276b0eaf0767f828b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal\" (UID: \"de52c8741c2ba60276b0eaf0767f828b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.841401 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.841331 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:01.914884 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.914835 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.920014 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:01.919694 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal" Jul 06 23:49:01.942474 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:01.942437 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:03.251729 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:03.251691 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:03.352306 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:03.352248 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:03.452768 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:03.452741 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:03.491314 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.491266 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 23:49:03.491946 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.491440 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 23:49:03.553652 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:03.553573 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:03.559394 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.559362 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:44:02 +0000 UTC" deadline="2028-03-30 17:41:01.099048844 +0000 UTC" Jul 06 23:49:03.559394 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.559390 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15185h51m57.539661925s" Jul 06 23:49:03.654138 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:03.654105 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-224.ec2.internal\" not found" Jul 06 23:49:03.724551 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:03.724504 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde52c8741c2ba60276b0eaf0767f828b.slice/crio-935a7830320686771b5b5e370505d3a26f1dedfd3fd8a069b1f1dae2f69bc11a WatchSource:0}: Error finding container 935a7830320686771b5b5e370505d3a26f1dedfd3fd8a069b1f1dae2f69bc11a: Status 404 returned error can't find the container with id 935a7830320686771b5b5e370505d3a26f1dedfd3fd8a069b1f1dae2f69bc11a Jul 06 23:49:03.730006 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.729982 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:49:03.754093 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.754069 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:49:03.754529 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.754501 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" Jul 06 23:49:03.765787 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.765762 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:49:03.767312 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.767295 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal" Jul 06 23:49:03.774703 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:03.774679 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a9ea5475b6b02a29732a9404f2a151.slice/crio-6b7d2d452a490b621502a7b26af01b1b5bf8cc2a7db12ccaf2225cf523127373 WatchSource:0}: Error finding container 6b7d2d452a490b621502a7b26af01b1b5bf8cc2a7db12ccaf2225cf523127373: Status 404 returned error can't find the container with id 6b7d2d452a490b621502a7b26af01b1b5bf8cc2a7db12ccaf2225cf523127373 Jul 06 23:49:03.776237 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:03.776223 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:49:04.054577 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.054550 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:49:04.130220 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.130185 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:49:04.535475 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.535442 2584 apiserver.go:52] "Watching apiserver" Jul 06 23:49:04.556431 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.556398 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 23:49:04.556905 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.556882 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 23:49:04.557827 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.557433 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal","openshift-multus/multus-additional-cni-plugins-cdkv6","openshift-network-operator/iptables-alerter-7q7ld","openshift-ovn-kubernetes/ovnkube-node-xpvsp","kube-system/konnectivity-agent-ntnf9","kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c","openshift-cluster-node-tuning-operator/tuned-xq7gs","openshift-image-registry/node-ca-m4pbg","openshift-multus/multus-hnt27","openshift-multus/network-metrics-daemon-l5d25","openshift-network-diagnostics/network-check-target-rtfjh","kube-system/global-pull-secret-syncer-g9g7s","openshift-dns/node-resolver-fvtwk"] Jul 06 23:49:04.560044 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.560008 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.562326 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.562304 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:04.562420 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.562394 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:04.564221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.564203 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.566419 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.566397 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.569013 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.568995 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:04.571880 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.571858 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.574366 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.574345 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.575121 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.575101 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 23:49:04.575209 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.575188 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 23:49:04.575286 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.575189 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 23:49:04.575370 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.575353 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 23:49:04.575921 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.575902 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 23:49:04.576017 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.575999 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 23:49:04.576081 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.576053 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t59k7\"" Jul 06 23:49:04.576164 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.576144 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c7rnr\"" Jul 06 23:49:04.576271 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.576195 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 23:49:04.577419 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.577400 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.579441 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.579423 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.582371 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.582354 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.584471 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.584356 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:04.584471 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.584429 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:04.587459 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.586817 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:04.587459 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.586866 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:04.600981 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.600935 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 23:49:04.601695 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.601632 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 23:49:04.601830 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.601806 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 23:49:04.645205 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.645180 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 23:49:04.645664 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.645648 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 23:49:04.646668 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.646647 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 23:49:04.646763 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.646666 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:49:04.647077 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.647060 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 23:49:04.647789 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.647766 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 23:49:04.649130 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.649113 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 23:49:04.649238 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.649190 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ndxkx\"" Jul 06 23:49:04.656734 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.656713 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 23:49:04.661731 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.661710 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bd996\"" Jul 06 23:49:04.661850 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.661751 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pb266\"" Jul 06 23:49:04.661850 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.661837 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 23:49:04.661960 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.661757 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ck7zt\"" Jul 06 23:49:04.661960 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.661931 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 23:49:04.662058 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.661976 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 23:49:04.662153 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.662135 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:49:04.662266 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.662157 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 23:49:04.662266 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.662176 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 23:49:04.662266 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.662163 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 23:49:04.662419 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.662342 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 23:49:04.662469 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.662437 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 23:49:04.662574 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.662553 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:49:04.662662 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.662653 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l8mbt\"" Jul 06 23:49:04.662713 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.662689 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 23:49:04.665538 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.665512 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hjz5k\"" Jul 06 23:49:04.668676 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668652 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-etc-openvswitch\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.668766 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668685 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.668766 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668705 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.668766 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668732 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-etc-kubernetes\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.668874 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668778 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-run-systemd\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.668874 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668837 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvcf9\" (UniqueName: \"kubernetes.io/projected/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-kube-api-access-gvcf9\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.668874 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668863 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-cnibin\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.669004 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668881 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-host\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.669004 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668929 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-var-lib-cni-bin\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.669004 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668959 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.669004 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.668990 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3-iptables-alerter-script\") pod \"iptables-alerter-7q7ld\" (UID: \"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3\") " pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.669187 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669018 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-run-openvswitch\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.669187 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669067 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-run-ovn\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.669187 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669104 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-cni-netd\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.669187 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669151 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkbtx\" (UniqueName: \"kubernetes.io/projected/4fafd82c-e4f9-4ae3-b9bf-53be91d68251-kube-api-access-gkbtx\") pod \"node-resolver-fvtwk\" (UID: \"4fafd82c-e4f9-4ae3-b9bf-53be91d68251\") " pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.669327 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669184 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-sysctl-d\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.669327 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669226 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbwlh\" (UniqueName: \"kubernetes.io/projected/ea83446f-2e1b-4a1e-9484-2ab8352d998b-kube-api-access-lbwlh\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.669327 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669252 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:04.669327 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669291 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-sys-fs\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.669464 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669332 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc4gn\" (UniqueName: \"kubernetes.io/projected/fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3-kube-api-access-tc4gn\") pod \"iptables-alerter-7q7ld\" (UID: \"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3\") " pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.669464 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669368 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-node-log\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.669464 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669402 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-sys\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.669464 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669432 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-run-k8s-cni-cncf-io\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.669464 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669458 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-var-lib-kubelet\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.669681 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669484 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1340007-5311-40a0-968e-4b9e694f6bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.669681 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669509 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-tuned\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.669681 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669531 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-system-cni-dir\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.669681 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669556 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mprc7\" (UniqueName: \"kubernetes.io/projected/a5c0c926-4fc0-4a99-9afd-78835d7ce470-kube-api-access-mprc7\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.669681 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669591 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-kubelet\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.669681 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669656 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-ovn-node-metrics-cert\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.669957 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669701 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc338a58-e895-4c9f-900f-15fa7e99427d-serviceca\") pod \"node-ca-m4pbg\" (UID: \"dc338a58-e895-4c9f-900f-15fa7e99427d\") " pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.669957 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669727 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-sysctl-conf\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.669957 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669749 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-run\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.669957 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669774 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-socket-dir-parent\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.669957 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669811 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5847788-75fd-4e51-85a4-b41114a18582-dbus\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:04.669957 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669834 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fafd82c-e4f9-4ae3-b9bf-53be91d68251-hosts-file\") pod \"node-resolver-fvtwk\" (UID: \"4fafd82c-e4f9-4ae3-b9bf-53be91d68251\") " pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.669957 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669859 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rjz6\" (UniqueName: \"kubernetes.io/projected/e1340007-5311-40a0-968e-4b9e694f6bc4-kube-api-access-7rjz6\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.669957 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669886 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-var-lib-cni-multus\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.669957 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669928 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-systemd-units\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.669968 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt46f\" (UniqueName: \"kubernetes.io/projected/245158ae-ab60-4367-a2d9-bd271be17552-kube-api-access-vt46f\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670007 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-device-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670030 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3-host-slash\") pod \"iptables-alerter-7q7ld\" (UID: \"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3\") " pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670058 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-slash\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670088 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-ovnkube-config\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670113 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-ovnkube-script-lib\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670128 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9n29\" (UniqueName: \"kubernetes.io/projected/c43a1a5f-5e13-418d-887c-42f1d85fb45f-kube-api-access-z9n29\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670158 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-conf-dir\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670205 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670241 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zzgs\" (UniqueName: \"kubernetes.io/projected/dc338a58-e895-4c9f-900f-15fa7e99427d-kube-api-access-4zzgs\") pod \"node-ca-m4pbg\" (UID: \"dc338a58-e895-4c9f-900f-15fa7e99427d\") " pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.670305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670284 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-cnibin\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670334 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-var-lib-openvswitch\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670363 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-log-socket\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670412 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670454 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-registration-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670486 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1340007-5311-40a0-968e-4b9e694f6bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670528 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-systemd\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670571 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-var-lib-kubelet\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670594 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-run-netns\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670632 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-run-multus-certs\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670658 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-env-overrides\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670683 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670707 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1340007-5311-40a0-968e-4b9e694f6bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670733 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-kubernetes\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670755 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-lib-modules\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670774 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-daemon-config\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.670790 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670797 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-run-ovn-kubernetes\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670818 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a0f3e2d-73f8-4385-8467-527b5b0a0120-konnectivity-ca\") pod \"konnectivity-agent-ntnf9\" (UID: \"4a0f3e2d-73f8-4385-8467-527b5b0a0120\") " pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670864 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fafd82c-e4f9-4ae3-b9bf-53be91d68251-tmp-dir\") pod \"node-resolver-fvtwk\" (UID: \"4fafd82c-e4f9-4ae3-b9bf-53be91d68251\") " pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670893 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c43a1a5f-5e13-418d-887c-42f1d85fb45f-tmp\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-os-release\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.670945 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea83446f-2e1b-4a1e-9484-2ab8352d998b-cni-binary-copy\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671004 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5847788-75fd-4e51-85a4-b41114a18582-kubelet-config\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671033 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-cni-bin\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671056 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-os-release\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671080 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-socket-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671108 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-run-netns\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671132 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a0f3e2d-73f8-4385-8467-527b5b0a0120-agent-certs\") pod \"konnectivity-agent-ntnf9\" (UID: \"4a0f3e2d-73f8-4385-8467-527b5b0a0120\") " pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671153 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-modprobe-d\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671186 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-sysconfig\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671286 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-cni-dir\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671317 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-hostroot\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc338a58-e895-4c9f-900f-15fa7e99427d-host\") pod \"node-ca-m4pbg\" (UID: \"dc338a58-e895-4c9f-900f-15fa7e99427d\") " pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.671542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.671366 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:04.685177 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.685141 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dhrjm\"" Jul 06 23:49:04.694963 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.694923 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal" event={"ID":"06a9ea5475b6b02a29732a9404f2a151","Type":"ContainerStarted","Data":"6b7d2d452a490b621502a7b26af01b1b5bf8cc2a7db12ccaf2225cf523127373"} Jul 06 23:49:04.696122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.696098 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" event={"ID":"de52c8741c2ba60276b0eaf0767f828b","Type":"ContainerStarted","Data":"935a7830320686771b5b5e370505d3a26f1dedfd3fd8a069b1f1dae2f69bc11a"} Jul 06 23:49:04.714660 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.714597 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6r7g8" Jul 06 23:49:04.731645 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.731590 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6r7g8" Jul 06 23:49:04.737618 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.737580 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:49:04.772161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772131 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-kubelet\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.772161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772166 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-ovn-node-metrics-cert\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.772400 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772192 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc338a58-e895-4c9f-900f-15fa7e99427d-serviceca\") pod \"node-ca-m4pbg\" (UID: \"dc338a58-e895-4c9f-900f-15fa7e99427d\") " pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.772400 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772257 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-kubelet\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.772400 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772319 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-sysctl-conf\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.772400 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772352 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-run\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.772400 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772379 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-socket-dir-parent\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.772626 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772402 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5847788-75fd-4e51-85a4-b41114a18582-dbus\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:04.772626 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772422 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fafd82c-e4f9-4ae3-b9bf-53be91d68251-hosts-file\") pod \"node-resolver-fvtwk\" (UID: \"4fafd82c-e4f9-4ae3-b9bf-53be91d68251\") " pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.772626 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772443 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rjz6\" (UniqueName: \"kubernetes.io/projected/e1340007-5311-40a0-968e-4b9e694f6bc4-kube-api-access-7rjz6\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.772626 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772463 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-var-lib-cni-multus\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.772626 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772500 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-systemd-units\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.772626 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772516 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-sysctl-conf\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.772626 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772525 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt46f\" (UniqueName: \"kubernetes.io/projected/245158ae-ab60-4367-a2d9-bd271be17552-kube-api-access-vt46f\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:04.772626 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772569 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-device-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772631 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3-host-slash\") pod \"iptables-alerter-7q7ld\" (UID: \"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3\") " pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772633 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772656 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-slash\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772689 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-ovnkube-config\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772710 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-ovnkube-script-lib\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772711 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc338a58-e895-4c9f-900f-15fa7e99427d-serviceca\") pod \"node-ca-m4pbg\" (UID: \"dc338a58-e895-4c9f-900f-15fa7e99427d\") " pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772735 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9n29\" (UniqueName: \"kubernetes.io/projected/c43a1a5f-5e13-418d-887c-42f1d85fb45f-kube-api-access-z9n29\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772771 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-conf-dir\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772796 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.772858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772841 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zzgs\" (UniqueName: \"kubernetes.io/projected/dc338a58-e895-4c9f-900f-15fa7e99427d-kube-api-access-4zzgs\") pod \"node-ca-m4pbg\" (UID: \"dc338a58-e895-4c9f-900f-15fa7e99427d\") " pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772860 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-run\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772870 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-cnibin\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772914 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-var-lib-openvswitch\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772917 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-socket-dir-parent\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772950 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-log-socket\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772955 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-var-lib-openvswitch\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772984 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.772987 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-log-socket\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773007 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-registration-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773031 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1340007-5311-40a0-968e-4b9e694f6bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773050 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-systemd\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773072 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-var-lib-kubelet\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773095 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-run-netns\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773110 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5847788-75fd-4e51-85a4-b41114a18582-dbus\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773118 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-run-multus-certs\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.773148 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773142 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-env-overrides\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773160 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fafd82c-e4f9-4ae3-b9bf-53be91d68251-hosts-file\") pod \"node-resolver-fvtwk\" (UID: \"4fafd82c-e4f9-4ae3-b9bf-53be91d68251\") " pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773212 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1340007-5311-40a0-968e-4b9e694f6bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773231 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-var-lib-cni-multus\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773234 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-kubernetes\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773271 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-kubernetes\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773279 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-lib-modules\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773269 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-slash\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773325 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-device-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773371 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3-host-slash\") pod \"iptables-alerter-7q7ld\" (UID: \"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3\") " pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773375 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-lib-modules\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773413 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-systemd-units\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773649 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-env-overrides\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773704 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-conf-dir\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773731 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-registration-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773750 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-run-netns\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.773896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773761 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-var-lib-kubelet\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773788 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773793 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-run-multus-certs\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773840 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-cnibin\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773888 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773932 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-systemd\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773961 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-daemon-config\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.773989 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-run-ovn-kubernetes\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774014 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a0f3e2d-73f8-4385-8467-527b5b0a0120-konnectivity-ca\") pod \"konnectivity-agent-ntnf9\" (UID: \"4a0f3e2d-73f8-4385-8467-527b5b0a0120\") " pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774039 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fafd82c-e4f9-4ae3-b9bf-53be91d68251-tmp-dir\") pod \"node-resolver-fvtwk\" (UID: \"4fafd82c-e4f9-4ae3-b9bf-53be91d68251\") " pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774062 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c43a1a5f-5e13-418d-887c-42f1d85fb45f-tmp\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774084 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-os-release\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774108 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea83446f-2e1b-4a1e-9484-2ab8352d998b-cni-binary-copy\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774127 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-ovnkube-config\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774134 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5847788-75fd-4e51-85a4-b41114a18582-kubelet-config\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774158 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-cni-bin\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774182 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-os-release\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.774682 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774201 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1340007-5311-40a0-968e-4b9e694f6bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774207 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-socket-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774237 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1340007-5311-40a0-968e-4b9e694f6bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774256 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-run-netns\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774257 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-ovnkube-script-lib\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774296 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-run-netns\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774305 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-socket-dir\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774324 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a0f3e2d-73f8-4385-8467-527b5b0a0120-agent-certs\") pod \"konnectivity-agent-ntnf9\" (UID: \"4a0f3e2d-73f8-4385-8467-527b5b0a0120\") " pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774330 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fafd82c-e4f9-4ae3-b9bf-53be91d68251-tmp-dir\") pod \"node-resolver-fvtwk\" (UID: \"4fafd82c-e4f9-4ae3-b9bf-53be91d68251\") " pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.774883 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-run-ovn-kubernetes\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.775417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.775401 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-daemon-config\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.775884 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.775662 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-os-release\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.775884 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.775690 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5847788-75fd-4e51-85a4-b41114a18582-kubelet-config\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:04.775884 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.775801 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-cni-bin\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.775884 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.775848 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-os-release\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.776065 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776015 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-modprobe-d\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.776065 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776053 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-sysconfig\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.776156 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776081 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-cni-dir\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.776156 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776111 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-hostroot\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.776156 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776138 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc338a58-e895-4c9f-900f-15fa7e99427d-host\") pod \"node-ca-m4pbg\" (UID: \"dc338a58-e895-4c9f-900f-15fa7e99427d\") " pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.776270 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776161 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:04.776270 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776180 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-etc-openvswitch\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.776270 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776207 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.776270 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776234 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.776270 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776255 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-etc-kubernetes\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.776452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-run-systemd\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.776452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776301 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvcf9\" (UniqueName: \"kubernetes.io/projected/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-kube-api-access-gvcf9\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.776452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776321 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-cnibin\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.776452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776346 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-host\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.776452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776369 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-var-lib-cni-bin\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.776452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776391 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.776452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776396 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a0f3e2d-73f8-4385-8467-527b5b0a0120-konnectivity-ca\") pod \"konnectivity-agent-ntnf9\" (UID: \"4a0f3e2d-73f8-4385-8467-527b5b0a0120\") " pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:04.776452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776407 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3-iptables-alerter-script\") pod \"iptables-alerter-7q7ld\" (UID: \"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3\") " pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.776452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776427 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-run-openvswitch\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.776812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776476 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-etc-kubernetes\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.776812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776511 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-run-systemd\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.776812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776557 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.776812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776636 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-run-openvswitch\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.776812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776706 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-host\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.776812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776773 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-modprobe-d\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.776812 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776778 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-var-lib-cni-bin\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.777062 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776830 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1340007-5311-40a0-968e-4b9e694f6bc4-cnibin\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.777062 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776856 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-hostroot\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.777062 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776896 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-multus-cni-dir\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.777062 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776934 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc338a58-e895-4c9f-900f-15fa7e99427d-host\") pod \"node-ca-m4pbg\" (UID: \"dc338a58-e895-4c9f-900f-15fa7e99427d\") " pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.777062 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.776998 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-sysconfig\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.777289 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777130 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3-iptables-alerter-script\") pod \"iptables-alerter-7q7ld\" (UID: \"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3\") " pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.777289 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777221 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.777289 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777258 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-etc-openvswitch\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.777398 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777297 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.777398 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777320 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-run-ovn\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.777398 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777349 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-cni-netd\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.777398 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777370 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkbtx\" (UniqueName: \"kubernetes.io/projected/4fafd82c-e4f9-4ae3-b9bf-53be91d68251-kube-api-access-gkbtx\") pod \"node-resolver-fvtwk\" (UID: \"4fafd82c-e4f9-4ae3-b9bf-53be91d68251\") " pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.777546 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777423 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-sysctl-d\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.777546 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777444 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbwlh\" (UniqueName: \"kubernetes.io/projected/ea83446f-2e1b-4a1e-9484-2ab8352d998b-kube-api-access-lbwlh\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.777546 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:04.777546 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777484 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-sys-fs\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.777546 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777510 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc4gn\" (UniqueName: \"kubernetes.io/projected/fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3-kube-api-access-tc4gn\") pod \"iptables-alerter-7q7ld\" (UID: \"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3\") " pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.777756 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777529 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-node-log\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.777756 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777678 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-sys\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.777756 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777706 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-run-k8s-cni-cncf-io\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.777756 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-var-lib-kubelet\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.777756 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777745 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1340007-5311-40a0-968e-4b9e694f6bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.777932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777872 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-sysctl-d\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.777932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777765 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-tuned\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.778004 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777932 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-system-cni-dir\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.778004 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.777973 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mprc7\" (UniqueName: \"kubernetes.io/projected/a5c0c926-4fc0-4a99-9afd-78835d7ce470-kube-api-access-mprc7\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.778463 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.778431 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-node-log\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.778527 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.777134 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:04.778859 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.778840 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret podName:e5847788-75fd-4e51-85a4-b41114a18582 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:05.278655582 +0000 UTC m=+3.070397318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret") pod "global-pull-secret-syncer-g9g7s" (UID: "e5847788-75fd-4e51-85a4-b41114a18582") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.779067 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c43a1a5f-5e13-418d-887c-42f1d85fb45f-sys\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.779113 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.779189 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-host-cni-netd\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.779273 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-run-k8s-cni-cncf-io\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.779292 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs podName:245158ae-ab60-4367-a2d9-bd271be17552 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:05.279273722 +0000 UTC m=+3.071015450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs") pod "network-metrics-daemon-l5d25" (UID: "245158ae-ab60-4367-a2d9-bd271be17552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.779375 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5c0c926-4fc0-4a99-9afd-78835d7ce470-sys-fs\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.779383 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-run-ovn\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.779399 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-host-var-lib-kubelet\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.779503 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea83446f-2e1b-4a1e-9484-2ab8352d998b-system-cni-dir\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.779912 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1340007-5311-40a0-968e-4b9e694f6bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.781534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.780429 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c43a1a5f-5e13-418d-887c-42f1d85fb45f-etc-tuned\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.782703 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.782678 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c43a1a5f-5e13-418d-887c-42f1d85fb45f-tmp\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.782822 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.782779 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a0f3e2d-73f8-4385-8467-527b5b0a0120-agent-certs\") pod \"konnectivity-agent-ntnf9\" (UID: \"4a0f3e2d-73f8-4385-8467-527b5b0a0120\") " pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:04.782883 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.782825 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea83446f-2e1b-4a1e-9484-2ab8352d998b-cni-binary-copy\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.784856 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.784833 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rjz6\" (UniqueName: \"kubernetes.io/projected/e1340007-5311-40a0-968e-4b9e694f6bc4-kube-api-access-7rjz6\") pod \"multus-additional-cni-plugins-cdkv6\" (UID: \"e1340007-5311-40a0-968e-4b9e694f6bc4\") " pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.785520 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.785399 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:49:04.785520 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.785427 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:49:04.785520 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.785441 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wzr4d for pod openshift-network-diagnostics/network-check-target-rtfjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:04.785710 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:04.785538 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d podName:83dbd9b6-df43-40a8-8f09-59143eb73041 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:05.285519843 +0000 UTC m=+3.077261581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wzr4d" (UniqueName: "kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d") pod "network-check-target-rtfjh" (UID: "83dbd9b6-df43-40a8-8f09-59143eb73041") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:04.785975 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.785954 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9n29\" (UniqueName: \"kubernetes.io/projected/c43a1a5f-5e13-418d-887c-42f1d85fb45f-kube-api-access-z9n29\") pod \"tuned-xq7gs\" (UID: \"c43a1a5f-5e13-418d-887c-42f1d85fb45f\") " pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.786433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.786402 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt46f\" (UniqueName: \"kubernetes.io/projected/245158ae-ab60-4367-a2d9-bd271be17552-kube-api-access-vt46f\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:04.788096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.788074 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zzgs\" (UniqueName: \"kubernetes.io/projected/dc338a58-e895-4c9f-900f-15fa7e99427d-kube-api-access-4zzgs\") pod \"node-ca-m4pbg\" (UID: \"dc338a58-e895-4c9f-900f-15fa7e99427d\") " pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.788893 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.788864 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-ovn-node-metrics-cert\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.795027 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.794999 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc4gn\" (UniqueName: \"kubernetes.io/projected/fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3-kube-api-access-tc4gn\") pod \"iptables-alerter-7q7ld\" (UID: \"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3\") " pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.795116 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.795066 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbwlh\" (UniqueName: \"kubernetes.io/projected/ea83446f-2e1b-4a1e-9484-2ab8352d998b-kube-api-access-lbwlh\") pod \"multus-hnt27\" (UID: \"ea83446f-2e1b-4a1e-9484-2ab8352d998b\") " pod="openshift-multus/multus-hnt27" Jul 06 23:49:04.795483 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.795464 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mprc7\" (UniqueName: \"kubernetes.io/projected/a5c0c926-4fc0-4a99-9afd-78835d7ce470-kube-api-access-mprc7\") pod \"aws-ebs-csi-driver-node-6nx2c\" (UID: \"a5c0c926-4fc0-4a99-9afd-78835d7ce470\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.795578 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.795516 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkbtx\" (UniqueName: \"kubernetes.io/projected/4fafd82c-e4f9-4ae3-b9bf-53be91d68251-kube-api-access-gkbtx\") pod \"node-resolver-fvtwk\" (UID: \"4fafd82c-e4f9-4ae3-b9bf-53be91d68251\") " pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.796086 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.796064 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvcf9\" (UniqueName: \"kubernetes.io/projected/19355afb-8b45-45e3-bf24-ea0d81d9dd8f-kube-api-access-gvcf9\") pod \"ovnkube-node-xpvsp\" (UID: \"19355afb-8b45-45e3-bf24-ea0d81d9dd8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.872285 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.872257 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" Jul 06 23:49:04.888276 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.888244 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7q7ld" Jul 06 23:49:04.899272 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.899247 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:04.905237 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.905212 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:04.914920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.914900 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fvtwk" Jul 06 23:49:04.921196 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.921177 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m4pbg" Jul 06 23:49:04.927983 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.927964 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" Jul 06 23:49:04.933944 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.933928 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" Jul 06 23:49:04.939434 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:04.939412 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hnt27" Jul 06 23:49:05.280927 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.280892 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:05.281103 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.280953 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:05.281103 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:05.281082 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:05.281103 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:05.281089 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:05.281282 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:05.281143 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs podName:245158ae-ab60-4367-a2d9-bd271be17552 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:06.281125278 +0000 UTC m=+4.072866994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs") pod "network-metrics-daemon-l5d25" (UID: "245158ae-ab60-4367-a2d9-bd271be17552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:05.281282 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:05.281158 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret podName:e5847788-75fd-4e51-85a4-b41114a18582 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:06.28115125 +0000 UTC m=+4.072892966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret") pod "global-pull-secret-syncer-g9g7s" (UID: "e5847788-75fd-4e51-85a4-b41114a18582") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:05.382113 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.382076 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:05.382299 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:05.382246 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:49:05.382299 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:05.382275 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:49:05.382299 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:05.382289 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wzr4d for pod openshift-network-diagnostics/network-check-target-rtfjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:05.382454 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:05.382353 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d podName:83dbd9b6-df43-40a8-8f09-59143eb73041 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:06.382333582 +0000 UTC m=+4.174075310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzr4d" (UniqueName: "kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d") pod "network-check-target-rtfjh" (UID: "83dbd9b6-df43-40a8-8f09-59143eb73041") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:05.605286 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:05.605257 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43a1a5f_5e13_418d_887c_42f1d85fb45f.slice/crio-0f3b54ab54fe844d15f752d0bd3c97e284391ce1d882c17d79b899403bc6b5dc WatchSource:0}: Error finding container 0f3b54ab54fe844d15f752d0bd3c97e284391ce1d882c17d79b899403bc6b5dc: Status 404 returned error can't find the container with id 0f3b54ab54fe844d15f752d0bd3c97e284391ce1d882c17d79b899403bc6b5dc Jul 06 23:49:05.607697 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:05.607672 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea83446f_2e1b_4a1e_9484_2ab8352d998b.slice/crio-a8d56c8665f182787409b6c78739abc5452a7092c39fe710a8c67e70418dfdf3 WatchSource:0}: Error finding container a8d56c8665f182787409b6c78739abc5452a7092c39fe710a8c67e70418dfdf3: Status 404 returned error can't find the container with id a8d56c8665f182787409b6c78739abc5452a7092c39fe710a8c67e70418dfdf3 Jul 06 23:49:05.608968 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:05.608634 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0f3e2d_73f8_4385_8467_527b5b0a0120.slice/crio-31aa4673e1a8f54faf24ca7548880b0f52c1e903117ef3440242fd6e1892f7f2 WatchSource:0}: Error finding container 31aa4673e1a8f54faf24ca7548880b0f52c1e903117ef3440242fd6e1892f7f2: Status 404 returned error can't find the container with id 31aa4673e1a8f54faf24ca7548880b0f52c1e903117ef3440242fd6e1892f7f2 Jul 06 23:49:05.631025 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:05.630988 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fafd82c_e4f9_4ae3_b9bf_53be91d68251.slice/crio-f0139daa2c772dcad99c36d3a7863c1918fee0ff207b00fcef796c44311b0f66 WatchSource:0}: Error finding container f0139daa2c772dcad99c36d3a7863c1918fee0ff207b00fcef796c44311b0f66: Status 404 returned error can't find the container with id f0139daa2c772dcad99c36d3a7863c1918fee0ff207b00fcef796c44311b0f66 Jul 06 23:49:05.631447 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:05.631425 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c0c926_4fc0_4a99_9afd_78835d7ce470.slice/crio-b0e244043f6194b23c17eaef962579cc33c63a014180455d181de7ee336231c1 WatchSource:0}: Error finding container b0e244043f6194b23c17eaef962579cc33c63a014180455d181de7ee336231c1: Status 404 returned error can't find the container with id b0e244043f6194b23c17eaef962579cc33c63a014180455d181de7ee336231c1 Jul 06 23:49:05.632853 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:05.632764 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5bc07d_1fa6_42eb_b4cd_014587cf8cc3.slice/crio-8e6e6047ec773df9fd601564863adb44229dccd1aedda79a2116e2db7e12725e WatchSource:0}: Error finding container 8e6e6047ec773df9fd601564863adb44229dccd1aedda79a2116e2db7e12725e: Status 404 returned error can't find the container with id 8e6e6047ec773df9fd601564863adb44229dccd1aedda79a2116e2db7e12725e Jul 06 23:49:05.634968 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:05.634395 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc338a58_e895_4c9f_900f_15fa7e99427d.slice/crio-2e9ea8ed15e4ee193278b1682b4721efb5469bd2c74e04123985d89018d8fb2c WatchSource:0}: Error finding container 2e9ea8ed15e4ee193278b1682b4721efb5469bd2c74e04123985d89018d8fb2c: Status 404 returned error can't find the container with id 2e9ea8ed15e4ee193278b1682b4721efb5469bd2c74e04123985d89018d8fb2c Jul 06 23:49:05.635354 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:05.635066 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1340007_5311_40a0_968e_4b9e694f6bc4.slice/crio-ae3e8b62138b56ada43d362ff201fae7be5ebbab1dd7c20eae6120f436fb9a0e WatchSource:0}: Error finding container ae3e8b62138b56ada43d362ff201fae7be5ebbab1dd7c20eae6120f436fb9a0e: Status 404 returned error can't find the container with id ae3e8b62138b56ada43d362ff201fae7be5ebbab1dd7c20eae6120f436fb9a0e Jul 06 23:49:05.636009 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:05.635987 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19355afb_8b45_45e3_bf24_ea0d81d9dd8f.slice/crio-60b669c076ccb2a9f13b5cbe3d6688240796471fdbcdd70292791c11939d8d5a WatchSource:0}: Error finding container 60b669c076ccb2a9f13b5cbe3d6688240796471fdbcdd70292791c11939d8d5a: Status 404 returned error can't find the container with id 60b669c076ccb2a9f13b5cbe3d6688240796471fdbcdd70292791c11939d8d5a Jul 06 23:49:05.698858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.698709 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" event={"ID":"a5c0c926-4fc0-4a99-9afd-78835d7ce470","Type":"ContainerStarted","Data":"b0e244043f6194b23c17eaef962579cc33c63a014180455d181de7ee336231c1"} Jul 06 23:49:05.699855 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.699827 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m4pbg" event={"ID":"dc338a58-e895-4c9f-900f-15fa7e99427d","Type":"ContainerStarted","Data":"2e9ea8ed15e4ee193278b1682b4721efb5469bd2c74e04123985d89018d8fb2c"} Jul 06 23:49:05.701010 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.700983 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7q7ld" event={"ID":"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3","Type":"ContainerStarted","Data":"8e6e6047ec773df9fd601564863adb44229dccd1aedda79a2116e2db7e12725e"} Jul 06 23:49:05.702006 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.701983 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fvtwk" event={"ID":"4fafd82c-e4f9-4ae3-b9bf-53be91d68251","Type":"ContainerStarted","Data":"f0139daa2c772dcad99c36d3a7863c1918fee0ff207b00fcef796c44311b0f66"} Jul 06 23:49:05.702977 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.702955 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntnf9" event={"ID":"4a0f3e2d-73f8-4385-8467-527b5b0a0120","Type":"ContainerStarted","Data":"31aa4673e1a8f54faf24ca7548880b0f52c1e903117ef3440242fd6e1892f7f2"} Jul 06 23:49:05.704233 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.704203 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hnt27" event={"ID":"ea83446f-2e1b-4a1e-9484-2ab8352d998b","Type":"ContainerStarted","Data":"a8d56c8665f182787409b6c78739abc5452a7092c39fe710a8c67e70418dfdf3"} Jul 06 23:49:05.705363 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.705342 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" event={"ID":"c43a1a5f-5e13-418d-887c-42f1d85fb45f","Type":"ContainerStarted","Data":"0f3b54ab54fe844d15f752d0bd3c97e284391ce1d882c17d79b899403bc6b5dc"} Jul 06 23:49:05.706548 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.706522 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" event={"ID":"19355afb-8b45-45e3-bf24-ea0d81d9dd8f","Type":"ContainerStarted","Data":"60b669c076ccb2a9f13b5cbe3d6688240796471fdbcdd70292791c11939d8d5a"} Jul 06 23:49:05.707725 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.707704 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" event={"ID":"e1340007-5311-40a0-968e-4b9e694f6bc4","Type":"ContainerStarted","Data":"ae3e8b62138b56ada43d362ff201fae7be5ebbab1dd7c20eae6120f436fb9a0e"} Jul 06 23:49:05.735420 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.735366 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:44:04 +0000 UTC" deadline="2028-03-16 09:53:26.49286265 +0000 UTC" Jul 06 23:49:05.735420 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:05.735413 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14842h4m20.757452361s" Jul 06 23:49:06.290322 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.290243 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:06.290322 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.290308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:06.290497 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.290483 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:06.291087 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.290547 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs podName:245158ae-ab60-4367-a2d9-bd271be17552 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:08.290529282 +0000 UTC m=+6.082271017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs") pod "network-metrics-daemon-l5d25" (UID: "245158ae-ab60-4367-a2d9-bd271be17552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:06.291087 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.290984 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:06.291087 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.291043 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret podName:e5847788-75fd-4e51-85a4-b41114a18582 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:08.291024513 +0000 UTC m=+6.082766243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret") pod "global-pull-secret-syncer-g9g7s" (UID: "e5847788-75fd-4e51-85a4-b41114a18582") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:06.391543 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.390847 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:06.391543 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.391054 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:49:06.391543 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.391077 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:49:06.391543 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.391090 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wzr4d for pod openshift-network-diagnostics/network-check-target-rtfjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:06.391543 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.391151 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d podName:83dbd9b6-df43-40a8-8f09-59143eb73041 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:08.391132969 +0000 UTC m=+6.182874691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzr4d" (UniqueName: "kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d") pod "network-check-target-rtfjh" (UID: "83dbd9b6-df43-40a8-8f09-59143eb73041") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:06.692345 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.692311 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:06.692825 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.692468 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:06.692890 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.692871 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:06.692985 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.692964 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:06.693059 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.693033 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:06.693132 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:06.693111 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:06.716033 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.715996 2584 generic.go:356] "Generic (PLEG): container finished" podID="de52c8741c2ba60276b0eaf0767f828b" containerID="172319e1a8bd6e17893b89c2faa2f53b6e43c768cfb9f3db175097846e28a9f3" exitCode=0 Jul 06 23:49:06.716204 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.716100 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" event={"ID":"de52c8741c2ba60276b0eaf0767f828b","Type":"ContainerDied","Data":"172319e1a8bd6e17893b89c2faa2f53b6e43c768cfb9f3db175097846e28a9f3"} Jul 06 23:49:06.736408 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.736374 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:44:04 +0000 UTC" deadline="2028-01-05 12:36:55.251690082 +0000 UTC" Jul 06 23:49:06.736408 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.736408 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13140h47m48.515286879s" Jul 06 23:49:06.737293 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.737246 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal" event={"ID":"06a9ea5475b6b02a29732a9404f2a151","Type":"ContainerStarted","Data":"89a7b099ff37c75493661e79028dd255cf3f50cfc72b49c2d107d09fb45e1b0d"} Jul 06 23:49:06.755465 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:06.755398 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-224.ec2.internal" podStartSLOduration=3.75537497 podStartE2EDuration="3.75537497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:06.7549381 +0000 UTC m=+4.546679860" watchObservedRunningTime="2026-07-06 23:49:06.75537497 +0000 UTC m=+4.547116712" Jul 06 23:49:07.750295 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:07.750098 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" event={"ID":"de52c8741c2ba60276b0eaf0767f828b","Type":"ContainerStarted","Data":"1f60fc74425aea232122b91cc276f7278ca76dd983b118bd1dfa4843d8c7490c"} Jul 06 23:49:08.308365 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:08.308326 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:08.308560 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:08.308387 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:08.308560 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.308478 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:08.308560 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.308478 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:08.308560 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.308547 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs podName:245158ae-ab60-4367-a2d9-bd271be17552 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:12.308525688 +0000 UTC m=+10.100267424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs") pod "network-metrics-daemon-l5d25" (UID: "245158ae-ab60-4367-a2d9-bd271be17552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:08.308807 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.308566 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret podName:e5847788-75fd-4e51-85a4-b41114a18582 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:12.308556718 +0000 UTC m=+10.100298441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret") pod "global-pull-secret-syncer-g9g7s" (UID: "e5847788-75fd-4e51-85a4-b41114a18582") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:08.409053 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:08.409016 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:08.409265 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.409248 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:49:08.409338 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.409276 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:49:08.409338 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.409289 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wzr4d for pod openshift-network-diagnostics/network-check-target-rtfjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:08.409438 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.409348 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d podName:83dbd9b6-df43-40a8-8f09-59143eb73041 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:12.409329886 +0000 UTC m=+10.201071622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzr4d" (UniqueName: "kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d") pod "network-check-target-rtfjh" (UID: "83dbd9b6-df43-40a8-8f09-59143eb73041") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:08.690381 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:08.690350 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:08.690381 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:08.690377 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:08.690628 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.690477 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:08.690628 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.690516 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:08.690628 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:08.690568 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:08.690781 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:08.690631 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:10.690893 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:10.690808 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:10.691336 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:10.690957 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:10.691437 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:10.691412 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:10.691521 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:10.691504 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:10.691574 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:10.691550 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:10.691716 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:10.691643 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:12.344679 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:12.344639 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:12.345145 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.344903 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:12.345145 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.344968 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs podName:245158ae-ab60-4367-a2d9-bd271be17552 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:20.344952295 +0000 UTC m=+18.136694023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs") pod "network-metrics-daemon-l5d25" (UID: "245158ae-ab60-4367-a2d9-bd271be17552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:12.345329 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:12.345304 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:12.345392 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.345380 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:12.345443 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.345433 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret podName:e5847788-75fd-4e51-85a4-b41114a18582 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:20.345416703 +0000 UTC m=+18.137158434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret") pod "global-pull-secret-syncer-g9g7s" (UID: "e5847788-75fd-4e51-85a4-b41114a18582") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:12.445991 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:12.445951 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:12.446167 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.446141 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:49:12.446167 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.446159 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:49:12.446167 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.446168 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wzr4d for pod openshift-network-diagnostics/network-check-target-rtfjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:12.446338 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.446214 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d podName:83dbd9b6-df43-40a8-8f09-59143eb73041 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:20.446199215 +0000 UTC m=+18.237940943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzr4d" (UniqueName: "kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d") pod "network-check-target-rtfjh" (UID: "83dbd9b6-df43-40a8-8f09-59143eb73041") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:12.693742 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:12.693000 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:12.693742 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.693119 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:12.693742 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:12.693481 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:12.693742 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.693556 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:12.693742 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:12.693630 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:12.693742 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:12.693711 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:14.690446 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:14.690403 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:14.690928 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:14.690531 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:14.690928 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:14.690873 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:14.691043 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:14.690958 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:14.691043 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:14.690993 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:14.691043 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:14.691041 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:16.690232 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:16.690190 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:16.690715 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:16.690189 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:16.690715 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:16.690199 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:16.690715 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:16.690357 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:16.690715 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:16.690497 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:16.690715 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:16.690650 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:18.689984 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:18.689941 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:18.690418 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:18.689949 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:18.690418 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:18.690087 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:18.690418 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:18.690152 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:18.690418 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:18.689959 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:18.690418 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:18.690244 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:20.410040 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:20.409946 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:20.410040 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:20.410002 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:20.410493 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.410122 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:20.410493 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.410126 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:20.410493 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.410186 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs podName:245158ae-ab60-4367-a2d9-bd271be17552 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:36.410166299 +0000 UTC m=+34.201908015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs") pod "network-metrics-daemon-l5d25" (UID: "245158ae-ab60-4367-a2d9-bd271be17552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:20.410493 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.410207 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret podName:e5847788-75fd-4e51-85a4-b41114a18582 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:36.41019656 +0000 UTC m=+34.201938276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret") pod "global-pull-secret-syncer-g9g7s" (UID: "e5847788-75fd-4e51-85a4-b41114a18582") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:20.510693 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:20.510640 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:20.510866 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.510820 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:49:20.510866 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.510850 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:49:20.510866 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.510863 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wzr4d for pod openshift-network-diagnostics/network-check-target-rtfjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:20.511005 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.510927 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d podName:83dbd9b6-df43-40a8-8f09-59143eb73041 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:36.510905964 +0000 UTC m=+34.302647701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzr4d" (UniqueName: "kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d") pod "network-check-target-rtfjh" (UID: "83dbd9b6-df43-40a8-8f09-59143eb73041") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:20.690231 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:20.690139 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:20.690231 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:20.690165 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:20.690430 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:20.690140 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:20.690430 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.690274 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:20.690430 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.690381 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:20.690526 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:20.690470 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:22.690980 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:22.690944 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:22.691458 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:22.691052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:22.691458 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:22.691083 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:22.691458 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:22.691101 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:22.691458 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:22.691163 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:22.691458 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:22.691245 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:24.693118 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:24.692322 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:24.693118 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:24.692442 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:24.693118 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:24.692842 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:24.693118 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:24.692938 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:24.693118 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:24.692997 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:24.693118 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:24.693074 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:25.786838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.786415 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntnf9" event={"ID":"4a0f3e2d-73f8-4385-8467-527b5b0a0120","Type":"ContainerStarted","Data":"67ea3793b980b17b3ce9a982322333b2018c9fa79deb51d2f4a00d4bbe79a46c"} Jul 06 23:49:25.787992 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.787964 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hnt27" event={"ID":"ea83446f-2e1b-4a1e-9484-2ab8352d998b","Type":"ContainerStarted","Data":"d635e7c76d66e59084c0c009ae6ae5f12b39fad90ed61496f6a56d4fd3ad8dfe"} Jul 06 23:49:25.789288 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.789256 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" event={"ID":"c43a1a5f-5e13-418d-887c-42f1d85fb45f","Type":"ContainerStarted","Data":"1a5a7ac1482c492119e268408d4cc4587bef2fd0854f6b19fcdb70eeecd87468"} Jul 06 23:49:25.792260 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.792237 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" event={"ID":"19355afb-8b45-45e3-bf24-ea0d81d9dd8f","Type":"ContainerStarted","Data":"d997f2b5225d737c79b96d70244a2b9f3085441fa652646cee19a7a2b85538d1"} Jul 06 23:49:25.792401 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.792310 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" event={"ID":"19355afb-8b45-45e3-bf24-ea0d81d9dd8f","Type":"ContainerStarted","Data":"e2290a2077019f61d0b5176f7aa8a8fe9e98540980a8c18dafcb9bf4b0713c19"} Jul 06 23:49:25.792401 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.792362 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" event={"ID":"19355afb-8b45-45e3-bf24-ea0d81d9dd8f","Type":"ContainerStarted","Data":"932be1d6b5a2fa921070bbe5bf47128f23dc814266719595862cea13d601f75e"} Jul 06 23:49:25.792514 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.792408 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" event={"ID":"19355afb-8b45-45e3-bf24-ea0d81d9dd8f","Type":"ContainerStarted","Data":"a41978a0ce80badf5926f541a1133c6e1ec8751655b84cf222d3c88cd2a604f5"} Jul 06 23:49:25.792514 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.792456 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" event={"ID":"19355afb-8b45-45e3-bf24-ea0d81d9dd8f","Type":"ContainerStarted","Data":"43dbdfe7bccc4a0430ceaf040b869ad95b32bffba053b01227fb651049717cb9"} Jul 06 23:49:25.792514 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.792504 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" event={"ID":"19355afb-8b45-45e3-bf24-ea0d81d9dd8f","Type":"ContainerStarted","Data":"d74b01f632612dc29977792da667a114f55f8af600da9293b3705bcf6fed5d7e"} Jul 06 23:49:25.793813 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.793778 2584 generic.go:356] "Generic (PLEG): container finished" podID="e1340007-5311-40a0-968e-4b9e694f6bc4" containerID="6cb769423da34e99b3d1f25e82149c586faae79e9fea966b36204fad105c4cb6" exitCode=0 Jul 06 23:49:25.793933 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.793861 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" event={"ID":"e1340007-5311-40a0-968e-4b9e694f6bc4","Type":"ContainerDied","Data":"6cb769423da34e99b3d1f25e82149c586faae79e9fea966b36204fad105c4cb6"} Jul 06 23:49:25.795350 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.795287 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" event={"ID":"a5c0c926-4fc0-4a99-9afd-78835d7ce470","Type":"ContainerStarted","Data":"cc6087234e5248f0f876698bee49247ff5a392f747ba7e60744f38c24b801103"} Jul 06 23:49:25.796773 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.796755 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m4pbg" event={"ID":"dc338a58-e895-4c9f-900f-15fa7e99427d","Type":"ContainerStarted","Data":"11de00c76eb69c4ff2cb5dce84ad635317a1f50b7fefc02d3af2c12d5d6dbb79"} Jul 06 23:49:25.798149 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.798128 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fvtwk" event={"ID":"4fafd82c-e4f9-4ae3-b9bf-53be91d68251","Type":"ContainerStarted","Data":"114b27e246b4f78f67c82236e64f2f2a6e432a1d8d717444cd1961e71e87c52e"} Jul 06 23:49:25.801039 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.801005 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-224.ec2.internal" podStartSLOduration=22.800993014 podStartE2EDuration="22.800993014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:07.766298643 +0000 UTC m=+5.558040381" watchObservedRunningTime="2026-07-06 23:49:25.800993014 +0000 UTC m=+23.592734752" Jul 06 23:49:25.801289 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.801269 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ntnf9" podStartSLOduration=9.284935876 podStartE2EDuration="23.801263955s" totalImagesPullingTime="14.516328079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:25.800973302 +0000 UTC m=+23.592715031" watchObservedRunningTime="2026-07-06 23:49:25.801263955 +0000 UTC m=+23.593005693" Jul 06 23:49:25.815787 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.815724 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fvtwk" podStartSLOduration=4.81613286 podStartE2EDuration="23.815703412s" totalImagesPullingTime="18.999570552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:25.815504482 +0000 UTC m=+23.607246220" watchObservedRunningTime="2026-07-06 23:49:25.815703412 +0000 UTC m=+23.607445149" Jul 06 23:49:25.844186 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.844147 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xq7gs" podStartSLOduration=4.7939230120000005 podStartE2EDuration="23.844132967s" totalImagesPullingTime="19.050209955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:25.843738964 +0000 UTC m=+23.635480703" watchObservedRunningTime="2026-07-06 23:49:25.844132967 +0000 UTC m=+23.635874705" Jul 06 23:49:25.844310 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.844237 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m4pbg" podStartSLOduration=4.856664411 podStartE2EDuration="23.84423104s" totalImagesPullingTime="18.987566629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:25.827401115 +0000 UTC m=+23.619142865" watchObservedRunningTime="2026-07-06 23:49:25.84423104 +0000 UTC m=+23.635972780" Jul 06 23:49:25.884379 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:25.884334 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hnt27" podStartSLOduration=4.833016161 podStartE2EDuration="23.884318222s" totalImagesPullingTime="19.051302061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:25.884149158 +0000 UTC m=+23.675890896" watchObservedRunningTime="2026-07-06 23:49:25.884318222 +0000 UTC m=+23.676059961" Jul 06 23:49:26.016312 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.016288 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:26.016900 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.016880 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:26.146289 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.146261 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 23:49:26.637074 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.636955 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:49:26.14628696Z","UUID":"3fd4541b-78c4-4b7e-b712-b2b41bd223d9","Handler":null,"Name":"","Endpoint":""} Jul 06 23:49:26.638829 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.638781 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 23:49:26.638971 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.638851 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 23:49:26.690039 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.689988 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:26.690224 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:26.690122 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:26.690529 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.690509 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:26.690729 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:26.690632 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:26.690809 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.690766 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:26.690862 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:26.690845 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:26.804272 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.804236 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" event={"ID":"a5c0c926-4fc0-4a99-9afd-78835d7ce470","Type":"ContainerStarted","Data":"518166bf424857e975f5c01d95a2bd87129ee421797553b5d15b4c95a8c95e56"} Jul 06 23:49:26.805978 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.805942 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7q7ld" event={"ID":"fe5bc07d-1fa6-42eb-b4cd-014587cf8cc3","Type":"ContainerStarted","Data":"3a80cf7174c57744e761a00bb8b65daf34e4ae2c48669d3d43f7c3ae012cc9b1"} Jul 06 23:49:26.806904 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.806876 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:26.807537 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.807517 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ntnf9" Jul 06 23:49:26.827086 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:26.827041 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7q7ld" podStartSLOduration=5.837068813 podStartE2EDuration="24.8270259s" totalImagesPullingTime="18.989957087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:26.826760478 +0000 UTC m=+24.618502216" watchObservedRunningTime="2026-07-06 23:49:26.8270259 +0000 UTC m=+24.618767662" Jul 06 23:49:27.812177 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:27.812095 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" event={"ID":"19355afb-8b45-45e3-bf24-ea0d81d9dd8f","Type":"ContainerStarted","Data":"1e7e17a58dcee9532c10a612b9914ee941a46bcc7be35341b8a708792c36692b"} Jul 06 23:49:27.814536 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:27.814500 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" event={"ID":"a5c0c926-4fc0-4a99-9afd-78835d7ce470","Type":"ContainerStarted","Data":"76568506722fe5deb4cf8a4b77f56fdd90c2e54131840ddccd76fad792307414"} Jul 06 23:49:27.834316 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:27.834257 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nx2c" podStartSLOduration=4.584785643 podStartE2EDuration="25.834232861s" totalImagesPullingTime="21.249447218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:27.834067652 +0000 UTC m=+25.625809410" watchObservedRunningTime="2026-07-06 23:49:27.834232861 +0000 UTC m=+25.625974600" Jul 06 23:49:28.690460 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:28.690424 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:28.690671 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:28.690464 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:28.690671 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:28.690532 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:28.690671 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:28.690664 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:28.690837 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:28.690814 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:28.690950 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:28.690921 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:30.690581 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:30.690281 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:30.691189 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:30.690281 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:30.691189 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:30.690281 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:30.691189 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:30.690678 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:30.691189 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:30.690783 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:30.691189 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:30.690872 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:30.824598 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:30.824564 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" event={"ID":"19355afb-8b45-45e3-bf24-ea0d81d9dd8f","Type":"ContainerStarted","Data":"9ca9401b66ce961c0c8b1ea5fe7bb451807dbbf70d13c734ff5d22bf0e06e746"} Jul 06 23:49:30.824870 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:30.824848 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:30.826453 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:30.826430 2584 generic.go:356] "Generic (PLEG): container finished" podID="e1340007-5311-40a0-968e-4b9e694f6bc4" containerID="c2edc5524ae0426ba13efc5ef5f9e24986ee0b7416c1a13461932953cf925c82" exitCode=0 Jul 06 23:49:30.826561 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:30.826465 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" event={"ID":"e1340007-5311-40a0-968e-4b9e694f6bc4","Type":"ContainerDied","Data":"c2edc5524ae0426ba13efc5ef5f9e24986ee0b7416c1a13461932953cf925c82"} Jul 06 23:49:30.841952 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:30.841923 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:30.910762 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:30.910712 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" podStartSLOduration=9.844976813 podStartE2EDuration="28.910695328s" totalImagesPullingTime="19.065718515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:30.873780015 +0000 UTC m=+28.665521766" watchObservedRunningTime="2026-07-06 23:49:30.910695328 +0000 UTC m=+28.702437065" Jul 06 23:49:31.829660 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:31.829627 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:31.830155 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:31.829751 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:31.846086 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:31.846054 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:49:31.899718 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:31.899684 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5d25"] Jul 06 23:49:31.899867 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:31.899838 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:31.900000 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:31.899970 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:31.902948 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:31.902921 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g9g7s"] Jul 06 23:49:31.903068 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:31.903023 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:31.903136 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:31.903113 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:31.913157 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:31.913027 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rtfjh"] Jul 06 23:49:31.913157 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:31.913117 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:31.913275 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:31.913186 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:32.832898 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:32.832861 2584 generic.go:356] "Generic (PLEG): container finished" podID="e1340007-5311-40a0-968e-4b9e694f6bc4" containerID="c5d519bb1825291f952b200ce75f1cd95f6de733a4f2e49c9ccb5c502c327e9e" exitCode=0 Jul 06 23:49:32.833269 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:32.832940 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" event={"ID":"e1340007-5311-40a0-968e-4b9e694f6bc4","Type":"ContainerDied","Data":"c5d519bb1825291f952b200ce75f1cd95f6de733a4f2e49c9ccb5c502c327e9e"} Jul 06 23:49:33.690310 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:33.690274 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:33.690472 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:33.690389 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:33.690472 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:33.690394 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:33.690552 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:33.690494 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:33.690552 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:33.690397 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:33.690647 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:33.690584 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:34.839773 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:34.839504 2584 generic.go:356] "Generic (PLEG): container finished" podID="e1340007-5311-40a0-968e-4b9e694f6bc4" containerID="f63d5c9a8c8af4b7f4fb167ff6e74c4b752f1e506f28f59ae761d934ba4a419e" exitCode=0 Jul 06 23:49:34.839773 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:34.839592 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" event={"ID":"e1340007-5311-40a0-968e-4b9e694f6bc4","Type":"ContainerDied","Data":"f63d5c9a8c8af4b7f4fb167ff6e74c4b752f1e506f28f59ae761d934ba4a419e"} Jul 06 23:49:35.690590 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:35.690549 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:35.690590 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:35.690581 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:35.690871 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:35.690622 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:35.690871 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:35.690711 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5d25" podUID="245158ae-ab60-4367-a2d9-bd271be17552" Jul 06 23:49:35.690976 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:35.690833 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtfjh" podUID="83dbd9b6-df43-40a8-8f09-59143eb73041" Jul 06 23:49:35.690976 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:35.690941 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g7s" podUID="e5847788-75fd-4e51-85a4-b41114a18582" Jul 06 23:49:36.431857 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:36.431817 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:36.432294 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:36.431875 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:36.432294 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:36.432015 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:36.432294 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:36.432030 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:36.432294 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:36.432103 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs podName:245158ae-ab60-4367-a2d9-bd271be17552 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:08.432074107 +0000 UTC m=+66.223815824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs") pod "network-metrics-daemon-l5d25" (UID: "245158ae-ab60-4367-a2d9-bd271be17552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:49:36.432294 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:36.432126 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret podName:e5847788-75fd-4e51-85a4-b41114a18582 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:08.432114646 +0000 UTC m=+66.223856364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret") pod "global-pull-secret-syncer-g9g7s" (UID: "e5847788-75fd-4e51-85a4-b41114a18582") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:49:36.532439 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:36.532401 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:36.532640 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:36.532585 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:49:36.532640 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:36.532638 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:49:36.532754 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:36.532652 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wzr4d for pod openshift-network-diagnostics/network-check-target-rtfjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:36.532754 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:36.532721 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d podName:83dbd9b6-df43-40a8-8f09-59143eb73041 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:08.532699576 +0000 UTC m=+66.324441312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzr4d" (UniqueName: "kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d") pod "network-check-target-rtfjh" (UID: "83dbd9b6-df43-40a8-8f09-59143eb73041") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:49:37.498370 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.498294 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-224.ec2.internal" event="NodeReady" Jul 06 23:49:37.498843 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.498444 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 23:49:37.544854 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.544821 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tjgb4"] Jul 06 23:49:37.549504 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.549478 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b7h9m"] Jul 06 23:49:37.549692 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.549646 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.552625 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.552226 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 23:49:37.552625 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.552259 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p99x7\"" Jul 06 23:49:37.552625 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.552445 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 23:49:37.553213 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.553195 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7h9m" Jul 06 23:49:37.555205 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.555185 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 23:49:37.555337 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.555233 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hk7zr\"" Jul 06 23:49:37.555337 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.555285 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 23:49:37.555337 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.555232 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 23:49:37.558479 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.558454 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tjgb4"] Jul 06 23:49:37.563517 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.563494 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7h9m"] Jul 06 23:49:37.641622 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.641571 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snxmd\" (UniqueName: \"kubernetes.io/projected/c9fabb51-1838-44ae-81e7-70690bc4b093-kube-api-access-snxmd\") pod \"ingress-canary-b7h9m\" (UID: \"c9fabb51-1838-44ae-81e7-70690bc4b093\") " pod="openshift-ingress-canary/ingress-canary-b7h9m" Jul 06 23:49:37.641806 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.641632 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.641806 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.641668 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0d495b0-9d58-4063-893b-3235af97c343-config-volume\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.641806 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.641713 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0d495b0-9d58-4063-893b-3235af97c343-tmp-dir\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.641806 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.641783 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9fabb51-1838-44ae-81e7-70690bc4b093-cert\") pod \"ingress-canary-b7h9m\" (UID: \"c9fabb51-1838-44ae-81e7-70690bc4b093\") " pod="openshift-ingress-canary/ingress-canary-b7h9m" Jul 06 23:49:37.642019 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.641872 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpc5x\" (UniqueName: \"kubernetes.io/projected/a0d495b0-9d58-4063-893b-3235af97c343-kube-api-access-kpc5x\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.689847 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.689809 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:49:37.689847 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.689848 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:49:37.690076 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.689848 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:49:37.693045 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.693020 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:49:37.693203 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.693136 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9m58d\"" Jul 06 23:49:37.693305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.693237 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:49:37.693531 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.693503 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:49:37.693531 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.693519 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:49:37.693770 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.693754 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7lfhk\"" Jul 06 23:49:37.742205 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.742169 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.742205 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.742217 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0d495b0-9d58-4063-893b-3235af97c343-config-volume\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.742450 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.742266 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0d495b0-9d58-4063-893b-3235af97c343-tmp-dir\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.742450 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.742296 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9fabb51-1838-44ae-81e7-70690bc4b093-cert\") pod \"ingress-canary-b7h9m\" (UID: \"c9fabb51-1838-44ae-81e7-70690bc4b093\") " pod="openshift-ingress-canary/ingress-canary-b7h9m" Jul 06 23:49:37.742450 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.742335 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpc5x\" (UniqueName: \"kubernetes.io/projected/a0d495b0-9d58-4063-893b-3235af97c343-kube-api-access-kpc5x\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.742450 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:37.742339 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:49:37.742450 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.742376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snxmd\" (UniqueName: \"kubernetes.io/projected/c9fabb51-1838-44ae-81e7-70690bc4b093-kube-api-access-snxmd\") pod \"ingress-canary-b7h9m\" (UID: \"c9fabb51-1838-44ae-81e7-70690bc4b093\") " pod="openshift-ingress-canary/ingress-canary-b7h9m" Jul 06 23:49:37.742450 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:37.742403 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls podName:a0d495b0-9d58-4063-893b-3235af97c343 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:38.242383239 +0000 UTC m=+36.034125170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls") pod "dns-default-tjgb4" (UID: "a0d495b0-9d58-4063-893b-3235af97c343") : secret "dns-default-metrics-tls" not found Jul 06 23:49:37.742750 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.742702 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0d495b0-9d58-4063-893b-3235af97c343-tmp-dir\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.742891 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.742873 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0d495b0-9d58-4063-893b-3235af97c343-config-volume\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.747229 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.747204 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9fabb51-1838-44ae-81e7-70690bc4b093-cert\") pod \"ingress-canary-b7h9m\" (UID: \"c9fabb51-1838-44ae-81e7-70690bc4b093\") " pod="openshift-ingress-canary/ingress-canary-b7h9m" Jul 06 23:49:37.754583 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.754514 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snxmd\" (UniqueName: \"kubernetes.io/projected/c9fabb51-1838-44ae-81e7-70690bc4b093-kube-api-access-snxmd\") pod \"ingress-canary-b7h9m\" (UID: \"c9fabb51-1838-44ae-81e7-70690bc4b093\") " pod="openshift-ingress-canary/ingress-canary-b7h9m" Jul 06 23:49:37.756151 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.756130 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpc5x\" (UniqueName: \"kubernetes.io/projected/a0d495b0-9d58-4063-893b-3235af97c343-kube-api-access-kpc5x\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:37.869382 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:37.869348 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7h9m" Jul 06 23:49:38.245431 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:38.245392 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:38.245634 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:38.245569 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:49:38.245688 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:38.245651 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls podName:a0d495b0-9d58-4063-893b-3235af97c343 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:39.245632957 +0000 UTC m=+37.037374673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls") pod "dns-default-tjgb4" (UID: "a0d495b0-9d58-4063-893b-3235af97c343") : secret "dns-default-metrics-tls" not found Jul 06 23:49:38.985466 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:38.985294 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7h9m"] Jul 06 23:49:38.990147 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:38.990124 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9fabb51_1838_44ae_81e7_70690bc4b093.slice/crio-3ae1f2a12e58da2e3e7c21566d0ea2e0be0b5ed78aad08f9cc74be59ecedbc82 WatchSource:0}: Error finding container 3ae1f2a12e58da2e3e7c21566d0ea2e0be0b5ed78aad08f9cc74be59ecedbc82: Status 404 returned error can't find the container with id 3ae1f2a12e58da2e3e7c21566d0ea2e0be0b5ed78aad08f9cc74be59ecedbc82 Jul 06 23:49:39.254232 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:39.254184 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:39.254433 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:39.254327 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:49:39.254433 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:39.254400 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls podName:a0d495b0-9d58-4063-893b-3235af97c343 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:41.254381193 +0000 UTC m=+39.046122923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls") pod "dns-default-tjgb4" (UID: "a0d495b0-9d58-4063-893b-3235af97c343") : secret "dns-default-metrics-tls" not found Jul 06 23:49:39.855670 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:39.855631 2584 generic.go:356] "Generic (PLEG): container finished" podID="e1340007-5311-40a0-968e-4b9e694f6bc4" containerID="6dafb9d35092b4ffe7827e6faaa059bbe83d40f2fe81cb6c487700dba00dee6c" exitCode=0 Jul 06 23:49:39.855855 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:39.855673 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" event={"ID":"e1340007-5311-40a0-968e-4b9e694f6bc4","Type":"ContainerDied","Data":"6dafb9d35092b4ffe7827e6faaa059bbe83d40f2fe81cb6c487700dba00dee6c"} Jul 06 23:49:39.857034 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:39.856998 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7h9m" event={"ID":"c9fabb51-1838-44ae-81e7-70690bc4b093","Type":"ContainerStarted","Data":"3ae1f2a12e58da2e3e7c21566d0ea2e0be0b5ed78aad08f9cc74be59ecedbc82"} Jul 06 23:49:40.863285 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:40.863245 2584 generic.go:356] "Generic (PLEG): container finished" podID="e1340007-5311-40a0-968e-4b9e694f6bc4" containerID="1d52594ae6595b7bbbec81e41957ae8dc7abaf6eddebc7999ed3df2cd29820de" exitCode=0 Jul 06 23:49:40.863711 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:40.863302 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" event={"ID":"e1340007-5311-40a0-968e-4b9e694f6bc4","Type":"ContainerDied","Data":"1d52594ae6595b7bbbec81e41957ae8dc7abaf6eddebc7999ed3df2cd29820de"} Jul 06 23:49:41.271899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:41.271859 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:41.272091 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:41.271987 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:49:41.272091 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:41.272058 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls podName:a0d495b0-9d58-4063-893b-3235af97c343 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:45.272038198 +0000 UTC m=+43.063779915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls") pod "dns-default-tjgb4" (UID: "a0d495b0-9d58-4063-893b-3235af97c343") : secret "dns-default-metrics-tls" not found Jul 06 23:49:41.869640 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:41.869373 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" event={"ID":"e1340007-5311-40a0-968e-4b9e694f6bc4","Type":"ContainerStarted","Data":"5b646b8eb5ba0305d2643f2f2d158f3baf6fd4a9c80a11c6d9d96f27d4bf6628"} Jul 06 23:49:41.896932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:41.896888 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cdkv6" podStartSLOduration=10.65964293 podStartE2EDuration="39.896871014s" totalImagesPullingTime="29.237228084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:41.895142024 +0000 UTC m=+39.686883782" watchObservedRunningTime="2026-07-06 23:49:41.896871014 +0000 UTC m=+39.688612751" Jul 06 23:49:42.873558 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:42.873513 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7h9m" event={"ID":"c9fabb51-1838-44ae-81e7-70690bc4b093","Type":"ContainerStarted","Data":"1c66c16e89a64d877dea83d318bb65ce5a49062d4ddbcd7dee703e5c2f98515a"} Jul 06 23:49:42.893143 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:42.893082 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b7h9m" podStartSLOduration=3.121981189 podStartE2EDuration="5.893060999s" totalImagesPullingTime="2.77107981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:42.892294081 +0000 UTC m=+40.684035840" watchObservedRunningTime="2026-07-06 23:49:42.893060999 +0000 UTC m=+40.684802738" Jul 06 23:49:45.136491 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.136455 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb"] Jul 06 23:49:45.164185 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.164153 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb"] Jul 06 23:49:45.164342 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.164274 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb" Jul 06 23:49:45.168667 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.168642 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6xskd\"" Jul 06 23:49:45.168853 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.168834 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 23:49:45.168940 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.168922 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 23:49:45.302538 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.302502 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxgqf\" (UniqueName: \"kubernetes.io/projected/9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5-kube-api-access-bxgqf\") pod \"migrator-d57d58cc9-pxqhb\" (UID: \"9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb" Jul 06 23:49:45.302723 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.302591 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:45.302723 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:45.302700 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:49:45.302831 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:45.302768 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls podName:a0d495b0-9d58-4063-893b-3235af97c343 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:53.30275006 +0000 UTC m=+51.094491776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls") pod "dns-default-tjgb4" (UID: "a0d495b0-9d58-4063-893b-3235af97c343") : secret "dns-default-metrics-tls" not found Jul 06 23:49:45.403139 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.403040 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxgqf\" (UniqueName: \"kubernetes.io/projected/9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5-kube-api-access-bxgqf\") pod \"migrator-d57d58cc9-pxqhb\" (UID: \"9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb" Jul 06 23:49:45.417208 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.417175 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxgqf\" (UniqueName: \"kubernetes.io/projected/9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5-kube-api-access-bxgqf\") pod \"migrator-d57d58cc9-pxqhb\" (UID: \"9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb" Jul 06 23:49:45.472966 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.472928 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb" Jul 06 23:49:45.546009 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.545097 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zvblv"] Jul 06 23:49:45.580348 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.578823 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvblv"] Jul 06 23:49:45.580348 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.578971 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.582770 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.582738 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 23:49:45.582925 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.582792 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 23:49:45.582925 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.582797 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 23:49:45.582925 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.582745 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 23:49:45.582925 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.582911 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lr2cs\"" Jul 06 23:49:45.637158 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.637127 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb"] Jul 06 23:49:45.640711 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:45.640686 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3d9a49_ed7b_45af_94b1_d7717fbe2ab5.slice/crio-e21e1d57f2e9fab6fe4d996bb111cd789ed90a5fc8b798f8b2337fc6e8ebbedb WatchSource:0}: Error finding container e21e1d57f2e9fab6fe4d996bb111cd789ed90a5fc8b798f8b2337fc6e8ebbedb: Status 404 returned error can't find the container with id e21e1d57f2e9fab6fe4d996bb111cd789ed90a5fc8b798f8b2337fc6e8ebbedb Jul 06 23:49:45.705024 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.704928 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d50ba7-0b96-4c1f-b99a-5106796e7609-data-volume\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.705024 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.704970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t554\" (UniqueName: \"kubernetes.io/projected/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-api-access-8t554\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.705024 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.704990 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.705251 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.705065 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.705251 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.705136 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57d50ba7-0b96-4c1f-b99a-5106796e7609-crio-socket\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.805459 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.805421 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.805518 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.805466 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57d50ba7-0b96-4c1f-b99a-5106796e7609-crio-socket\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.805577 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.805535 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d50ba7-0b96-4c1f-b99a-5106796e7609-data-volume\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.805577 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:45.805536 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:49:45.805577 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.805553 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t554\" (UniqueName: \"kubernetes.io/projected/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-api-access-8t554\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.805730 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.805577 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.805730 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:45.805627 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:46.305584384 +0000 UTC m=+44.097326189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : configmap "kube-rbac-proxy" not found Jul 06 23:49:45.805730 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:45.805694 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:49:45.805867 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:45.805749 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:46.305731855 +0000 UTC m=+44.097473590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : secret "insights-runtime-extractor-tls" not found Jul 06 23:49:45.805867 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.805783 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57d50ba7-0b96-4c1f-b99a-5106796e7609-crio-socket\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.805951 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.805866 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d50ba7-0b96-4c1f-b99a-5106796e7609-data-volume\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.813252 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.813227 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t554\" (UniqueName: \"kubernetes.io/projected/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-api-access-8t554\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:45.882124 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:45.882088 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb" event={"ID":"9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5","Type":"ContainerStarted","Data":"e21e1d57f2e9fab6fe4d996bb111cd789ed90a5fc8b798f8b2337fc6e8ebbedb"} Jul 06 23:49:46.309408 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:46.309365 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:46.309408 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:46.309410 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:46.309882 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:46.309533 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:49:46.309882 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:46.309536 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:49:46.309882 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:46.309587 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:47.30957253 +0000 UTC m=+45.101314245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : configmap "kube-rbac-proxy" not found Jul 06 23:49:46.309882 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:46.309619 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:47.309594119 +0000 UTC m=+45.101335835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : secret "insights-runtime-extractor-tls" not found Jul 06 23:49:47.317757 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:47.317718 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:47.317757 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:47.317758 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:47.318231 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:47.317849 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:49:47.318231 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:47.317906 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:49.31789011 +0000 UTC m=+47.109631848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : configmap "kube-rbac-proxy" not found Jul 06 23:49:47.318231 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:47.317912 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:49:47.318231 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:47.318001 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:49.317981223 +0000 UTC m=+47.109722956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : secret "insights-runtime-extractor-tls" not found Jul 06 23:49:47.889642 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:47.889585 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb" event={"ID":"9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5","Type":"ContainerStarted","Data":"9cf1c1fd125e3dab261da3c6de0fd37e55656a7ba5153446889bc48d29a94b87"} Jul 06 23:49:47.889872 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:47.889669 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb" event={"ID":"9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5","Type":"ContainerStarted","Data":"5821e860c949fe808d1b486fdf96b7e2bb7eef527a187e163a58f9305a6aa899"} Jul 06 23:49:47.906825 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:47.906777 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pxqhb" podStartSLOduration=1.2283091050000001 podStartE2EDuration="2.906761606s" totalImagesPullingTime="1.678452501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:47.905912145 +0000 UTC m=+45.697653883" watchObservedRunningTime="2026-07-06 23:49:47.906761606 +0000 UTC m=+45.698503344" Jul 06 23:49:48.090213 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.090178 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-g964d"] Jul 06 23:49:48.114218 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.114184 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-g964d"] Jul 06 23:49:48.114363 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.114280 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.116828 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.116806 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lrkw4\"" Jul 06 23:49:48.116967 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.116854 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 23:49:48.116967 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.116814 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 23:49:48.116967 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.116854 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 23:49:48.117113 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.116810 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 23:49:48.226362 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.226266 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2fa59cb-7305-4828-9b60-62d6be54758a-signing-cabundle\") pod \"service-ca-758f599c5-g964d\" (UID: \"d2fa59cb-7305-4828-9b60-62d6be54758a\") " pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.226362 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.226317 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5p8l\" (UniqueName: \"kubernetes.io/projected/d2fa59cb-7305-4828-9b60-62d6be54758a-kube-api-access-s5p8l\") pod \"service-ca-758f599c5-g964d\" (UID: \"d2fa59cb-7305-4828-9b60-62d6be54758a\") " pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.226362 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.226353 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2fa59cb-7305-4828-9b60-62d6be54758a-signing-key\") pod \"service-ca-758f599c5-g964d\" (UID: \"d2fa59cb-7305-4828-9b60-62d6be54758a\") " pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.327325 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.327288 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5p8l\" (UniqueName: \"kubernetes.io/projected/d2fa59cb-7305-4828-9b60-62d6be54758a-kube-api-access-s5p8l\") pod \"service-ca-758f599c5-g964d\" (UID: \"d2fa59cb-7305-4828-9b60-62d6be54758a\") " pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.327741 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.327347 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2fa59cb-7305-4828-9b60-62d6be54758a-signing-key\") pod \"service-ca-758f599c5-g964d\" (UID: \"d2fa59cb-7305-4828-9b60-62d6be54758a\") " pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.327741 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.327419 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2fa59cb-7305-4828-9b60-62d6be54758a-signing-cabundle\") pod \"service-ca-758f599c5-g964d\" (UID: \"d2fa59cb-7305-4828-9b60-62d6be54758a\") " pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.328120 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.328094 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2fa59cb-7305-4828-9b60-62d6be54758a-signing-cabundle\") pod \"service-ca-758f599c5-g964d\" (UID: \"d2fa59cb-7305-4828-9b60-62d6be54758a\") " pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.329926 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.329884 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2fa59cb-7305-4828-9b60-62d6be54758a-signing-key\") pod \"service-ca-758f599c5-g964d\" (UID: \"d2fa59cb-7305-4828-9b60-62d6be54758a\") " pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.343661 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.343631 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5p8l\" (UniqueName: \"kubernetes.io/projected/d2fa59cb-7305-4828-9b60-62d6be54758a-kube-api-access-s5p8l\") pod \"service-ca-758f599c5-g964d\" (UID: \"d2fa59cb-7305-4828-9b60-62d6be54758a\") " pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.346562 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.346540 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fvtwk_4fafd82c-e4f9-4ae3-b9bf-53be91d68251/dns-node-resolver/0.log" Jul 06 23:49:48.423566 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.423529 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-g964d" Jul 06 23:49:48.584383 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.584348 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-g964d"] Jul 06 23:49:48.588021 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:49:48.587996 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fa59cb_7305_4828_9b60_62d6be54758a.slice/crio-13e3c93cc119c7db90a9a3b9a7ebcf3edce3265d4d80ecb6ef7626c089bae8d2 WatchSource:0}: Error finding container 13e3c93cc119c7db90a9a3b9a7ebcf3edce3265d4d80ecb6ef7626c089bae8d2: Status 404 returned error can't find the container with id 13e3c93cc119c7db90a9a3b9a7ebcf3edce3265d4d80ecb6ef7626c089bae8d2 Jul 06 23:49:48.893086 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:48.893051 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-g964d" event={"ID":"d2fa59cb-7305-4828-9b60-62d6be54758a","Type":"ContainerStarted","Data":"13e3c93cc119c7db90a9a3b9a7ebcf3edce3265d4d80ecb6ef7626c089bae8d2"} Jul 06 23:49:49.336358 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:49.336275 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:49.336358 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:49.336317 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:49.336820 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:49.336404 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:49:49.336820 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:49.336454 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:53.336440559 +0000 UTC m=+51.128182289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : configmap "kube-rbac-proxy" not found Jul 06 23:49:49.336820 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:49.336457 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:49:49.336820 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:49.336541 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:53.336520775 +0000 UTC m=+51.128262505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : secret "insights-runtime-extractor-tls" not found Jul 06 23:49:49.344440 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:49.344405 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m4pbg_dc338a58-e895-4c9f-900f-15fa7e99427d/node-ca/0.log" Jul 06 23:49:50.145813 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:50.145785 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7h9m_c9fabb51-1838-44ae-81e7-70690bc4b093/serve-healthcheck-canary/0.log" Jul 06 23:49:50.541550 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:50.541463 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pxqhb_9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5/migrator/0.log" Jul 06 23:49:50.740473 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:50.740440 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pxqhb_9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5/graceful-termination/0.log" Jul 06 23:49:51.902883 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:51.902851 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-g964d" event={"ID":"d2fa59cb-7305-4828-9b60-62d6be54758a","Type":"ContainerStarted","Data":"1aebfdc2ed29954bf9b5c420ff36f2f6307d7dec8c8a9c5f04c3c57a859ec42d"} Jul 06 23:49:51.918665 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:51.918593 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-g964d" podStartSLOduration=1.50684446 podStartE2EDuration="3.918575062s" totalImagesPullingTime="2.411730602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:51.918110285 +0000 UTC m=+49.709852047" watchObservedRunningTime="2026-07-06 23:49:51.918575062 +0000 UTC m=+49.710316800" Jul 06 23:49:53.366258 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:53.366202 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:53.366769 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:53.366334 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:49:53.366769 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:49:53.366367 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:49:53.366769 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:53.366486 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:49:53.366769 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:53.366548 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:01.366528968 +0000 UTC m=+59.158270688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : secret "insights-runtime-extractor-tls" not found Jul 06 23:49:53.366997 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:53.366905 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:49:53.366997 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:53.366968 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:49:53.366997 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:53.366987 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls podName:a0d495b0-9d58-4063-893b-3235af97c343 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:09.366967753 +0000 UTC m=+67.158709488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls") pod "dns-default-tjgb4" (UID: "a0d495b0-9d58-4063-893b-3235af97c343") : secret "dns-default-metrics-tls" not found Jul 06 23:49:53.367138 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:49:53.367011 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:01.366997987 +0000 UTC m=+59.158739706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : configmap "kube-rbac-proxy" not found Jul 06 23:50:01.433167 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:01.433125 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:50:01.433890 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:01.433184 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:50:01.433890 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:01.433289 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:50:01.433890 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:01.433363 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls podName:57d50ba7-0b96-4c1f-b99a-5106796e7609 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:17.433347299 +0000 UTC m=+75.225089020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvblv" (UID: "57d50ba7-0b96-4c1f-b99a-5106796e7609") : secret "insights-runtime-extractor-tls" not found Jul 06 23:50:01.433890 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:01.433883 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57d50ba7-0b96-4c1f-b99a-5106796e7609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:50:03.855948 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:03.855911 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpvsp" Jul 06 23:50:08.490139 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.490081 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:50:08.490637 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.490184 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:50:08.492534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.492509 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:50:08.493033 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.493018 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:50:08.502879 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.502855 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5847788-75fd-4e51-85a4-b41114a18582-original-pull-secret\") pod \"global-pull-secret-syncer-g9g7s\" (UID: \"e5847788-75fd-4e51-85a4-b41114a18582\") " pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:50:08.502992 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.502897 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/245158ae-ab60-4367-a2d9-bd271be17552-metrics-certs\") pod \"network-metrics-daemon-l5d25\" (UID: \"245158ae-ab60-4367-a2d9-bd271be17552\") " pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:50:08.591516 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.591460 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:50:08.594143 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.594123 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:50:08.600131 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.600110 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g7s" Jul 06 23:50:08.604323 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.604306 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:50:08.608995 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.608974 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9m58d\"" Jul 06 23:50:08.615389 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.615361 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzr4d\" (UniqueName: \"kubernetes.io/projected/83dbd9b6-df43-40a8-8f09-59143eb73041-kube-api-access-wzr4d\") pod \"network-check-target-rtfjh\" (UID: \"83dbd9b6-df43-40a8-8f09-59143eb73041\") " pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:50:08.618089 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.618048 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5d25" Jul 06 23:50:08.738816 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.738782 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g9g7s"] Jul 06 23:50:08.743025 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:08.742995 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5847788_75fd_4e51_85a4_b41114a18582.slice/crio-879015ad96e79d69e2d0c958e040eabf63c2c9dff745e2bd6d92d3ba216e6119 WatchSource:0}: Error finding container 879015ad96e79d69e2d0c958e040eabf63c2c9dff745e2bd6d92d3ba216e6119: Status 404 returned error can't find the container with id 879015ad96e79d69e2d0c958e040eabf63c2c9dff745e2bd6d92d3ba216e6119 Jul 06 23:50:08.754571 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.754542 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5d25"] Jul 06 23:50:08.758067 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:08.758037 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245158ae_ab60_4367_a2d9_bd271be17552.slice/crio-3e2c430c8555e1abccd88841e1524751e1102cceded5df65853b3fb1d2de811c WatchSource:0}: Error finding container 3e2c430c8555e1abccd88841e1524751e1102cceded5df65853b3fb1d2de811c: Status 404 returned error can't find the container with id 3e2c430c8555e1abccd88841e1524751e1102cceded5df65853b3fb1d2de811c Jul 06 23:50:08.914768 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.914737 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7lfhk\"" Jul 06 23:50:08.923314 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.923288 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:50:08.946040 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.946008 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5d25" event={"ID":"245158ae-ab60-4367-a2d9-bd271be17552","Type":"ContainerStarted","Data":"3e2c430c8555e1abccd88841e1524751e1102cceded5df65853b3fb1d2de811c"} Jul 06 23:50:08.947288 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:08.947245 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g9g7s" event={"ID":"e5847788-75fd-4e51-85a4-b41114a18582","Type":"ContainerStarted","Data":"879015ad96e79d69e2d0c958e040eabf63c2c9dff745e2bd6d92d3ba216e6119"} Jul 06 23:50:09.045262 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:09.045225 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rtfjh"] Jul 06 23:50:09.048098 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:09.048057 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83dbd9b6_df43_40a8_8f09_59143eb73041.slice/crio-7ad45ef6a27d9f4a43b7d1695b4953655bc25d242358595d759e9455612d6b39 WatchSource:0}: Error finding container 7ad45ef6a27d9f4a43b7d1695b4953655bc25d242358595d759e9455612d6b39: Status 404 returned error can't find the container with id 7ad45ef6a27d9f4a43b7d1695b4953655bc25d242358595d759e9455612d6b39 Jul 06 23:50:09.397397 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:09.397359 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:50:09.400479 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:09.400447 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0d495b0-9d58-4063-893b-3235af97c343-metrics-tls\") pod \"dns-default-tjgb4\" (UID: \"a0d495b0-9d58-4063-893b-3235af97c343\") " pod="openshift-dns/dns-default-tjgb4" Jul 06 23:50:09.666294 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:09.666211 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p99x7\"" Jul 06 23:50:09.674025 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:09.673995 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tjgb4" Jul 06 23:50:09.949130 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:09.949039 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tjgb4"] Jul 06 23:50:09.952540 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:09.952500 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rtfjh" event={"ID":"83dbd9b6-df43-40a8-8f09-59143eb73041","Type":"ContainerStarted","Data":"7ad45ef6a27d9f4a43b7d1695b4953655bc25d242358595d759e9455612d6b39"} Jul 06 23:50:09.952693 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:09.952665 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d495b0_9d58_4063_893b_3235af97c343.slice/crio-ac24aadff9cc851ef2df4767f6379354ad002ecd0e03f712706d7ed0faf04320 WatchSource:0}: Error finding container ac24aadff9cc851ef2df4767f6379354ad002ecd0e03f712706d7ed0faf04320: Status 404 returned error can't find the container with id ac24aadff9cc851ef2df4767f6379354ad002ecd0e03f712706d7ed0faf04320 Jul 06 23:50:09.954896 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:09.954817 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5d25" event={"ID":"245158ae-ab60-4367-a2d9-bd271be17552","Type":"ContainerStarted","Data":"10bbd06819f67950efecd8fcc4e8fe4564be9df89ff041add95a1e2380c3f623"} Jul 06 23:50:09.999274 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:09.998247 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2"] Jul 06 23:50:10.001490 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.000999 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" Jul 06 23:50:10.009510 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.009127 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 23:50:10.010431 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.010399 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fbghg\"" Jul 06 23:50:10.012010 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.011527 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 23:50:10.014977 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.014956 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2"] Jul 06 23:50:10.105119 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.105084 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-5q4qv"] Jul 06 23:50:10.108451 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.108423 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5q4qv" Jul 06 23:50:10.112394 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.112263 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 23:50:10.112714 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.112691 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-x6m4k\"" Jul 06 23:50:10.112953 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.112810 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 23:50:10.114080 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.114053 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf334344-744b-4a9a-9190-a3994c049b70-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pzjd2\" (UID: \"bf334344-744b-4a9a-9190-a3994c049b70\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" Jul 06 23:50:10.114245 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.114100 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bf334344-744b-4a9a-9190-a3994c049b70-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-pzjd2\" (UID: \"bf334344-744b-4a9a-9190-a3994c049b70\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" Jul 06 23:50:10.133178 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.133142 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5q4qv"] Jul 06 23:50:10.214915 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.214832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf334344-744b-4a9a-9190-a3994c049b70-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pzjd2\" (UID: \"bf334344-744b-4a9a-9190-a3994c049b70\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" Jul 06 23:50:10.214915 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.214881 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bf334344-744b-4a9a-9190-a3994c049b70-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-pzjd2\" (UID: \"bf334344-744b-4a9a-9190-a3994c049b70\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" Jul 06 23:50:10.215161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.214920 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tkd4\" (UniqueName: \"kubernetes.io/projected/7f93043e-d1a1-4fe4-8105-21a472155afc-kube-api-access-6tkd4\") pod \"downloads-685bfb5f64-5q4qv\" (UID: \"7f93043e-d1a1-4fe4-8105-21a472155afc\") " pod="openshift-console/downloads-685bfb5f64-5q4qv" Jul 06 23:50:10.215734 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.215712 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bf334344-744b-4a9a-9190-a3994c049b70-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-pzjd2\" (UID: \"bf334344-744b-4a9a-9190-a3994c049b70\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" Jul 06 23:50:10.218017 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.217993 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf334344-744b-4a9a-9190-a3994c049b70-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pzjd2\" (UID: \"bf334344-744b-4a9a-9190-a3994c049b70\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" Jul 06 23:50:10.225566 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.225529 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6db75b4d8-2fdcc"] Jul 06 23:50:10.231085 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.230695 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.234020 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.233957 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 23:50:10.234020 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.233991 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 23:50:10.234229 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.233953 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5vhf7\"" Jul 06 23:50:10.234229 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.234051 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 23:50:10.240803 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.240667 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 23:50:10.243817 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.243789 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db75b4d8-2fdcc"] Jul 06 23:50:10.316388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.316334 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bffbe712-4570-4901-8208-6f0b59f4e8c5-image-registry-private-configuration\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.316566 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.316415 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bffbe712-4570-4901-8208-6f0b59f4e8c5-registry-tls\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.316566 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.316436 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bffbe712-4570-4901-8208-6f0b59f4e8c5-ca-trust-extracted\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.316566 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.316478 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tkd4\" (UniqueName: \"kubernetes.io/projected/7f93043e-d1a1-4fe4-8105-21a472155afc-kube-api-access-6tkd4\") pod \"downloads-685bfb5f64-5q4qv\" (UID: \"7f93043e-d1a1-4fe4-8105-21a472155afc\") " pod="openshift-console/downloads-685bfb5f64-5q4qv" Jul 06 23:50:10.316566 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.316509 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bffbe712-4570-4901-8208-6f0b59f4e8c5-installation-pull-secrets\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.316566 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.316534 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tts49\" (UniqueName: \"kubernetes.io/projected/bffbe712-4570-4901-8208-6f0b59f4e8c5-kube-api-access-tts49\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.316835 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.316587 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bffbe712-4570-4901-8208-6f0b59f4e8c5-registry-certificates\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.316835 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.316639 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bffbe712-4570-4901-8208-6f0b59f4e8c5-trusted-ca\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.316835 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.316677 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bffbe712-4570-4901-8208-6f0b59f4e8c5-bound-sa-token\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.322080 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.322050 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" Jul 06 23:50:10.327309 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.327271 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tkd4\" (UniqueName: \"kubernetes.io/projected/7f93043e-d1a1-4fe4-8105-21a472155afc-kube-api-access-6tkd4\") pod \"downloads-685bfb5f64-5q4qv\" (UID: \"7f93043e-d1a1-4fe4-8105-21a472155afc\") " pod="openshift-console/downloads-685bfb5f64-5q4qv" Jul 06 23:50:10.418419 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.417928 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bffbe712-4570-4901-8208-6f0b59f4e8c5-registry-certificates\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.418419 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.417981 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bffbe712-4570-4901-8208-6f0b59f4e8c5-trusted-ca\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.418419 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.418027 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bffbe712-4570-4901-8208-6f0b59f4e8c5-bound-sa-token\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.418419 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.418082 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bffbe712-4570-4901-8208-6f0b59f4e8c5-image-registry-private-configuration\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.418785 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.418759 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bffbe712-4570-4901-8208-6f0b59f4e8c5-registry-tls\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.418902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.418801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bffbe712-4570-4901-8208-6f0b59f4e8c5-ca-trust-extracted\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.418902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.418847 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bffbe712-4570-4901-8208-6f0b59f4e8c5-installation-pull-secrets\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.418902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.418878 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tts49\" (UniqueName: \"kubernetes.io/projected/bffbe712-4570-4901-8208-6f0b59f4e8c5-kube-api-access-tts49\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.419064 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.419001 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bffbe712-4570-4901-8208-6f0b59f4e8c5-registry-certificates\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.419210 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.419189 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bffbe712-4570-4901-8208-6f0b59f4e8c5-ca-trust-extracted\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.420692 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.420336 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bffbe712-4570-4901-8208-6f0b59f4e8c5-trusted-ca\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.420692 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.420446 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5q4qv" Jul 06 23:50:10.422129 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.422100 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bffbe712-4570-4901-8208-6f0b59f4e8c5-image-registry-private-configuration\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.422233 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.422210 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bffbe712-4570-4901-8208-6f0b59f4e8c5-installation-pull-secrets\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.423397 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.423374 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bffbe712-4570-4901-8208-6f0b59f4e8c5-registry-tls\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.427754 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.427708 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bffbe712-4570-4901-8208-6f0b59f4e8c5-bound-sa-token\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.430011 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.429962 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tts49\" (UniqueName: \"kubernetes.io/projected/bffbe712-4570-4901-8208-6f0b59f4e8c5-kube-api-access-tts49\") pod \"image-registry-6db75b4d8-2fdcc\" (UID: \"bffbe712-4570-4901-8208-6f0b59f4e8c5\") " pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.502092 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.500550 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2"] Jul 06 23:50:10.504837 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:10.504792 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf334344_744b_4a9a_9190_a3994c049b70.slice/crio-b8bbbcf58b0e399f5f327c141506df420f1a584237dc83f260f333cd07b93f20 WatchSource:0}: Error finding container b8bbbcf58b0e399f5f327c141506df420f1a584237dc83f260f333cd07b93f20: Status 404 returned error can't find the container with id b8bbbcf58b0e399f5f327c141506df420f1a584237dc83f260f333cd07b93f20 Jul 06 23:50:10.550458 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.550401 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:10.609288 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.609192 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5q4qv"] Jul 06 23:50:10.616498 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:10.616455 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f93043e_d1a1_4fe4_8105_21a472155afc.slice/crio-501dd8ce93dd26247d0316e60c8aa8c5da7eaccb98e0a0fc39277365b77d7d26 WatchSource:0}: Error finding container 501dd8ce93dd26247d0316e60c8aa8c5da7eaccb98e0a0fc39277365b77d7d26: Status 404 returned error can't find the container with id 501dd8ce93dd26247d0316e60c8aa8c5da7eaccb98e0a0fc39277365b77d7d26 Jul 06 23:50:10.749269 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.749181 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db75b4d8-2fdcc"] Jul 06 23:50:10.761361 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:10.761308 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbffbe712_4570_4901_8208_6f0b59f4e8c5.slice/crio-aaae540f40565d3ec9cc2c4cfe3f28a0a6e7b14934c8d9e11a46566c3d160183 WatchSource:0}: Error finding container aaae540f40565d3ec9cc2c4cfe3f28a0a6e7b14934c8d9e11a46566c3d160183: Status 404 returned error can't find the container with id aaae540f40565d3ec9cc2c4cfe3f28a0a6e7b14934c8d9e11a46566c3d160183 Jul 06 23:50:10.968548 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.967334 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" event={"ID":"bf334344-744b-4a9a-9190-a3994c049b70","Type":"ContainerStarted","Data":"b8bbbcf58b0e399f5f327c141506df420f1a584237dc83f260f333cd07b93f20"} Jul 06 23:50:10.971766 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.971503 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5q4qv" event={"ID":"7f93043e-d1a1-4fe4-8105-21a472155afc","Type":"ContainerStarted","Data":"501dd8ce93dd26247d0316e60c8aa8c5da7eaccb98e0a0fc39277365b77d7d26"} Jul 06 23:50:10.973123 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.973094 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tjgb4" event={"ID":"a0d495b0-9d58-4063-893b-3235af97c343","Type":"ContainerStarted","Data":"ac24aadff9cc851ef2df4767f6379354ad002ecd0e03f712706d7ed0faf04320"} Jul 06 23:50:10.976557 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.975798 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5d25" event={"ID":"245158ae-ab60-4367-a2d9-bd271be17552","Type":"ContainerStarted","Data":"9b76669b03c8525b93f8574a02ffb9d403a861bbfe2c1abd053779f5e351c1b2"} Jul 06 23:50:10.978848 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.978746 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" event={"ID":"bffbe712-4570-4901-8208-6f0b59f4e8c5","Type":"ContainerStarted","Data":"4f38e79442094935a47ef8ac39c529a97719aad6fe32f46f5a9e2ce2f634111c"} Jul 06 23:50:10.978848 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.978784 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" event={"ID":"bffbe712-4570-4901-8208-6f0b59f4e8c5","Type":"ContainerStarted","Data":"aaae540f40565d3ec9cc2c4cfe3f28a0a6e7b14934c8d9e11a46566c3d160183"} Jul 06 23:50:10.979169 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:10.979110 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:11.016837 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.015638 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" podStartSLOduration=1.015595112 podStartE2EDuration="1.015595112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:11.014963208 +0000 UTC m=+68.806704948" watchObservedRunningTime="2026-07-06 23:50:11.015595112 +0000 UTC m=+68.807336842" Jul 06 23:50:11.016837 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.016126 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l5d25" podStartSLOduration=67.960186242 podStartE2EDuration="1m9.016112601s" totalImagesPullingTime="1.055926359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:10.995082647 +0000 UTC m=+68.786824389" watchObservedRunningTime="2026-07-06 23:50:11.016112601 +0000 UTC m=+68.807854340" Jul 06 23:50:11.125515 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.124101 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw"] Jul 06 23:50:11.140275 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.139379 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw"] Jul 06 23:50:11.140275 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.139497 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" Jul 06 23:50:11.143558 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.142449 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vp5dg\"" Jul 06 23:50:11.143558 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.142714 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 23:50:11.226650 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.226554 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a0a09c2b-328c-437e-98b0-469fe11fc518-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gp5jw\" (UID: \"a0a09c2b-328c-437e-98b0-469fe11fc518\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" Jul 06 23:50:11.328040 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.327943 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a0a09c2b-328c-437e-98b0-469fe11fc518-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gp5jw\" (UID: \"a0a09c2b-328c-437e-98b0-469fe11fc518\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" Jul 06 23:50:11.328206 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:11.328148 2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 23:50:11.328268 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:11.328245 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a09c2b-328c-437e-98b0-469fe11fc518-tls-certificates podName:a0a09c2b-328c-437e-98b0-469fe11fc518 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:11.828223335 +0000 UTC m=+69.619965056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a0a09c2b-328c-437e-98b0-469fe11fc518-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-gp5jw" (UID: "a0a09c2b-328c-437e-98b0-469fe11fc518") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 23:50:11.833160 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.833118 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a0a09c2b-328c-437e-98b0-469fe11fc518-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gp5jw\" (UID: \"a0a09c2b-328c-437e-98b0-469fe11fc518\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" Jul 06 23:50:11.836387 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:11.836318 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a0a09c2b-328c-437e-98b0-469fe11fc518-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gp5jw\" (UID: \"a0a09c2b-328c-437e-98b0-469fe11fc518\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" Jul 06 23:50:12.056657 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:12.056619 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" Jul 06 23:50:15.569012 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:15.568003 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw"] Jul 06 23:50:16.002879 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.002812 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g9g7s" event={"ID":"e5847788-75fd-4e51-85a4-b41114a18582","Type":"ContainerStarted","Data":"c6a5545442ba85d999d5bd740c902710d24057107cfb2557a6130026d1e7f325"} Jul 06 23:50:16.004268 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.004237 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" event={"ID":"a0a09c2b-328c-437e-98b0-469fe11fc518","Type":"ContainerStarted","Data":"4897ab8e3f4d12c5f634c913269f81f6765c67d125aab0d7256ec3486131e58d"} Jul 06 23:50:16.006362 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.006337 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" event={"ID":"bf334344-744b-4a9a-9190-a3994c049b70","Type":"ContainerStarted","Data":"fe2ba704d9708bce6138bccc5c05e98aee5e824d6461265ada34f34c3d33bcad"} Jul 06 23:50:16.008065 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.008020 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rtfjh" event={"ID":"83dbd9b6-df43-40a8-8f09-59143eb73041","Type":"ContainerStarted","Data":"66d0ab3d162ebc1ff1a391139a2351940bb80b2ab6dd83d8625b2c04a3378cf2"} Jul 06 23:50:16.008187 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.008139 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:50:16.009848 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.009814 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tjgb4" event={"ID":"a0d495b0-9d58-4063-893b-3235af97c343","Type":"ContainerStarted","Data":"6b503e7f3a7e62fc85debd6ff8ac1b8ca3c21f4e51b4b4cc2d7cf19c42bdd15d"} Jul 06 23:50:16.009954 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.009862 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tjgb4" event={"ID":"a0d495b0-9d58-4063-893b-3235af97c343","Type":"ContainerStarted","Data":"057a0f8ebfcaf45db1cbd9d70a3051d52b96c9165627ba37667a58ca400d03f3"} Jul 06 23:50:16.010055 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.010037 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tjgb4" Jul 06 23:50:16.020166 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.020109 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g9g7s" podStartSLOduration=67.373334945 podStartE2EDuration="1m14.020090711s" totalImagesPullingTime="6.646755766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:16.019193729 +0000 UTC m=+73.810935495" watchObservedRunningTime="2026-07-06 23:50:16.020090711 +0000 UTC m=+73.811832450" Jul 06 23:50:16.038845 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.038788 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pzjd2" podStartSLOduration=2.164953318 podStartE2EDuration="7.038765035s" totalImagesPullingTime="4.873811717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:16.038045212 +0000 UTC m=+73.829786963" watchObservedRunningTime="2026-07-06 23:50:16.038765035 +0000 UTC m=+73.830506774" Jul 06 23:50:16.087027 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.086338 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rtfjh" podStartSLOduration=67.755356556 podStartE2EDuration="1m14.086319073s" totalImagesPullingTime="6.330962517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:16.085981552 +0000 UTC m=+73.877723318" watchObservedRunningTime="2026-07-06 23:50:16.086319073 +0000 UTC m=+73.878060810" Jul 06 23:50:16.087027 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:16.086455 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tjgb4" podStartSLOduration=33.664472624 podStartE2EDuration="39.086448s" totalImagesPullingTime="5.421975376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:16.063560725 +0000 UTC m=+73.855302464" watchObservedRunningTime="2026-07-06 23:50:16.086448 +0000 UTC m=+73.878189739" Jul 06 23:50:17.015687 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.015556 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" event={"ID":"a0a09c2b-328c-437e-98b0-469fe11fc518","Type":"ContainerStarted","Data":"c6c2d7897d8764989ded3dafe4b3fa4bb3b00c61f546cac99480673a90bc2337"} Jul 06 23:50:17.016084 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.015949 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" Jul 06 23:50:17.021561 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.021539 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" Jul 06 23:50:17.032108 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.032059 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gp5jw" podStartSLOduration=4.807315645 podStartE2EDuration="6.0320402s" totalImagesPullingTime="1.224724555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:17.031013004 +0000 UTC m=+74.822754765" watchObservedRunningTime="2026-07-06 23:50:17.0320402 +0000 UTC m=+74.823781939" Jul 06 23:50:17.213099 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.213058 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8"] Jul 06 23:50:17.216444 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.216410 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.218751 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.218720 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 23:50:17.218894 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.218819 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 23:50:17.218894 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.218876 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 23:50:17.219082 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.219065 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xltmb\"" Jul 06 23:50:17.219155 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.219107 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 23:50:17.219244 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.219220 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 23:50:17.224941 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.224918 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8"] Jul 06 23:50:17.285843 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.285808 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx78q\" (UniqueName: \"kubernetes.io/projected/4d386512-acaa-4d5d-9bf9-1a36fde717df-kube-api-access-kx78q\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.286028 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.285852 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d386512-acaa-4d5d-9bf9-1a36fde717df-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.286028 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.285879 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d386512-acaa-4d5d-9bf9-1a36fde717df-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.286028 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.285922 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4d386512-acaa-4d5d-9bf9-1a36fde717df-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.379913 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.379873 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-df4f849b4-x7jjc"] Jul 06 23:50:17.383386 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.383358 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.385723 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.385693 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 23:50:17.385884 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.385756 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 23:50:17.385884 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.385699 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m6b92\"" Jul 06 23:50:17.386006 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.385975 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 23:50:17.386136 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.386119 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 23:50:17.386248 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.386231 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 23:50:17.386609 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.386585 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4d386512-acaa-4d5d-9bf9-1a36fde717df-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.386721 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.386702 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx78q\" (UniqueName: \"kubernetes.io/projected/4d386512-acaa-4d5d-9bf9-1a36fde717df-kube-api-access-kx78q\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.386810 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:17.386788 2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 23:50:17.386930 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:17.386857 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d386512-acaa-4d5d-9bf9-1a36fde717df-prometheus-operator-tls podName:4d386512-acaa-4d5d-9bf9-1a36fde717df nodeName:}" failed. No retries permitted until 2026-07-06 23:50:17.88683722 +0000 UTC m=+75.678578936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4d386512-acaa-4d5d-9bf9-1a36fde717df-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-rlvn8" (UID: "4d386512-acaa-4d5d-9bf9-1a36fde717df") : secret "prometheus-operator-tls" not found Jul 06 23:50:17.387002 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.386762 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d386512-acaa-4d5d-9bf9-1a36fde717df-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.387061 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.387002 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d386512-acaa-4d5d-9bf9-1a36fde717df-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.387754 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.387733 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d386512-acaa-4d5d-9bf9-1a36fde717df-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.389988 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.389964 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d386512-acaa-4d5d-9bf9-1a36fde717df-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.396214 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.396192 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df4f849b4-x7jjc"] Jul 06 23:50:17.401700 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.401672 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx78q\" (UniqueName: \"kubernetes.io/projected/4d386512-acaa-4d5d-9bf9-1a36fde717df-kube-api-access-kx78q\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.488242 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.488160 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:50:17.488242 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.488201 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-serving-cert\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.488242 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.488239 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-service-ca\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.488490 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.488366 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw9m6\" (UniqueName: \"kubernetes.io/projected/9065ec3e-5a44-489f-bdac-1f6c97399cbb-kube-api-access-sw9m6\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.488490 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.488397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-oauth-config\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.488490 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.488437 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-config\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.488581 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.488507 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-oauth-serving-cert\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.491129 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.491088 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57d50ba7-0b96-4c1f-b99a-5106796e7609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvblv\" (UID: \"57d50ba7-0b96-4c1f-b99a-5106796e7609\") " pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:50:17.588990 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.588941 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-oauth-serving-cert\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.589179 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.588999 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-serving-cert\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.589179 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.589041 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-service-ca\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.589179 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.589069 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw9m6\" (UniqueName: \"kubernetes.io/projected/9065ec3e-5a44-489f-bdac-1f6c97399cbb-kube-api-access-sw9m6\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.589179 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.589098 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-oauth-config\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.589179 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.589133 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-config\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.589925 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.589903 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-config\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.590047 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.589900 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-oauth-serving-cert\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.590138 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.590108 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-service-ca\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.592123 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.592060 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-serving-cert\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.592434 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.592410 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-oauth-config\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.597525 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.597504 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw9m6\" (UniqueName: \"kubernetes.io/projected/9065ec3e-5a44-489f-bdac-1f6c97399cbb-kube-api-access-sw9m6\") pod \"console-df4f849b4-x7jjc\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.692562 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.692529 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lr2cs\"" Jul 06 23:50:17.700379 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.700353 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvblv" Jul 06 23:50:17.702781 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.702745 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:17.877816 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.877763 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvblv"] Jul 06 23:50:17.881808 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:17.881777 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d50ba7_0b96_4c1f_b99a_5106796e7609.slice/crio-e75cbf566d8ec6ba57afa8c1267ed496eb6830d4338206feb1a6cc150d5a0e21 WatchSource:0}: Error finding container e75cbf566d8ec6ba57afa8c1267ed496eb6830d4338206feb1a6cc150d5a0e21: Status 404 returned error can't find the container with id e75cbf566d8ec6ba57afa8c1267ed496eb6830d4338206feb1a6cc150d5a0e21 Jul 06 23:50:17.893999 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.893863 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df4f849b4-x7jjc"] Jul 06 23:50:17.897395 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:17.897361 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9065ec3e_5a44_489f_bdac_1f6c97399cbb.slice/crio-d887e3626b40730b4a02990fe45b8dc7a50429b4bcae34f7d3562b0ee4b5305b WatchSource:0}: Error finding container d887e3626b40730b4a02990fe45b8dc7a50429b4bcae34f7d3562b0ee4b5305b: Status 404 returned error can't find the container with id d887e3626b40730b4a02990fe45b8dc7a50429b4bcae34f7d3562b0ee4b5305b Jul 06 23:50:17.898697 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.898673 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4d386512-acaa-4d5d-9bf9-1a36fde717df-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:17.901740 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:17.901706 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4d386512-acaa-4d5d-9bf9-1a36fde717df-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rlvn8\" (UID: \"4d386512-acaa-4d5d-9bf9-1a36fde717df\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:18.021523 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:18.021435 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df4f849b4-x7jjc" event={"ID":"9065ec3e-5a44-489f-bdac-1f6c97399cbb","Type":"ContainerStarted","Data":"d887e3626b40730b4a02990fe45b8dc7a50429b4bcae34f7d3562b0ee4b5305b"} Jul 06 23:50:18.022793 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:18.022767 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvblv" event={"ID":"57d50ba7-0b96-4c1f-b99a-5106796e7609","Type":"ContainerStarted","Data":"e75cbf566d8ec6ba57afa8c1267ed496eb6830d4338206feb1a6cc150d5a0e21"} Jul 06 23:50:18.127525 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:18.127489 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" Jul 06 23:50:18.275558 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:18.275410 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8"] Jul 06 23:50:18.279207 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:18.279167 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d386512_acaa_4d5d_9bf9_1a36fde717df.slice/crio-e68c9f9a3bdd84d6e68b103c0f75fa99fa978d2c894aa7f8d0e2cb366ddd48da WatchSource:0}: Error finding container e68c9f9a3bdd84d6e68b103c0f75fa99fa978d2c894aa7f8d0e2cb366ddd48da: Status 404 returned error can't find the container with id e68c9f9a3bdd84d6e68b103c0f75fa99fa978d2c894aa7f8d0e2cb366ddd48da Jul 06 23:50:19.034767 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:19.034720 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" event={"ID":"4d386512-acaa-4d5d-9bf9-1a36fde717df","Type":"ContainerStarted","Data":"e68c9f9a3bdd84d6e68b103c0f75fa99fa978d2c894aa7f8d0e2cb366ddd48da"} Jul 06 23:50:26.018489 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:26.018107 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tjgb4" Jul 06 23:50:31.990149 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:31.990115 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6db75b4d8-2fdcc" Jul 06 23:50:32.088438 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.088371 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df4f849b4-x7jjc" event={"ID":"9065ec3e-5a44-489f-bdac-1f6c97399cbb","Type":"ContainerStarted","Data":"f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97"} Jul 06 23:50:32.090405 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.090358 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvblv" event={"ID":"57d50ba7-0b96-4c1f-b99a-5106796e7609","Type":"ContainerStarted","Data":"f39435987b7e38587ef0e90dbf88592d6cb939eef69befb72d46ac309172c459"} Jul 06 23:50:32.092327 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.092296 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5q4qv" event={"ID":"7f93043e-d1a1-4fe4-8105-21a472155afc","Type":"ContainerStarted","Data":"96135fcac62efed66bdb22ff32bdaa8283607ff76be6a61accf4fa5de5b46f0c"} Jul 06 23:50:32.092460 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.092440 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-5q4qv" Jul 06 23:50:32.095717 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.095689 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" event={"ID":"4d386512-acaa-4d5d-9bf9-1a36fde717df","Type":"ContainerStarted","Data":"a49c4073e106a97e406477cd3e1bb8327be8bf27940c6e830b74964a75a57f9f"} Jul 06 23:50:32.095834 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.095740 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" event={"ID":"4d386512-acaa-4d5d-9bf9-1a36fde717df","Type":"ContainerStarted","Data":"03ee65967dd49bced37982544b079ad1fa04bc2e6142c50218a4842ef1fb6a48"} Jul 06 23:50:32.106592 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.106566 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-5q4qv" Jul 06 23:50:32.106959 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.106910 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-df4f849b4-x7jjc" podStartSLOduration=1.739696119 podStartE2EDuration="15.106896016s" totalImagesPullingTime="13.367199897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:32.105672396 +0000 UTC m=+89.897414158" watchObservedRunningTime="2026-07-06 23:50:32.106896016 +0000 UTC m=+89.898637753" Jul 06 23:50:32.128231 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.128170 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rlvn8" podStartSLOduration=2.186355556 podStartE2EDuration="15.128149357s" totalImagesPullingTime="12.941793801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:32.126848116 +0000 UTC m=+89.918589880" watchObservedRunningTime="2026-07-06 23:50:32.128149357 +0000 UTC m=+89.919891096" Jul 06 23:50:32.143142 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:32.143089 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-5q4qv" podStartSLOduration=1.4697519940000001 podStartE2EDuration="22.143069058s" totalImagesPullingTime="20.673317064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:32.141449371 +0000 UTC m=+89.933191169" watchObservedRunningTime="2026-07-06 23:50:32.143069058 +0000 UTC m=+89.934810796" Jul 06 23:50:33.105471 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.105391 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvblv" event={"ID":"57d50ba7-0b96-4c1f-b99a-5106796e7609","Type":"ContainerStarted","Data":"e2c6b138c0e74d595f21a98dcac2c9ca5d0a36cc542df5b7b5935916065af39c"} Jul 06 23:50:33.548476 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.546997 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw"] Jul 06 23:50:33.576451 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.574961 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw"] Jul 06 23:50:33.576451 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.575113 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.583271 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.581813 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46"] Jul 06 23:50:33.584025 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.583571 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 23:50:33.584025 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.583842 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 23:50:33.584025 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.583888 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8qdlp\"" Jul 06 23:50:33.612053 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.610356 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2sfdq"] Jul 06 23:50:33.612053 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.611025 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.614442 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.614412 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 23:50:33.615018 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.614999 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 23:50:33.615385 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.615369 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 23:50:33.615566 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.615426 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-drpgv\"" Jul 06 23:50:33.629112 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.629089 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46"] Jul 06 23:50:33.629386 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.629372 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.638932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.633953 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14d32330-317f-4a76-9112-3b74784e8518-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.638932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.634085 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14d32330-317f-4a76-9112-3b74784e8518-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.638932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.634118 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-textfile\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.638932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.634145 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-accelerators-collector-config\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.638932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.634277 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77bfbfcc-be10-482a-b570-6bbfaff158c3-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.638932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.634733 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j6ctg\"" Jul 06 23:50:33.638932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.634993 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 23:50:33.638932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.635284 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 23:50:33.638932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.635677 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 23:50:33.642616 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.639885 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6thcg\" (UniqueName: \"kubernetes.io/projected/77bfbfcc-be10-482a-b570-6bbfaff158c3-kube-api-access-6thcg\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.642616 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.640045 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14d32330-317f-4a76-9112-3b74784e8518-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.642616 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.640176 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14d32330-317f-4a76-9112-3b74784e8518-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.642616 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.640207 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-tls\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.642616 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.640330 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14d32330-317f-4a76-9112-3b74784e8518-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.642616 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.640362 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzhz\" (UniqueName: \"kubernetes.io/projected/14d32330-317f-4a76-9112-3b74784e8518-kube-api-access-mrzhz\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.646122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.645830 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-root\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.646122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.645887 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-wtmp\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.646122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.645916 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-metrics-client-ca\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.646122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.645934 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.646122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.645956 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.646122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.645975 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f5gh\" (UniqueName: \"kubernetes.io/projected/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-kube-api-access-2f5gh\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.646122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.646004 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-sys\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.646122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.646020 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747313 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14d32330-317f-4a76-9112-3b74784e8518-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747370 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrzhz\" (UniqueName: \"kubernetes.io/projected/14d32330-317f-4a76-9112-3b74784e8518-kube-api-access-mrzhz\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747399 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-root\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747432 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-wtmp\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747468 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-metrics-client-ca\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747496 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747528 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747575 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f5gh\" (UniqueName: \"kubernetes.io/projected/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-kube-api-access-2f5gh\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747630 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-sys\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747657 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747705 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14d32330-317f-4a76-9112-3b74784e8518-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747734 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14d32330-317f-4a76-9112-3b74784e8518-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747763 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-textfile\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747791 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-accelerators-collector-config\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747835 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77bfbfcc-be10-482a-b570-6bbfaff158c3-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.748838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747865 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6thcg\" (UniqueName: \"kubernetes.io/projected/77bfbfcc-be10-482a-b570-6bbfaff158c3-kube-api-access-6thcg\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.749771 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747908 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14d32330-317f-4a76-9112-3b74784e8518-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.749771 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747943 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14d32330-317f-4a76-9112-3b74784e8518-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.749771 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.747970 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-tls\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.749771 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:33.748117 2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 23:50:33.749771 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:33.748185 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-tls podName:15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf nodeName:}" failed. No retries permitted until 2026-07-06 23:50:34.248162718 +0000 UTC m=+92.039904448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-tls") pod "node-exporter-2sfdq" (UID: "15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf") : secret "node-exporter-tls" not found Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.750797 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77bfbfcc-be10-482a-b570-6bbfaff158c3-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.751682 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14d32330-317f-4a76-9112-3b74784e8518-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.752250 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14d32330-317f-4a76-9112-3b74784e8518-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.755694 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14d32330-317f-4a76-9112-3b74784e8518-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.756101 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-textfile\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.756330 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14d32330-317f-4a76-9112-3b74784e8518-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.756726 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14d32330-317f-4a76-9112-3b74784e8518-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.756804 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-metrics-client-ca\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.757090 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-root\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.757212 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-wtmp\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.758375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.757724 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-accelerators-collector-config\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.759237 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.759191 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-sys\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.759493 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:33.759443 2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 23:50:33.764594 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:33.759657 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-tls podName:77bfbfcc-be10-482a-b570-6bbfaff158c3 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:34.259636174 +0000 UTC m=+92.051377905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-lxkfw" (UID: "77bfbfcc-be10-482a-b570-6bbfaff158c3") : secret "openshift-state-metrics-tls" not found Jul 06 23:50:33.774641 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.768230 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6thcg\" (UniqueName: \"kubernetes.io/projected/77bfbfcc-be10-482a-b570-6bbfaff158c3-kube-api-access-6thcg\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.774641 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.768363 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrzhz\" (UniqueName: \"kubernetes.io/projected/14d32330-317f-4a76-9112-3b74784e8518-kube-api-access-mrzhz\") pod \"kube-state-metrics-7c9dbb8b7d-kzd46\" (UID: \"14d32330-317f-4a76-9112-3b74784e8518\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:33.774641 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.768472 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:33.774641 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.771283 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f5gh\" (UniqueName: \"kubernetes.io/projected/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-kube-api-access-2f5gh\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.774641 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.771682 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:33.927010 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:33.926968 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" Jul 06 23:50:34.197269 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.197224 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46"] Jul 06 23:50:34.200033 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:34.199998 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d32330_317f_4a76_9112_3b74784e8518.slice/crio-e4179085de0002f5cfa3429af9fa070b77e6bd8449bf4d903175fd277e204497 WatchSource:0}: Error finding container e4179085de0002f5cfa3429af9fa070b77e6bd8449bf4d903175fd277e204497: Status 404 returned error can't find the container with id e4179085de0002f5cfa3429af9fa070b77e6bd8449bf4d903175fd277e204497 Jul 06 23:50:34.253494 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.253448 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-tls\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:34.256877 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.256847 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf-node-exporter-tls\") pod \"node-exporter-2sfdq\" (UID: \"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf\") " pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:34.354705 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.354665 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:34.354906 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:34.354840 2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 23:50:34.354979 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:50:34.354919 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-tls podName:77bfbfcc-be10-482a-b570-6bbfaff158c3 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:35.35489966 +0000 UTC m=+93.146641379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-lxkfw" (UID: "77bfbfcc-be10-482a-b570-6bbfaff158c3") : secret "openshift-state-metrics-tls" not found Jul 06 23:50:34.549748 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.549659 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2sfdq" Jul 06 23:50:34.642995 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.642957 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 23:50:34.662500 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.661969 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.662500 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.661971 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 23:50:34.664234 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.664103 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 23:50:34.665747 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.665723 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 23:50:34.666277 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.665893 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 23:50:34.666277 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.665976 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 23:50:34.666277 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.666148 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 23:50:34.666489 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.666328 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 23:50:34.666545 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.666525 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 23:50:34.666945 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.666743 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 23:50:34.666945 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.666841 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-spq8j\"" Jul 06 23:50:34.667446 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.667248 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 23:50:34.758629 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758563 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.758899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758652 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.758899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758680 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.758899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758745 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.758899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758771 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kqcs\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-kube-api-access-6kqcs\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.758899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758799 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-out\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.758899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758823 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.758899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758871 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-web-config\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.759293 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758911 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.759293 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758950 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.759293 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758978 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.759293 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.758999 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.759293 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.759027 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860267 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860184 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860267 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860245 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860549 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860309 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860549 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860350 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kqcs\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-kube-api-access-6kqcs\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860549 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860381 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-out\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860549 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860405 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860549 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860455 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-web-config\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860549 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860489 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860549 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860527 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860952 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860554 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860952 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860583 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860952 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860654 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.860952 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.860688 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.877797 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.866320 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-out\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.877797 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.866708 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.877797 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.867165 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.877797 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.867494 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.877797 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.868052 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.877797 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.877038 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kqcs\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-kube-api-access-6kqcs\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.896068 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.895999 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.898932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.898582 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.898932 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.898843 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.899144 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.899039 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.899417 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.899389 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-web-config\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.899756 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.899730 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.900197 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.900172 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:34.976244 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:34.976206 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:50:35.144099 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:35.144030 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" event={"ID":"14d32330-317f-4a76-9112-3b74784e8518","Type":"ContainerStarted","Data":"e4179085de0002f5cfa3429af9fa070b77e6bd8449bf4d903175fd277e204497"} Jul 06 23:50:35.346510 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:35.346459 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-df4f849b4-x7jjc"] Jul 06 23:50:35.364654 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:35.364177 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:35.367717 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:35.367657 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77bfbfcc-be10-482a-b570-6bbfaff158c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lxkfw\" (UID: \"77bfbfcc-be10-482a-b570-6bbfaff158c3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:35.398870 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:35.398594 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" Jul 06 23:50:35.869391 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:35.868792 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ebcaed_6d0e_4d5b_b7b2_ef3543ff1caf.slice/crio-6f9cbacc5beb16f27b9f8439156643eb5645e67a6477748ba89e15002b07f8d7 WatchSource:0}: Error finding container 6f9cbacc5beb16f27b9f8439156643eb5645e67a6477748ba89e15002b07f8d7: Status 404 returned error can't find the container with id 6f9cbacc5beb16f27b9f8439156643eb5645e67a6477748ba89e15002b07f8d7 Jul 06 23:50:36.033408 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:36.032842 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 23:50:36.034587 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:36.034556 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3de6bcb_965d_496b_a5b2_ea2f16205ae5.slice/crio-cd32008a08e80690e99098d5aca6ac2d166496ad24541021cc851d352c1f0bac WatchSource:0}: Error finding container cd32008a08e80690e99098d5aca6ac2d166496ad24541021cc851d352c1f0bac: Status 404 returned error can't find the container with id cd32008a08e80690e99098d5aca6ac2d166496ad24541021cc851d352c1f0bac Jul 06 23:50:36.046285 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:36.046254 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw"] Jul 06 23:50:36.049641 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:36.049578 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bfbfcc_be10_482a_b570_6bbfaff158c3.slice/crio-f594e505f2bdb22c78f903636988b179935ac091ed92fa4d18f3ab549ff0b57a WatchSource:0}: Error finding container f594e505f2bdb22c78f903636988b179935ac091ed92fa4d18f3ab549ff0b57a: Status 404 returned error can't find the container with id f594e505f2bdb22c78f903636988b179935ac091ed92fa4d18f3ab549ff0b57a Jul 06 23:50:36.149416 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:36.149325 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" event={"ID":"77bfbfcc-be10-482a-b570-6bbfaff158c3","Type":"ContainerStarted","Data":"f594e505f2bdb22c78f903636988b179935ac091ed92fa4d18f3ab549ff0b57a"} Jul 06 23:50:36.150859 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:36.150816 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sfdq" event={"ID":"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf","Type":"ContainerStarted","Data":"6f9cbacc5beb16f27b9f8439156643eb5645e67a6477748ba89e15002b07f8d7"} Jul 06 23:50:36.152259 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:36.152230 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerStarted","Data":"cd32008a08e80690e99098d5aca6ac2d166496ad24541021cc851d352c1f0bac"} Jul 06 23:50:37.165909 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:37.165626 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvblv" event={"ID":"57d50ba7-0b96-4c1f-b99a-5106796e7609","Type":"ContainerStarted","Data":"c77a0c527c9dffd7dacf50befb170bd0bdc3d1527465d7a204e574da033d0b73"} Jul 06 23:50:37.169177 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:37.169145 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" event={"ID":"77bfbfcc-be10-482a-b570-6bbfaff158c3","Type":"ContainerStarted","Data":"ed563ffb2bef790a72b68d4db57830767469ac62ed2e29097ea01d6b7d8f1af1"} Jul 06 23:50:37.169312 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:37.169228 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" event={"ID":"77bfbfcc-be10-482a-b570-6bbfaff158c3","Type":"ContainerStarted","Data":"90cae34f1710760f8a02de3af6308b2d8cc9beb7386fb8d5fbfdd5efeec4a821"} Jul 06 23:50:37.185811 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:37.185418 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zvblv" podStartSLOduration=34.014409788 podStartE2EDuration="52.185394939s" totalImagesPullingTime="18.170985151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:37.183727578 +0000 UTC m=+94.975469533" watchObservedRunningTime="2026-07-06 23:50:37.185394939 +0000 UTC m=+94.977136678" Jul 06 23:50:37.703784 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:37.703755 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:50:38.629969 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.629932 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d44544bdd-zhj24"] Jul 06 23:50:38.653263 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.653226 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d44544bdd-zhj24"] Jul 06 23:50:38.653470 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.653358 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.661850 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.661788 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 23:50:38.698640 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.698591 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-oauth-config\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.698809 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.698662 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-trusted-ca-bundle\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.698809 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.698735 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-oauth-serving-cert\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.698809 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.698796 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-service-ca\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.699022 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.698836 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-serving-cert\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.699022 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.698858 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-console-config\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.699022 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.698960 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nxvt\" (UniqueName: \"kubernetes.io/projected/a464aa99-5912-44a3-be30-c2deb743e0ad-kube-api-access-7nxvt\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.800168 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.800128 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-service-ca\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.800355 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.800185 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-serving-cert\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.800355 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.800215 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-console-config\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.800355 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.800281 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nxvt\" (UniqueName: \"kubernetes.io/projected/a464aa99-5912-44a3-be30-c2deb743e0ad-kube-api-access-7nxvt\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.800355 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.800325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-oauth-config\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.800590 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.800384 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-trusted-ca-bundle\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.800590 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.800422 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-oauth-serving-cert\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.801088 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.801047 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-console-config\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.801390 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.801365 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-trusted-ca-bundle\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.801561 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.801536 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-service-ca\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.801899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.801879 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-oauth-serving-cert\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.803448 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.803423 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-oauth-config\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.803646 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.803625 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-serving-cert\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.808183 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.808156 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c76b54566-cdjjx"] Jul 06 23:50:38.813851 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.813827 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nxvt\" (UniqueName: \"kubernetes.io/projected/a464aa99-5912-44a3-be30-c2deb743e0ad-kube-api-access-7nxvt\") pod \"console-7d44544bdd-zhj24\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:38.843485 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.843448 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c76b54566-cdjjx"] Jul 06 23:50:38.843697 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.843595 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:38.846198 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.846171 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 23:50:38.846356 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.846201 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xs2vr\"" Jul 06 23:50:38.846457 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.846429 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 23:50:38.846939 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.846735 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 23:50:38.846939 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.846811 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 23:50:38.846939 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.846828 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 23:50:38.851324 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.851292 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 23:50:38.901653 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.901585 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-federate-client-tls\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:38.901653 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.901653 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-telemeter-client-tls\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:38.901838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.901682 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14913d44-1aae-4c39-8cf5-e34d7808bc4a-serving-certs-ca-bundle\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:38.901838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.901722 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14913d44-1aae-4c39-8cf5-e34d7808bc4a-metrics-client-ca\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:38.901838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.901755 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dcnn\" (UniqueName: \"kubernetes.io/projected/14913d44-1aae-4c39-8cf5-e34d7808bc4a-kube-api-access-6dcnn\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:38.901838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.901799 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-secret-telemeter-client\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:38.901838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.901828 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:38.902082 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.901850 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14913d44-1aae-4c39-8cf5-e34d7808bc4a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:38.967451 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:38.967272 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:39.002799 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.002765 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.002974 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.002815 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14913d44-1aae-4c39-8cf5-e34d7808bc4a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.002974 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.002865 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-federate-client-tls\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.002974 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.002894 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-telemeter-client-tls\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.002974 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.002934 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14913d44-1aae-4c39-8cf5-e34d7808bc4a-serving-certs-ca-bundle\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.002974 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.002974 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14913d44-1aae-4c39-8cf5-e34d7808bc4a-metrics-client-ca\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.003196 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.003006 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dcnn\" (UniqueName: \"kubernetes.io/projected/14913d44-1aae-4c39-8cf5-e34d7808bc4a-kube-api-access-6dcnn\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.003196 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.003054 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-secret-telemeter-client\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.004258 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.004167 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14913d44-1aae-4c39-8cf5-e34d7808bc4a-metrics-client-ca\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.004596 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.004487 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14913d44-1aae-4c39-8cf5-e34d7808bc4a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.005115 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.005089 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14913d44-1aae-4c39-8cf5-e34d7808bc4a-serving-certs-ca-bundle\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.006555 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.006509 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-telemeter-client-tls\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.007738 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.007696 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.007863 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.007775 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-federate-client-tls\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.012320 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.012269 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dcnn\" (UniqueName: \"kubernetes.io/projected/14913d44-1aae-4c39-8cf5-e34d7808bc4a-kube-api-access-6dcnn\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.013403 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.013379 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/14913d44-1aae-4c39-8cf5-e34d7808bc4a-secret-telemeter-client\") pod \"telemeter-client-5c76b54566-cdjjx\" (UID: \"14913d44-1aae-4c39-8cf5-e34d7808bc4a\") " pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.156926 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.156831 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" Jul 06 23:50:39.417107 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.415941 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d44544bdd-zhj24"] Jul 06 23:50:39.459594 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:39.459554 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c76b54566-cdjjx"] Jul 06 23:50:39.466938 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:39.466892 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14913d44_1aae_4c39_8cf5_e34d7808bc4a.slice/crio-cf981096dae5a85a498028666b3c4fd080d38774ba7f76be13dc700be9ea7aa4 WatchSource:0}: Error finding container cf981096dae5a85a498028666b3c4fd080d38774ba7f76be13dc700be9ea7aa4: Status 404 returned error can't find the container with id cf981096dae5a85a498028666b3c4fd080d38774ba7f76be13dc700be9ea7aa4 Jul 06 23:50:40.185955 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.185908 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" event={"ID":"14913d44-1aae-4c39-8cf5-e34d7808bc4a","Type":"ContainerStarted","Data":"cf981096dae5a85a498028666b3c4fd080d38774ba7f76be13dc700be9ea7aa4"} Jul 06 23:50:40.187925 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.187895 2584 generic.go:356] "Generic (PLEG): container finished" podID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerID="86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800" exitCode=0 Jul 06 23:50:40.188077 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.187992 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerDied","Data":"86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800"} Jul 06 23:50:40.192031 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.191977 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" event={"ID":"14d32330-317f-4a76-9112-3b74784e8518","Type":"ContainerStarted","Data":"5b88e5d9f65e2d18fbec63742a3857696c73b9776d1202586777450204d36c94"} Jul 06 23:50:40.192143 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.192071 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" event={"ID":"14d32330-317f-4a76-9112-3b74784e8518","Type":"ContainerStarted","Data":"842d5c1bf04258b320c15787356274ae1dc05253b9d7629b8b88d915e2f67ad0"} Jul 06 23:50:40.192143 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.192101 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" event={"ID":"14d32330-317f-4a76-9112-3b74784e8518","Type":"ContainerStarted","Data":"20e5e9639fc20d08ce3507dc80e2f92578a69725c0a6421217058e942dc25919"} Jul 06 23:50:40.195135 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.195104 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" event={"ID":"77bfbfcc-be10-482a-b570-6bbfaff158c3","Type":"ContainerStarted","Data":"6863b8e14a50ea0f5cc4dc588223886e80ca8caf9c82706cc767a61050b75249"} Jul 06 23:50:40.197013 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.196975 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d44544bdd-zhj24" event={"ID":"a464aa99-5912-44a3-be30-c2deb743e0ad","Type":"ContainerStarted","Data":"2b3ae75a13fe565afee00ad3ce432316c6ba81aa96d991898e41e9a625259a40"} Jul 06 23:50:40.197122 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.197027 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d44544bdd-zhj24" event={"ID":"a464aa99-5912-44a3-be30-c2deb743e0ad","Type":"ContainerStarted","Data":"ee79f7a7cc9875c6da81b222d821eff313e481e1d93b8146965155cd83ff280c"} Jul 06 23:50:40.198769 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.198740 2584 generic.go:356] "Generic (PLEG): container finished" podID="15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf" containerID="97c1a07b73e84449b987d52b9863cae7de0aad239496da81b7f006514b1a2953" exitCode=0 Jul 06 23:50:40.198838 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.198798 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sfdq" event={"ID":"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf","Type":"ContainerDied","Data":"97c1a07b73e84449b987d52b9863cae7de0aad239496da81b7f006514b1a2953"} Jul 06 23:50:40.242552 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.242488 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxkfw" podStartSLOduration=4.126010237 podStartE2EDuration="7.242467332s" totalImagesPullingTime="3.116457095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:40.242260691 +0000 UTC m=+98.034002442" watchObservedRunningTime="2026-07-06 23:50:40.242467332 +0000 UTC m=+98.034209070" Jul 06 23:50:40.294894 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.294835 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d44544bdd-zhj24" podStartSLOduration=2.294810425 podStartE2EDuration="2.294810425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:40.271571927 +0000 UTC m=+98.063313686" watchObservedRunningTime="2026-07-06 23:50:40.294810425 +0000 UTC m=+98.086552166" Jul 06 23:50:40.295416 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:40.295379 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kzd46" podStartSLOduration=2.27767958 podStartE2EDuration="7.29536695s" totalImagesPullingTime="5.01768737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:40.293092076 +0000 UTC m=+98.084833840" watchObservedRunningTime="2026-07-06 23:50:40.29536695 +0000 UTC m=+98.087108689" Jul 06 23:50:41.207258 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:41.207215 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sfdq" event={"ID":"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf","Type":"ContainerStarted","Data":"174e6498f093256b9aa5764d0484c55c1f64e572c1578e2b67f954db07e9610b"} Jul 06 23:50:41.207740 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:41.207282 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sfdq" event={"ID":"15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf","Type":"ContainerStarted","Data":"19dc8450b0b3398c171f05b2c119823dfe24426f827063d64715b4f781c96d17"} Jul 06 23:50:41.228032 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:41.227975 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2sfdq" podStartSLOduration=4.751039122 podStartE2EDuration="8.227958404s" totalImagesPullingTime="3.349129767s" totalInitContainerRuntime="127.789515ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:41.227097086 +0000 UTC m=+99.018838845" watchObservedRunningTime="2026-07-06 23:50:41.227958404 +0000 UTC m=+99.019700142" Jul 06 23:50:43.219967 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:43.219926 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerStarted","Data":"131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3"} Jul 06 23:50:43.220452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:43.220019 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerStarted","Data":"174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1"} Jul 06 23:50:43.220452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:43.220061 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerStarted","Data":"35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a"} Jul 06 23:50:43.220452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:43.220102 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerStarted","Data":"cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e"} Jul 06 23:50:43.220452 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:43.220139 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerStarted","Data":"aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47"} Jul 06 23:50:43.222867 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:43.222829 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" event={"ID":"14913d44-1aae-4c39-8cf5-e34d7808bc4a","Type":"ContainerStarted","Data":"09ac580c6e797f85f7fa8c00b4f137bb1ede7bd2116faeae43c391bad908c2ef"} Jul 06 23:50:43.222994 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:43.222900 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" event={"ID":"14913d44-1aae-4c39-8cf5-e34d7808bc4a","Type":"ContainerStarted","Data":"5e7a701f9d056b8eb23537f639c8c8073eb362a31a2db6b7447474d484ebc7ad"} Jul 06 23:50:43.222994 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:43.222933 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" event={"ID":"14913d44-1aae-4c39-8cf5-e34d7808bc4a","Type":"ContainerStarted","Data":"bfb416a5f836e26b5b7c2129d59146f37fd94a2a1beaba6b2697b8d1744f89b1"} Jul 06 23:50:43.245848 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:43.245788 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c76b54566-cdjjx" podStartSLOduration=2.337164676 podStartE2EDuration="5.245765311s" totalImagesPullingTime="2.908600635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:43.243987558 +0000 UTC m=+101.035729323" watchObservedRunningTime="2026-07-06 23:50:43.245765311 +0000 UTC m=+101.037507049" Jul 06 23:50:44.113191 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.113145 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d44544bdd-zhj24"] Jul 06 23:50:44.153134 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.153095 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-799b4847c-5c86h"] Jul 06 23:50:44.172908 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.172873 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-799b4847c-5c86h"] Jul 06 23:50:44.173068 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.173002 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.255992 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.255949 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-oauth-serving-cert\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.256389 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.256030 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-oauth-config\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.256389 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.256080 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-service-ca\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.256389 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.256126 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-serving-cert\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.256389 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.256147 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-config\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.256389 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.256184 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-trusted-ca-bundle\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.256389 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.256216 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnrtq\" (UniqueName: \"kubernetes.io/projected/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-kube-api-access-pnrtq\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.357003 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.356968 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnrtq\" (UniqueName: \"kubernetes.io/projected/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-kube-api-access-pnrtq\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.357200 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.357025 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-oauth-serving-cert\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.357437 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.357411 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-oauth-config\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.357530 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.357493 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-service-ca\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.357635 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.357590 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-serving-cert\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.357710 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.357658 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-config\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.357763 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.357722 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-trusted-ca-bundle\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.357875 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.357847 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-oauth-serving-cert\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.358249 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.358222 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-service-ca\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.358519 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.358460 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-trusted-ca-bundle\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.358688 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.358663 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-config\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.360047 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.360024 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-oauth-config\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.360341 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.360321 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-serving-cert\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.364380 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.364358 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnrtq\" (UniqueName: \"kubernetes.io/projected/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-kube-api-access-pnrtq\") pod \"console-799b4847c-5c86h\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.483437 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.483414 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:44.697831 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:50:44.697798 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7fd6f3_ebe4_4354_b990_2739e84bd3a7.slice/crio-4e4da944635bc25d6fd883b2bbd987b8e6546c4254dce754289f0292e4d685a5 WatchSource:0}: Error finding container 4e4da944635bc25d6fd883b2bbd987b8e6546c4254dce754289f0292e4d685a5: Status 404 returned error can't find the container with id 4e4da944635bc25d6fd883b2bbd987b8e6546c4254dce754289f0292e4d685a5 Jul 06 23:50:44.698181 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:44.698159 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-799b4847c-5c86h"] Jul 06 23:50:45.237640 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:45.237563 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerStarted","Data":"3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24"} Jul 06 23:50:45.239317 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:45.239266 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799b4847c-5c86h" event={"ID":"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7","Type":"ContainerStarted","Data":"4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678"} Jul 06 23:50:45.239483 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:45.239329 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799b4847c-5c86h" event={"ID":"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7","Type":"ContainerStarted","Data":"4e4da944635bc25d6fd883b2bbd987b8e6546c4254dce754289f0292e4d685a5"} Jul 06 23:50:45.265758 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:45.265683 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.508113657 podStartE2EDuration="11.265658652s" totalImagesPullingTime="6.748299816s" totalInitContainerRuntime="9.245179ms" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:45.263947456 +0000 UTC m=+103.055689220" watchObservedRunningTime="2026-07-06 23:50:45.265658652 +0000 UTC m=+103.057400391" Jul 06 23:50:45.283115 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:45.283064 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-799b4847c-5c86h" podStartSLOduration=1.283047231 podStartE2EDuration="1.283047231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:45.281150396 +0000 UTC m=+103.072892155" watchObservedRunningTime="2026-07-06 23:50:45.283047231 +0000 UTC m=+103.074788969" Jul 06 23:50:47.018153 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:47.018121 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rtfjh" Jul 06 23:50:48.967718 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:48.967675 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:50:54.484133 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:54.484095 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:54.484589 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:54.484176 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:54.488889 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:54.488863 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:50:55.283465 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:50:55.283436 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:51:00.373516 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.373447 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-df4f849b4-x7jjc" podUID="9065ec3e-5a44-489f-bdac-1f6c97399cbb" containerName="console" containerID="cri-o://f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97" gracePeriod=15 Jul 06 23:51:00.666822 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.666790 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:51:00.801588 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.801548 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-oauth-serving-cert\") pod \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " Jul 06 23:51:00.801785 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.801633 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-serving-cert\") pod \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " Jul 06 23:51:00.801785 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.801696 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-oauth-config\") pod \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " Jul 06 23:51:00.801785 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.801721 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-service-ca\") pod \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " Jul 06 23:51:00.801927 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.801787 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-config\") pod \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " Jul 06 23:51:00.801927 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.801829 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw9m6\" (UniqueName: \"kubernetes.io/projected/9065ec3e-5a44-489f-bdac-1f6c97399cbb-kube-api-access-sw9m6\") pod \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\" (UID: \"9065ec3e-5a44-489f-bdac-1f6c97399cbb\") " Jul 06 23:51:00.802205 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.802064 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9065ec3e-5a44-489f-bdac-1f6c97399cbb" (UID: "9065ec3e-5a44-489f-bdac-1f6c97399cbb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:00.802205 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.802188 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-service-ca" (OuterVolumeSpecName: "service-ca") pod "9065ec3e-5a44-489f-bdac-1f6c97399cbb" (UID: "9065ec3e-5a44-489f-bdac-1f6c97399cbb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:00.802475 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.802438 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-config" (OuterVolumeSpecName: "console-config") pod "9065ec3e-5a44-489f-bdac-1f6c97399cbb" (UID: "9065ec3e-5a44-489f-bdac-1f6c97399cbb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:00.804153 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.804127 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9065ec3e-5a44-489f-bdac-1f6c97399cbb" (UID: "9065ec3e-5a44-489f-bdac-1f6c97399cbb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:00.804238 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.804215 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9065ec3e-5a44-489f-bdac-1f6c97399cbb-kube-api-access-sw9m6" (OuterVolumeSpecName: "kube-api-access-sw9m6") pod "9065ec3e-5a44-489f-bdac-1f6c97399cbb" (UID: "9065ec3e-5a44-489f-bdac-1f6c97399cbb"). InnerVolumeSpecName "kube-api-access-sw9m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:51:00.804274 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.804230 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9065ec3e-5a44-489f-bdac-1f6c97399cbb" (UID: "9065ec3e-5a44-489f-bdac-1f6c97399cbb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:00.902598 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.902505 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-oauth-config\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:00.902598 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.902536 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-service-ca\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:00.902598 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.902549 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-config\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:00.902598 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.902560 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw9m6\" (UniqueName: \"kubernetes.io/projected/9065ec3e-5a44-489f-bdac-1f6c97399cbb-kube-api-access-sw9m6\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:00.902598 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.902572 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9065ec3e-5a44-489f-bdac-1f6c97399cbb-oauth-serving-cert\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:00.902598 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:00.902585 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9065ec3e-5a44-489f-bdac-1f6c97399cbb-console-serving-cert\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:01.306275 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:01.306191 2584 generic.go:356] "Generic (PLEG): container finished" podID="9065ec3e-5a44-489f-bdac-1f6c97399cbb" containerID="f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97" exitCode=0 Jul 06 23:51:01.306275 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:01.306239 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df4f849b4-x7jjc" Jul 06 23:51:01.306275 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:01.306259 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df4f849b4-x7jjc" event={"ID":"9065ec3e-5a44-489f-bdac-1f6c97399cbb","Type":"ContainerDied","Data":"f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97"} Jul 06 23:51:01.306486 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:01.306303 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df4f849b4-x7jjc" event={"ID":"9065ec3e-5a44-489f-bdac-1f6c97399cbb","Type":"ContainerDied","Data":"d887e3626b40730b4a02990fe45b8dc7a50429b4bcae34f7d3562b0ee4b5305b"} Jul 06 23:51:01.306486 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:01.306339 2584 scope.go:117] "RemoveContainer" containerID="f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97" Jul 06 23:51:01.315539 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:01.315518 2584 scope.go:117] "RemoveContainer" containerID="f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97" Jul 06 23:51:01.315850 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:51:01.315828 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97\": container with ID starting with f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97 not found: ID does not exist" containerID="f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97" Jul 06 23:51:01.315920 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:01.315857 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97"} err="failed to get container status \"f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97\": rpc error: code = NotFound desc = could not find container \"f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97\": container with ID starting with f563bfa4de501a7df78ceabc9de599f6b09efded19b9efda045eb91a34b56d97 not found: ID does not exist" Jul 06 23:51:01.330297 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:01.330268 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-df4f849b4-x7jjc"] Jul 06 23:51:01.336031 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:01.336007 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-df4f849b4-x7jjc"] Jul 06 23:51:02.695328 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:02.695281 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9065ec3e-5a44-489f-bdac-1f6c97399cbb" path="/var/lib/kubelet/pods/9065ec3e-5a44-489f-bdac-1f6c97399cbb/volumes" Jul 06 23:51:09.135760 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.135686 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d44544bdd-zhj24" podUID="a464aa99-5912-44a3-be30-c2deb743e0ad" containerName="console" containerID="cri-o://2b3ae75a13fe565afee00ad3ce432316c6ba81aa96d991898e41e9a625259a40" gracePeriod=15 Jul 06 23:51:09.341644 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.341583 2584 generic.go:356] "Generic (PLEG): container finished" podID="a464aa99-5912-44a3-be30-c2deb743e0ad" containerID="2b3ae75a13fe565afee00ad3ce432316c6ba81aa96d991898e41e9a625259a40" exitCode=0 Jul 06 23:51:09.341804 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.341644 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d44544bdd-zhj24" event={"ID":"a464aa99-5912-44a3-be30-c2deb743e0ad","Type":"ContainerDied","Data":"2b3ae75a13fe565afee00ad3ce432316c6ba81aa96d991898e41e9a625259a40"} Jul 06 23:51:09.415045 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.414962 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:51:09.576276 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576242 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-console-config\") pod \"a464aa99-5912-44a3-be30-c2deb743e0ad\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " Jul 06 23:51:09.576448 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576295 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-oauth-config\") pod \"a464aa99-5912-44a3-be30-c2deb743e0ad\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " Jul 06 23:51:09.576448 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576326 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-serving-cert\") pod \"a464aa99-5912-44a3-be30-c2deb743e0ad\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " Jul 06 23:51:09.576448 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576363 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-service-ca\") pod \"a464aa99-5912-44a3-be30-c2deb743e0ad\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " Jul 06 23:51:09.576448 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576394 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nxvt\" (UniqueName: \"kubernetes.io/projected/a464aa99-5912-44a3-be30-c2deb743e0ad-kube-api-access-7nxvt\") pod \"a464aa99-5912-44a3-be30-c2deb743e0ad\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " Jul 06 23:51:09.576448 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576432 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-oauth-serving-cert\") pod \"a464aa99-5912-44a3-be30-c2deb743e0ad\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " Jul 06 23:51:09.576726 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576478 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-trusted-ca-bundle\") pod \"a464aa99-5912-44a3-be30-c2deb743e0ad\" (UID: \"a464aa99-5912-44a3-be30-c2deb743e0ad\") " Jul 06 23:51:09.576849 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576701 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-console-config" (OuterVolumeSpecName: "console-config") pod "a464aa99-5912-44a3-be30-c2deb743e0ad" (UID: "a464aa99-5912-44a3-be30-c2deb743e0ad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:09.576983 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576892 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a464aa99-5912-44a3-be30-c2deb743e0ad" (UID: "a464aa99-5912-44a3-be30-c2deb743e0ad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:09.577264 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.576994 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-service-ca" (OuterVolumeSpecName: "service-ca") pod "a464aa99-5912-44a3-be30-c2deb743e0ad" (UID: "a464aa99-5912-44a3-be30-c2deb743e0ad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:09.577264 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.577066 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a464aa99-5912-44a3-be30-c2deb743e0ad" (UID: "a464aa99-5912-44a3-be30-c2deb743e0ad"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:09.578739 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.578711 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a464aa99-5912-44a3-be30-c2deb743e0ad" (UID: "a464aa99-5912-44a3-be30-c2deb743e0ad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:09.578843 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.578799 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a464aa99-5912-44a3-be30-c2deb743e0ad" (UID: "a464aa99-5912-44a3-be30-c2deb743e0ad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:09.578843 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.578808 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a464aa99-5912-44a3-be30-c2deb743e0ad-kube-api-access-7nxvt" (OuterVolumeSpecName: "kube-api-access-7nxvt") pod "a464aa99-5912-44a3-be30-c2deb743e0ad" (UID: "a464aa99-5912-44a3-be30-c2deb743e0ad"). InnerVolumeSpecName "kube-api-access-7nxvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:51:09.677579 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.677498 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-oauth-config\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:09.677579 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.677526 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a464aa99-5912-44a3-be30-c2deb743e0ad-console-serving-cert\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:09.677579 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.677539 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-service-ca\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:09.677579 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.677547 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nxvt\" (UniqueName: \"kubernetes.io/projected/a464aa99-5912-44a3-be30-c2deb743e0ad-kube-api-access-7nxvt\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:09.677579 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.677556 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-oauth-serving-cert\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:09.677579 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.677564 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-trusted-ca-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:09.677579 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:09.677573 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a464aa99-5912-44a3-be30-c2deb743e0ad-console-config\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:10.346919 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:10.346886 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d44544bdd-zhj24" Jul 06 23:51:10.347375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:10.346912 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d44544bdd-zhj24" event={"ID":"a464aa99-5912-44a3-be30-c2deb743e0ad","Type":"ContainerDied","Data":"ee79f7a7cc9875c6da81b222d821eff313e481e1d93b8146965155cd83ff280c"} Jul 06 23:51:10.347375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:10.346974 2584 scope.go:117] "RemoveContainer" containerID="2b3ae75a13fe565afee00ad3ce432316c6ba81aa96d991898e41e9a625259a40" Jul 06 23:51:10.365749 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:10.365719 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d44544bdd-zhj24"] Jul 06 23:51:10.368755 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:10.368732 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d44544bdd-zhj24"] Jul 06 23:51:10.694993 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:10.694959 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a464aa99-5912-44a3-be30-c2deb743e0ad" path="/var/lib/kubelet/pods/a464aa99-5912-44a3-be30-c2deb743e0ad/volumes" Jul 06 23:51:54.068169 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.068078 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 23:51:54.068706 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.068413 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="alertmanager" containerID="cri-o://aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47" gracePeriod=120 Jul 06 23:51:54.068706 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.068457 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy" containerID="cri-o://174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1" gracePeriod=120 Jul 06 23:51:54.068706 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.068489 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy-metric" containerID="cri-o://131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3" gracePeriod=120 Jul 06 23:51:54.068706 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.068496 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy-web" containerID="cri-o://35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a" gracePeriod=120 Jul 06 23:51:54.068706 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.068459 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="prom-label-proxy" containerID="cri-o://3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24" gracePeriod=120 Jul 06 23:51:54.068706 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.068509 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="config-reloader" containerID="cri-o://cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e" gracePeriod=120 Jul 06 23:51:54.529862 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.529829 2584 generic.go:356] "Generic (PLEG): container finished" podID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerID="3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24" exitCode=0 Jul 06 23:51:54.529862 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.529853 2584 generic.go:356] "Generic (PLEG): container finished" podID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerID="131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3" exitCode=0 Jul 06 23:51:54.529862 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.529859 2584 generic.go:356] "Generic (PLEG): container finished" podID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerID="174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1" exitCode=0 Jul 06 23:51:54.529862 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.529865 2584 generic.go:356] "Generic (PLEG): container finished" podID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerID="cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e" exitCode=0 Jul 06 23:51:54.529862 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.529870 2584 generic.go:356] "Generic (PLEG): container finished" podID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerID="aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47" exitCode=0 Jul 06 23:51:54.530163 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.529903 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerDied","Data":"3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24"} Jul 06 23:51:54.530163 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.529970 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerDied","Data":"131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3"} Jul 06 23:51:54.530163 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.529997 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerDied","Data":"174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1"} Jul 06 23:51:54.530163 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.530022 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerDied","Data":"cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e"} Jul 06 23:51:54.530163 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:54.530047 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerDied","Data":"aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47"} Jul 06 23:51:55.304862 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.304836 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.460885 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.460792 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-main-db\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.460885 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.460840 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-metrics-client-ca\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.460885 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.460860 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.460888 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.460917 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-web-config\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.460945 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-trusted-ca-bundle\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.460984 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-tls-assets\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461018 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-web\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461041 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kqcs\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-kube-api-access-6kqcs\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461078 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-volume\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461116 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-out\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461161 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461148 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-main-tls\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461638 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461211 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-cluster-tls-config\") pod \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\" (UID: \"d3de6bcb-965d-496b-a5b2-ea2f16205ae5\") " Jul 06 23:51:55.461638 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461225 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:51:55.461638 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461302 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:55.461638 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461491 2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-metrics-client-ca\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.461638 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461511 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-main-db\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.461909 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.461653 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:55.464206 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.464176 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:55.464515 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.464431 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-out" (OuterVolumeSpecName: "config-out") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:51:55.464515 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.464450 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:55.464713 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.464529 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-kube-api-access-6kqcs" (OuterVolumeSpecName: "kube-api-access-6kqcs") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "kube-api-access-6kqcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:51:55.464927 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.464895 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:55.465174 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.465062 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:51:55.466102 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.466077 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-volume" (OuterVolumeSpecName: "config-volume") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:55.466371 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.466344 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:55.468572 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.468545 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:55.475191 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.475168 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-web-config" (OuterVolumeSpecName: "web-config") pod "d3de6bcb-965d-496b-a5b2-ea2f16205ae5" (UID: "d3de6bcb-965d-496b-a5b2-ea2f16205ae5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:55.536875 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.536843 2584 generic.go:356] "Generic (PLEG): container finished" podID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerID="35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a" exitCode=0 Jul 06 23:51:55.537026 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.536931 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.537026 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.536938 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerDied","Data":"35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a"} Jul 06 23:51:55.537026 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.537013 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3de6bcb-965d-496b-a5b2-ea2f16205ae5","Type":"ContainerDied","Data":"cd32008a08e80690e99098d5aca6ac2d166496ad24541021cc851d352c1f0bac"} Jul 06 23:51:55.537145 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.537051 2584 scope.go:117] "RemoveContainer" containerID="3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24" Jul 06 23:51:55.546673 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.546249 2584 scope.go:117] "RemoveContainer" containerID="131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3" Jul 06 23:51:55.554451 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.554430 2584 scope.go:117] "RemoveContainer" containerID="174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1" Jul 06 23:51:55.558773 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.558748 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 23:51:55.562027 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562001 2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-volume\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562134 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562034 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-config-out\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562134 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562050 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-main-tls\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562134 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562066 2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-cluster-tls-config\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562134 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562083 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562134 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562099 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562134 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562114 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-web-config\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562134 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562129 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562435 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562143 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-tls-assets\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562435 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562156 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.562435 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.562169 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kqcs\" (UniqueName: \"kubernetes.io/projected/d3de6bcb-965d-496b-a5b2-ea2f16205ae5-kube-api-access-6kqcs\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:51:55.563112 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.563002 2584 scope.go:117] "RemoveContainer" containerID="35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a" Jul 06 23:51:55.563236 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.563142 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 23:51:55.570516 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.570485 2584 scope.go:117] "RemoveContainer" containerID="cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e" Jul 06 23:51:55.578168 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.578150 2584 scope.go:117] "RemoveContainer" containerID="aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47" Jul 06 23:51:55.586021 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.585984 2584 scope.go:117] "RemoveContainer" containerID="86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800" Jul 06 23:51:55.587800 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.587780 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 23:51:55.588076 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588063 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="init-config-reloader" Jul 06 23:51:55.588118 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588078 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="init-config-reloader" Jul 06 23:51:55.588118 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588087 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy-metric" Jul 06 23:51:55.588118 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588092 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy-metric" Jul 06 23:51:55.588118 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588100 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy" Jul 06 23:51:55.588118 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588107 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy" Jul 06 23:51:55.588118 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588117 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9065ec3e-5a44-489f-bdac-1f6c97399cbb" containerName="console" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588122 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9065ec3e-5a44-489f-bdac-1f6c97399cbb" containerName="console" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588129 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="prom-label-proxy" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588134 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="prom-label-proxy" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588141 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="config-reloader" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588146 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="config-reloader" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588154 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="alertmanager" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588158 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="alertmanager" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588166 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a464aa99-5912-44a3-be30-c2deb743e0ad" containerName="console" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588171 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a464aa99-5912-44a3-be30-c2deb743e0ad" containerName="console" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588177 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy-web" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588182 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy-web" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588225 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy-web" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588232 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="prom-label-proxy" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588238 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a464aa99-5912-44a3-be30-c2deb743e0ad" containerName="console" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588244 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="config-reloader" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588249 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588254 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="kube-rbac-proxy-metric" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588259 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9065ec3e-5a44-489f-bdac-1f6c97399cbb" containerName="console" Jul 06 23:51:55.588279 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.588264 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" containerName="alertmanager" Jul 06 23:51:55.591890 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.591871 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.594043 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.593985 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 23:51:55.594157 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594092 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 23:51:55.594157 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594103 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 23:51:55.594157 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594130 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 23:51:55.594305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594254 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 23:51:55.594305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594284 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 23:51:55.594403 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594255 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 23:51:55.594403 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594384 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-spq8j\"" Jul 06 23:51:55.594621 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594582 2584 scope.go:117] "RemoveContainer" containerID="3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24" Jul 06 23:51:55.594683 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594639 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 23:51:55.594968 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:51:55.594941 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24\": container with ID starting with 3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24 not found: ID does not exist" containerID="3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24" Jul 06 23:51:55.595029 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.594981 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24"} err="failed to get container status \"3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24\": rpc error: code = NotFound desc = could not find container \"3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24\": container with ID starting with 3dab11a3247ca6ee6a36c7d3e816fb68e868f9e50c662e4a34384c6c9f09cc24 not found: ID does not exist" Jul 06 23:51:55.595029 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.595011 2584 scope.go:117] "RemoveContainer" containerID="131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3" Jul 06 23:51:55.595319 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:51:55.595293 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3\": container with ID starting with 131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3 not found: ID does not exist" containerID="131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3" Jul 06 23:51:55.595368 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.595323 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3"} err="failed to get container status \"131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3\": rpc error: code = NotFound desc = could not find container \"131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3\": container with ID starting with 131c5e14e998dddf26b021acaf61d33923a2c86008b3918b498a61fd3ac151d3 not found: ID does not exist" Jul 06 23:51:55.595368 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.595336 2584 scope.go:117] "RemoveContainer" containerID="174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1" Jul 06 23:51:55.595627 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:51:55.595585 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1\": container with ID starting with 174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1 not found: ID does not exist" containerID="174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1" Jul 06 23:51:55.595728 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.595635 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1"} err="failed to get container status \"174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1\": rpc error: code = NotFound desc = could not find container \"174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1\": container with ID starting with 174f446b0edc9585a0d41b1cd7e9b27541440316a98ef0f50d4662125233fea1 not found: ID does not exist" Jul 06 23:51:55.595728 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.595654 2584 scope.go:117] "RemoveContainer" containerID="35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a" Jul 06 23:51:55.595953 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:51:55.595932 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a\": container with ID starting with 35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a not found: ID does not exist" containerID="35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a" Jul 06 23:51:55.596081 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.596054 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a"} err="failed to get container status \"35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a\": rpc error: code = NotFound desc = could not find container \"35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a\": container with ID starting with 35c3c121d990847b9aeb938f9dde30d397a267b5f6db6b33257767754b92b27a not found: ID does not exist" Jul 06 23:51:55.596081 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.596081 2584 scope.go:117] "RemoveContainer" containerID="cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e" Jul 06 23:51:55.596364 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:51:55.596346 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e\": container with ID starting with cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e not found: ID does not exist" containerID="cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e" Jul 06 23:51:55.596437 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.596368 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e"} err="failed to get container status \"cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e\": rpc error: code = NotFound desc = could not find container \"cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e\": container with ID starting with cb0e615f6c5d16ef03eea2e2d24e97ff5f16dbfaebe1c78f32ffe29e79955d1e not found: ID does not exist" Jul 06 23:51:55.596437 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.596383 2584 scope.go:117] "RemoveContainer" containerID="aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47" Jul 06 23:51:55.596704 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:51:55.596679 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47\": container with ID starting with aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47 not found: ID does not exist" containerID="aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47" Jul 06 23:51:55.596770 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.596722 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47"} err="failed to get container status \"aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47\": rpc error: code = NotFound desc = could not find container \"aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47\": container with ID starting with aa49812864fd120a3268d1ebd0359d77c891a597030e51f2f95e4959fc58bb47 not found: ID does not exist" Jul 06 23:51:55.596770 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.596742 2584 scope.go:117] "RemoveContainer" containerID="86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800" Jul 06 23:51:55.597023 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:51:55.597003 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800\": container with ID starting with 86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800 not found: ID does not exist" containerID="86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800" Jul 06 23:51:55.597076 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.597032 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800"} err="failed to get container status \"86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800\": rpc error: code = NotFound desc = could not find container \"86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800\": container with ID starting with 86f70eeb86cb5fc6abd0b5609ae83855fd771bc313c470620209023a9c18b800 not found: ID does not exist" Jul 06 23:51:55.600507 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.600463 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 23:51:55.612322 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.612295 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 23:51:55.763849 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.763749 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6c33848-79a1-4152-9438-02e1685e64c1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.763849 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.763797 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6c33848-79a1-4152-9438-02e1685e64c1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.763849 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.763820 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.763849 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.763838 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6c33848-79a1-4152-9438-02e1685e64c1-config-out\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.764138 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.763858 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.764138 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.763917 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6c33848-79a1-4152-9438-02e1685e64c1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.764138 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.763956 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48h7f\" (UniqueName: \"kubernetes.io/projected/b6c33848-79a1-4152-9438-02e1685e64c1-kube-api-access-48h7f\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.764138 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.763982 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-config-volume\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.764138 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.764010 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.764138 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.764072 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6c33848-79a1-4152-9438-02e1685e64c1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.764138 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.764095 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.764138 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.764123 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-web-config\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.764364 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.764149 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.864700 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.864648 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.864700 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.864700 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6c33848-79a1-4152-9438-02e1685e64c1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.864700 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.864717 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h7f\" (UniqueName: \"kubernetes.io/projected/b6c33848-79a1-4152-9438-02e1685e64c1-kube-api-access-48h7f\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.864966 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.864739 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-config-volume\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865023 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.864971 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865199 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.865167 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6c33848-79a1-4152-9438-02e1685e64c1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865319 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.865215 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865319 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.865253 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-web-config\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865319 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.865312 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865468 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.865366 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6c33848-79a1-4152-9438-02e1685e64c1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865468 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.865402 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6c33848-79a1-4152-9438-02e1685e64c1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865468 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.865459 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865821 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.865492 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6c33848-79a1-4152-9438-02e1685e64c1-config-out\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.865933 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.865908 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6c33848-79a1-4152-9438-02e1685e64c1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.868047 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.868015 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6c33848-79a1-4152-9438-02e1685e64c1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.868152 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.868047 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-config-volume\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.868152 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.868075 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.868273 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.868240 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.868335 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.868302 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6c33848-79a1-4152-9438-02e1685e64c1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.868582 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.868548 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.868679 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.868577 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6c33848-79a1-4152-9438-02e1685e64c1-config-out\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.868679 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.868581 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6c33848-79a1-4152-9438-02e1685e64c1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.868892 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.868876 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.869298 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.869277 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-web-config\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.870341 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.870324 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6c33848-79a1-4152-9438-02e1685e64c1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.873245 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.873224 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48h7f\" (UniqueName: \"kubernetes.io/projected/b6c33848-79a1-4152-9438-02e1685e64c1-kube-api-access-48h7f\") pod \"alertmanager-main-0\" (UID: \"b6c33848-79a1-4152-9438-02e1685e64c1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:55.902243 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:55.902215 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 23:51:56.042222 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:56.042148 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 23:51:56.045328 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:51:56.045301 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c33848_79a1_4152_9438_02e1685e64c1.slice/crio-83c582c32aeddfb52bf89d56e12c60773d102b9754f989fd725212704e737eaf WatchSource:0}: Error finding container 83c582c32aeddfb52bf89d56e12c60773d102b9754f989fd725212704e737eaf: Status 404 returned error can't find the container with id 83c582c32aeddfb52bf89d56e12c60773d102b9754f989fd725212704e737eaf Jul 06 23:51:56.543736 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:56.543702 2584 generic.go:356] "Generic (PLEG): container finished" podID="b6c33848-79a1-4152-9438-02e1685e64c1" containerID="219e9b5060b6a919bbc545615e5b3819fa106c31741a67222be3aa9149e4cd16" exitCode=0 Jul 06 23:51:56.544151 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:56.543786 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6c33848-79a1-4152-9438-02e1685e64c1","Type":"ContainerDied","Data":"219e9b5060b6a919bbc545615e5b3819fa106c31741a67222be3aa9149e4cd16"} Jul 06 23:51:56.544151 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:56.543854 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6c33848-79a1-4152-9438-02e1685e64c1","Type":"ContainerStarted","Data":"83c582c32aeddfb52bf89d56e12c60773d102b9754f989fd725212704e737eaf"} Jul 06 23:51:56.697115 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:56.697083 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3de6bcb-965d-496b-a5b2-ea2f16205ae5" path="/var/lib/kubelet/pods/d3de6bcb-965d-496b-a5b2-ea2f16205ae5/volumes" Jul 06 23:51:57.553459 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:57.553428 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6c33848-79a1-4152-9438-02e1685e64c1","Type":"ContainerStarted","Data":"83899b2e2d40a5712148c4889f774d4b51a8b8dec8bd1166f00834c3fa454193"} Jul 06 23:51:57.553842 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:57.553490 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6c33848-79a1-4152-9438-02e1685e64c1","Type":"ContainerStarted","Data":"7fafb0684e65765a655ea6c31a01257e16929fedf886c3f8aa18054294a5e6e4"} Jul 06 23:51:57.553842 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:57.553519 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6c33848-79a1-4152-9438-02e1685e64c1","Type":"ContainerStarted","Data":"a83417d4d6e7011191f297f43ad2961269e035389e08a4ddaeb40aac7afca54c"} Jul 06 23:51:57.553842 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:57.553545 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6c33848-79a1-4152-9438-02e1685e64c1","Type":"ContainerStarted","Data":"9d8f74af87d7cee6fc2dc782af32b60af64d1a85130b05718a4cb38f778d83ca"} Jul 06 23:51:57.553842 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:57.553570 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6c33848-79a1-4152-9438-02e1685e64c1","Type":"ContainerStarted","Data":"6de5eef81c62e01196283a4ac8624035b5fbb38b9e2d5668ac3aac7675a8972e"} Jul 06 23:51:57.553842 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:57.553594 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6c33848-79a1-4152-9438-02e1685e64c1","Type":"ContainerStarted","Data":"08f57112f27efed3056cd4d9e9ef8d89343ce57fdb6908373b884594b0b07eb6"} Jul 06 23:51:57.579060 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:51:57.579011 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.563184933 podStartE2EDuration="2.578990788s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.805855ms" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:57.576996911 +0000 UTC m=+175.368738648" watchObservedRunningTime="2026-07-06 23:51:57.578990788 +0000 UTC m=+175.370732525" Jul 06 23:52:09.782778 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:09.782744 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-799b4847c-5c86h"] Jul 06 23:52:34.803670 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:34.803597 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-799b4847c-5c86h" podUID="0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" containerName="console" containerID="cri-o://4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678" gracePeriod=15 Jul 06 23:52:35.052253 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.052226 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:52:35.170228 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170190 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-oauth-serving-cert\") pod \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " Jul 06 23:52:35.170422 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170257 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-config\") pod \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " Jul 06 23:52:35.170422 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170281 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnrtq\" (UniqueName: \"kubernetes.io/projected/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-kube-api-access-pnrtq\") pod \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " Jul 06 23:52:35.170422 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170314 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-trusted-ca-bundle\") pod \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " Jul 06 23:52:35.170422 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170358 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-serving-cert\") pod \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " Jul 06 23:52:35.170652 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170538 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-oauth-config\") pod \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " Jul 06 23:52:35.170652 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170644 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-service-ca\") pod \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\" (UID: \"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7\") " Jul 06 23:52:35.170773 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170744 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-config" (OuterVolumeSpecName: "console-config") pod "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" (UID: "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:52:35.170951 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170925 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" (UID: "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:52:35.171018 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.170984 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-config\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:35.171073 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.171022 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" (UID: "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:52:35.171073 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.171042 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" (UID: "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:52:35.172717 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.172690 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" (UID: "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:52:35.172831 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.172783 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" (UID: "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:52:35.172899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.172880 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-kube-api-access-pnrtq" (OuterVolumeSpecName: "kube-api-access-pnrtq") pod "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" (UID: "0c7fd6f3-ebe4-4354-b990-2739e84bd3a7"). InnerVolumeSpecName "kube-api-access-pnrtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:52:35.271573 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.271537 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-oauth-config\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:35.271573 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.271566 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-service-ca\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:35.271573 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.271576 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-oauth-serving-cert\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:35.271819 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.271584 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnrtq\" (UniqueName: \"kubernetes.io/projected/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-kube-api-access-pnrtq\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:35.271819 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.271593 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-trusted-ca-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:35.271819 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.271622 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7-console-serving-cert\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:35.706112 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.706074 2584 generic.go:356] "Generic (PLEG): container finished" podID="0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" containerID="4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678" exitCode=0 Jul 06 23:52:35.706281 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.706123 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799b4847c-5c86h" Jul 06 23:52:35.706281 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.706164 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799b4847c-5c86h" event={"ID":"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7","Type":"ContainerDied","Data":"4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678"} Jul 06 23:52:35.706281 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.706221 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799b4847c-5c86h" event={"ID":"0c7fd6f3-ebe4-4354-b990-2739e84bd3a7","Type":"ContainerDied","Data":"4e4da944635bc25d6fd883b2bbd987b8e6546c4254dce754289f0292e4d685a5"} Jul 06 23:52:35.706281 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.706245 2584 scope.go:117] "RemoveContainer" containerID="4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678" Jul 06 23:52:35.714990 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.714963 2584 scope.go:117] "RemoveContainer" containerID="4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678" Jul 06 23:52:35.715263 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:52:35.715244 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678\": container with ID starting with 4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678 not found: ID does not exist" containerID="4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678" Jul 06 23:52:35.715326 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.715276 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678"} err="failed to get container status \"4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678\": rpc error: code = NotFound desc = could not find container \"4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678\": container with ID starting with 4348a75c772da5798a216721c619b9bbaf075e18f9f71ea0548e0cb01f777678 not found: ID does not exist" Jul 06 23:52:35.730698 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.730664 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-799b4847c-5c86h"] Jul 06 23:52:35.733899 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:35.733874 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-799b4847c-5c86h"] Jul 06 23:52:36.695218 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:36.695183 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" path="/var/lib/kubelet/pods/0c7fd6f3-ebe4-4354-b990-2739e84bd3a7/volumes" Jul 06 23:52:39.496724 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.496688 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw"] Jul 06 23:52:39.497096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.496999 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" containerName="console" Jul 06 23:52:39.497096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.497011 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" containerName="console" Jul 06 23:52:39.497096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.497059 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c7fd6f3-ebe4-4354-b990-2739e84bd3a7" containerName="console" Jul 06 23:52:39.499815 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.499794 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.503709 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.503685 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:52:39.503846 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.503804 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nsbj9\"" Jul 06 23:52:39.505033 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.505013 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:52:39.511056 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.511031 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw"] Jul 06 23:52:39.605994 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.605953 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbk69\" (UniqueName: \"kubernetes.io/projected/23bc9d20-5564-4f8a-b324-2d15b7027d70-kube-api-access-lbk69\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.605994 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.605995 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.606212 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.606021 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.707028 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.706982 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbk69\" (UniqueName: \"kubernetes.io/projected/23bc9d20-5564-4f8a-b324-2d15b7027d70-kube-api-access-lbk69\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.707028 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.707035 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.707270 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.707062 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.707395 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.707377 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.707434 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.707404 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.714987 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.714955 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbk69\" (UniqueName: \"kubernetes.io/projected/23bc9d20-5564-4f8a-b324-2d15b7027d70-kube-api-access-lbk69\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.809776 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.809678 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:39.941749 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:39.941724 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw"] Jul 06 23:52:39.944288 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:52:39.944261 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bc9d20_5564_4f8a_b324_2d15b7027d70.slice/crio-3dedd3ae2943d4bebf5e22df4adb4788c4697c8d2b3cc9de4f56389d749c60a0 WatchSource:0}: Error finding container 3dedd3ae2943d4bebf5e22df4adb4788c4697c8d2b3cc9de4f56389d749c60a0: Status 404 returned error can't find the container with id 3dedd3ae2943d4bebf5e22df4adb4788c4697c8d2b3cc9de4f56389d749c60a0 Jul 06 23:52:40.742329 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:40.742281 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" event={"ID":"23bc9d20-5564-4f8a-b324-2d15b7027d70","Type":"ContainerStarted","Data":"3dedd3ae2943d4bebf5e22df4adb4788c4697c8d2b3cc9de4f56389d749c60a0"} Jul 06 23:52:46.773231 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:46.773192 2584 generic.go:356] "Generic (PLEG): container finished" podID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerID="8a8a6b8b88b397095776feced3b49c245c2582209297d592ac18e578bcae3d2b" exitCode=0 Jul 06 23:52:46.773674 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:46.773283 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" event={"ID":"23bc9d20-5564-4f8a-b324-2d15b7027d70","Type":"ContainerDied","Data":"8a8a6b8b88b397095776feced3b49c245c2582209297d592ac18e578bcae3d2b"} Jul 06 23:52:49.787830 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:49.787795 2584 generic.go:356] "Generic (PLEG): container finished" podID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerID="68d6d5dfe55fbc3edea610c612defbef345805cce7f09812611101142e89ef38" exitCode=0 Jul 06 23:52:49.788250 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:49.787857 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" event={"ID":"23bc9d20-5564-4f8a-b324-2d15b7027d70","Type":"ContainerDied","Data":"68d6d5dfe55fbc3edea610c612defbef345805cce7f09812611101142e89ef38"} Jul 06 23:52:56.829147 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:56.829105 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" event={"ID":"23bc9d20-5564-4f8a-b324-2d15b7027d70","Type":"ContainerStarted","Data":"1bcb8795c4b80ec6f3defa5781fc45d8686493bc46483342feba3b4cae14f544"} Jul 06 23:52:56.849501 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:56.849452 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" podStartSLOduration=2.406477577 podStartE2EDuration="17.849434574s" totalImagesPullingTime="15.442956997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:52:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:52:56.848638624 +0000 UTC m=+234.640380380" watchObservedRunningTime="2026-07-06 23:52:56.849434574 +0000 UTC m=+234.641176313" Jul 06 23:52:57.835913 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:57.835878 2584 generic.go:356] "Generic (PLEG): container finished" podID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerID="1bcb8795c4b80ec6f3defa5781fc45d8686493bc46483342feba3b4cae14f544" exitCode=0 Jul 06 23:52:57.836305 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:57.835956 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" event={"ID":"23bc9d20-5564-4f8a-b324-2d15b7027d70","Type":"ContainerDied","Data":"1bcb8795c4b80ec6f3defa5781fc45d8686493bc46483342feba3b4cae14f544"} Jul 06 23:52:58.964953 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:58.964926 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:59.087691 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.087642 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbk69\" (UniqueName: \"kubernetes.io/projected/23bc9d20-5564-4f8a-b324-2d15b7027d70-kube-api-access-lbk69\") pod \"23bc9d20-5564-4f8a-b324-2d15b7027d70\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " Jul 06 23:52:59.087691 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.087692 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-util\") pod \"23bc9d20-5564-4f8a-b324-2d15b7027d70\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " Jul 06 23:52:59.087940 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.087761 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-bundle\") pod \"23bc9d20-5564-4f8a-b324-2d15b7027d70\" (UID: \"23bc9d20-5564-4f8a-b324-2d15b7027d70\") " Jul 06 23:52:59.088402 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.088368 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-bundle" (OuterVolumeSpecName: "bundle") pod "23bc9d20-5564-4f8a-b324-2d15b7027d70" (UID: "23bc9d20-5564-4f8a-b324-2d15b7027d70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:52:59.089950 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.089921 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23bc9d20-5564-4f8a-b324-2d15b7027d70-kube-api-access-lbk69" (OuterVolumeSpecName: "kube-api-access-lbk69") pod "23bc9d20-5564-4f8a-b324-2d15b7027d70" (UID: "23bc9d20-5564-4f8a-b324-2d15b7027d70"). InnerVolumeSpecName "kube-api-access-lbk69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:52:59.091689 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.091638 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-util" (OuterVolumeSpecName: "util") pod "23bc9d20-5564-4f8a-b324-2d15b7027d70" (UID: "23bc9d20-5564-4f8a-b324-2d15b7027d70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:52:59.188538 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.188501 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:59.188538 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.188534 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbk69\" (UniqueName: \"kubernetes.io/projected/23bc9d20-5564-4f8a-b324-2d15b7027d70-kube-api-access-lbk69\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:59.188538 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.188545 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23bc9d20-5564-4f8a-b324-2d15b7027d70-util\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:52:59.845802 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.845774 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" Jul 06 23:52:59.845802 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.845793 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kqppw" event={"ID":"23bc9d20-5564-4f8a-b324-2d15b7027d70","Type":"ContainerDied","Data":"3dedd3ae2943d4bebf5e22df4adb4788c4697c8d2b3cc9de4f56389d749c60a0"} Jul 06 23:52:59.846010 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:52:59.845833 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3dedd3ae2943d4bebf5e22df4adb4788c4697c8d2b3cc9de4f56389d749c60a0" Jul 06 23:53:08.421430 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.421394 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2"] Jul 06 23:53:08.421917 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.421720 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerName="extract" Jul 06 23:53:08.421917 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.421732 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerName="extract" Jul 06 23:53:08.421917 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.421741 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerName="util" Jul 06 23:53:08.421917 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.421746 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerName="util" Jul 06 23:53:08.421917 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.421755 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerName="pull" Jul 06 23:53:08.421917 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.421761 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerName="pull" Jul 06 23:53:08.421917 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.421811 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="23bc9d20-5564-4f8a-b324-2d15b7027d70" containerName="extract" Jul 06 23:53:08.426976 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.426958 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" Jul 06 23:53:08.429456 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.429425 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 23:53:08.429586 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.429527 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:53:08.429586 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.429578 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hpnsr\"" Jul 06 23:53:08.458317 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.458285 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce0699e4-1582-47f8-9a19-d3c764eebf6f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kgbs2\" (UID: \"ce0699e4-1582-47f8-9a19-d3c764eebf6f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" Jul 06 23:53:08.458473 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.458395 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbd5\" (UniqueName: \"kubernetes.io/projected/ce0699e4-1582-47f8-9a19-d3c764eebf6f-kube-api-access-mjbd5\") pod \"cert-manager-operator-controller-manager-55c444bf86-kgbs2\" (UID: \"ce0699e4-1582-47f8-9a19-d3c764eebf6f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" Jul 06 23:53:08.510193 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.510160 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2"] Jul 06 23:53:08.558890 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.558855 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbd5\" (UniqueName: \"kubernetes.io/projected/ce0699e4-1582-47f8-9a19-d3c764eebf6f-kube-api-access-mjbd5\") pod \"cert-manager-operator-controller-manager-55c444bf86-kgbs2\" (UID: \"ce0699e4-1582-47f8-9a19-d3c764eebf6f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" Jul 06 23:53:08.559067 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.558913 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce0699e4-1582-47f8-9a19-d3c764eebf6f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kgbs2\" (UID: \"ce0699e4-1582-47f8-9a19-d3c764eebf6f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" Jul 06 23:53:08.559272 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.559246 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce0699e4-1582-47f8-9a19-d3c764eebf6f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kgbs2\" (UID: \"ce0699e4-1582-47f8-9a19-d3c764eebf6f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" Jul 06 23:53:08.570107 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.570083 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbd5\" (UniqueName: \"kubernetes.io/projected/ce0699e4-1582-47f8-9a19-d3c764eebf6f-kube-api-access-mjbd5\") pod \"cert-manager-operator-controller-manager-55c444bf86-kgbs2\" (UID: \"ce0699e4-1582-47f8-9a19-d3c764eebf6f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" Jul 06 23:53:08.735859 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.735748 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" Jul 06 23:53:08.870336 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.870310 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2"] Jul 06 23:53:08.873104 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:53:08.873071 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0699e4_1582_47f8_9a19_d3c764eebf6f.slice/crio-ee6fc3c7c33460510afa5ddd34f4d765466a656bcb10f6646bafd58f88d9d46a WatchSource:0}: Error finding container ee6fc3c7c33460510afa5ddd34f4d765466a656bcb10f6646bafd58f88d9d46a: Status 404 returned error can't find the container with id ee6fc3c7c33460510afa5ddd34f4d765466a656bcb10f6646bafd58f88d9d46a Jul 06 23:53:08.883057 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:08.882996 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" event={"ID":"ce0699e4-1582-47f8-9a19-d3c764eebf6f","Type":"ContainerStarted","Data":"ee6fc3c7c33460510afa5ddd34f4d765466a656bcb10f6646bafd58f88d9d46a"} Jul 06 23:53:10.893545 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:10.893504 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" event={"ID":"ce0699e4-1582-47f8-9a19-d3c764eebf6f","Type":"ContainerStarted","Data":"80dd09b2579a7005c2a259b39b73947a8de7141a2aff5ea81e14d50837af592a"} Jul 06 23:53:10.918972 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:10.918915 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kgbs2" podStartSLOduration=1.335490334 podStartE2EDuration="2.918893575s" totalImagesPullingTime="1.583403241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:53:10.916751888 +0000 UTC m=+248.708493642" watchObservedRunningTime="2026-07-06 23:53:10.918893575 +0000 UTC m=+248.710635317" Jul 06 23:53:11.609066 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.609030 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt"] Jul 06 23:53:11.612741 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.612719 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.615276 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.615252 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:53:11.615913 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.615899 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nsbj9\"" Jul 06 23:53:11.616042 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.615935 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:53:11.631073 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.631043 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt"] Jul 06 23:53:11.688922 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.688885 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.689096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.689006 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.689096 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.689038 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hztfm\" (UniqueName: \"kubernetes.io/projected/452088f5-07c6-4d9a-8b05-7913c89ee9cd-kube-api-access-hztfm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.789733 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.789695 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.789887 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.789775 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.789887 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.789797 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hztfm\" (UniqueName: \"kubernetes.io/projected/452088f5-07c6-4d9a-8b05-7913c89ee9cd-kube-api-access-hztfm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.790100 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.790082 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.790142 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.790108 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.802792 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.802764 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hztfm\" (UniqueName: \"kubernetes.io/projected/452088f5-07c6-4d9a-8b05-7913c89ee9cd-kube-api-access-hztfm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.923042 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.923006 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:11.932384 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.932350 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dpknv"] Jul 06 23:53:11.935969 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.935949 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:11.938396 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.938370 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 23:53:11.938529 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.938383 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jgnk7\"" Jul 06 23:53:11.938828 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.938811 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 23:53:11.945809 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.945781 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dpknv"] Jul 06 23:53:11.991745 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.991586 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28db77d9-53cf-4f52-83a5-ac62cc15d21b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dpknv\" (UID: \"28db77d9-53cf-4f52-83a5-ac62cc15d21b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:11.991745 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:11.991643 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwmx9\" (UniqueName: \"kubernetes.io/projected/28db77d9-53cf-4f52-83a5-ac62cc15d21b-kube-api-access-kwmx9\") pod \"cert-manager-webhook-6486ffd997-dpknv\" (UID: \"28db77d9-53cf-4f52-83a5-ac62cc15d21b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:12.064753 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.064729 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt"] Jul 06 23:53:12.067118 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:53:12.067092 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452088f5_07c6_4d9a_8b05_7913c89ee9cd.slice/crio-27279281368cd3f4ec7a8d1cede2d9dab2329011f0a1439072347ae99fbf8569 WatchSource:0}: Error finding container 27279281368cd3f4ec7a8d1cede2d9dab2329011f0a1439072347ae99fbf8569: Status 404 returned error can't find the container with id 27279281368cd3f4ec7a8d1cede2d9dab2329011f0a1439072347ae99fbf8569 Jul 06 23:53:12.093093 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.093060 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28db77d9-53cf-4f52-83a5-ac62cc15d21b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dpknv\" (UID: \"28db77d9-53cf-4f52-83a5-ac62cc15d21b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:12.093242 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.093104 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwmx9\" (UniqueName: \"kubernetes.io/projected/28db77d9-53cf-4f52-83a5-ac62cc15d21b-kube-api-access-kwmx9\") pod \"cert-manager-webhook-6486ffd997-dpknv\" (UID: \"28db77d9-53cf-4f52-83a5-ac62cc15d21b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:12.101931 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.101898 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28db77d9-53cf-4f52-83a5-ac62cc15d21b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dpknv\" (UID: \"28db77d9-53cf-4f52-83a5-ac62cc15d21b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:12.102032 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.102004 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwmx9\" (UniqueName: \"kubernetes.io/projected/28db77d9-53cf-4f52-83a5-ac62cc15d21b-kube-api-access-kwmx9\") pod \"cert-manager-webhook-6486ffd997-dpknv\" (UID: \"28db77d9-53cf-4f52-83a5-ac62cc15d21b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:12.260663 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.260542 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:12.399886 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.396804 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dpknv"] Jul 06 23:53:12.903642 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.903587 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" event={"ID":"28db77d9-53cf-4f52-83a5-ac62cc15d21b","Type":"ContainerStarted","Data":"93c4bd96f3dc091232b7657a1a647f43568f1d32a0fa735d7a5896fae7513caf"} Jul 06 23:53:12.905098 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.905073 2584 generic.go:356] "Generic (PLEG): container finished" podID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerID="695e17754fe166177f7f18662eb357155754f60fe305e79307846a1d26c018ad" exitCode=0 Jul 06 23:53:12.905212 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.905102 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" event={"ID":"452088f5-07c6-4d9a-8b05-7913c89ee9cd","Type":"ContainerDied","Data":"695e17754fe166177f7f18662eb357155754f60fe305e79307846a1d26c018ad"} Jul 06 23:53:12.905212 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:12.905132 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" event={"ID":"452088f5-07c6-4d9a-8b05-7913c89ee9cd","Type":"ContainerStarted","Data":"27279281368cd3f4ec7a8d1cede2d9dab2329011f0a1439072347ae99fbf8569"} Jul 06 23:53:14.917472 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:14.917440 2584 generic.go:356] "Generic (PLEG): container finished" podID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerID="763cf4e83bcc573060050ca5fcbce3fe552b1ed6f9a7fbff24afe5da75444fba" exitCode=0 Jul 06 23:53:14.917911 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:14.917510 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" event={"ID":"452088f5-07c6-4d9a-8b05-7913c89ee9cd","Type":"ContainerDied","Data":"763cf4e83bcc573060050ca5fcbce3fe552b1ed6f9a7fbff24afe5da75444fba"} Jul 06 23:53:15.923753 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:15.923718 2584 generic.go:356] "Generic (PLEG): container finished" podID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerID="c763bcb217ca816e0e492cb798d1414a321b22c7631c5fb596486adb2c7b8be7" exitCode=0 Jul 06 23:53:15.924171 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:15.923812 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" event={"ID":"452088f5-07c6-4d9a-8b05-7913c89ee9cd","Type":"ContainerDied","Data":"c763bcb217ca816e0e492cb798d1414a321b22c7631c5fb596486adb2c7b8be7"} Jul 06 23:53:16.770482 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.770449 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9"] Jul 06 23:53:16.773910 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.773892 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" Jul 06 23:53:16.776273 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.776253 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pmh6s\"" Jul 06 23:53:16.780510 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.780484 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9"] Jul 06 23:53:16.835004 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.834963 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c15b550a-06b2-44d4-98f4-e8abf96c6ee2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kvsp9\" (UID: \"c15b550a-06b2-44d4-98f4-e8abf96c6ee2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" Jul 06 23:53:16.835190 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.835028 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4z4n\" (UniqueName: \"kubernetes.io/projected/c15b550a-06b2-44d4-98f4-e8abf96c6ee2-kube-api-access-h4z4n\") pod \"cert-manager-cainjector-559cdd8c87-kvsp9\" (UID: \"c15b550a-06b2-44d4-98f4-e8abf96c6ee2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" Jul 06 23:53:16.935697 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.935668 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c15b550a-06b2-44d4-98f4-e8abf96c6ee2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kvsp9\" (UID: \"c15b550a-06b2-44d4-98f4-e8abf96c6ee2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" Jul 06 23:53:16.936026 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.935717 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4z4n\" (UniqueName: \"kubernetes.io/projected/c15b550a-06b2-44d4-98f4-e8abf96c6ee2-kube-api-access-h4z4n\") pod \"cert-manager-cainjector-559cdd8c87-kvsp9\" (UID: \"c15b550a-06b2-44d4-98f4-e8abf96c6ee2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" Jul 06 23:53:16.945241 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.945211 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c15b550a-06b2-44d4-98f4-e8abf96c6ee2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kvsp9\" (UID: \"c15b550a-06b2-44d4-98f4-e8abf96c6ee2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" Jul 06 23:53:16.945402 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:16.945388 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4z4n\" (UniqueName: \"kubernetes.io/projected/c15b550a-06b2-44d4-98f4-e8abf96c6ee2-kube-api-access-h4z4n\") pod \"cert-manager-cainjector-559cdd8c87-kvsp9\" (UID: \"c15b550a-06b2-44d4-98f4-e8abf96c6ee2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" Jul 06 23:53:17.063324 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.063295 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:17.083898 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.083859 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" Jul 06 23:53:17.137398 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.137369 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-util\") pod \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " Jul 06 23:53:17.137535 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.137405 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hztfm\" (UniqueName: \"kubernetes.io/projected/452088f5-07c6-4d9a-8b05-7913c89ee9cd-kube-api-access-hztfm\") pod \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " Jul 06 23:53:17.137535 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.137459 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-bundle\") pod \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\" (UID: \"452088f5-07c6-4d9a-8b05-7913c89ee9cd\") " Jul 06 23:53:17.137983 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.137930 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-bundle" (OuterVolumeSpecName: "bundle") pod "452088f5-07c6-4d9a-8b05-7913c89ee9cd" (UID: "452088f5-07c6-4d9a-8b05-7913c89ee9cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:53:17.140290 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.140254 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452088f5-07c6-4d9a-8b05-7913c89ee9cd-kube-api-access-hztfm" (OuterVolumeSpecName: "kube-api-access-hztfm") pod "452088f5-07c6-4d9a-8b05-7913c89ee9cd" (UID: "452088f5-07c6-4d9a-8b05-7913c89ee9cd"). InnerVolumeSpecName "kube-api-access-hztfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:53:17.143965 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.143930 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-util" (OuterVolumeSpecName: "util") pod "452088f5-07c6-4d9a-8b05-7913c89ee9cd" (UID: "452088f5-07c6-4d9a-8b05-7913c89ee9cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:53:17.223358 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.223330 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9"] Jul 06 23:53:17.225616 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:53:17.225577 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc15b550a_06b2_44d4_98f4_e8abf96c6ee2.slice/crio-7235cc21ca2e432024d98941de85452db92d5c2e6df4c31309872ce30e6544c4 WatchSource:0}: Error finding container 7235cc21ca2e432024d98941de85452db92d5c2e6df4c31309872ce30e6544c4: Status 404 returned error can't find the container with id 7235cc21ca2e432024d98941de85452db92d5c2e6df4c31309872ce30e6544c4 Jul 06 23:53:17.238283 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.238257 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-util\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:53:17.238283 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.238283 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hztfm\" (UniqueName: \"kubernetes.io/projected/452088f5-07c6-4d9a-8b05-7913c89ee9cd-kube-api-access-hztfm\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:53:17.238433 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.238293 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452088f5-07c6-4d9a-8b05-7913c89ee9cd-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:53:17.934868 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.934831 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" event={"ID":"c15b550a-06b2-44d4-98f4-e8abf96c6ee2","Type":"ContainerStarted","Data":"7235cc21ca2e432024d98941de85452db92d5c2e6df4c31309872ce30e6544c4"} Jul 06 23:53:17.936654 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.936626 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" event={"ID":"452088f5-07c6-4d9a-8b05-7913c89ee9cd","Type":"ContainerDied","Data":"27279281368cd3f4ec7a8d1cede2d9dab2329011f0a1439072347ae99fbf8569"} Jul 06 23:53:17.936972 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.936662 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bhdt" Jul 06 23:53:17.936972 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:17.936673 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27279281368cd3f4ec7a8d1cede2d9dab2329011f0a1439072347ae99fbf8569" Jul 06 23:53:20.954619 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:20.954560 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" event={"ID":"c15b550a-06b2-44d4-98f4-e8abf96c6ee2","Type":"ContainerStarted","Data":"eafbeafc156db3a0907188db03c6763aad47535fbb26e188ac6c41722a443338"} Jul 06 23:53:20.970786 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:20.970689 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvsp9" podStartSLOduration=1.489778201 podStartE2EDuration="4.970670683s" totalImagesPullingTime="3.480892482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:53:20.969108843 +0000 UTC m=+258.760850585" watchObservedRunningTime="2026-07-06 23:53:20.970670683 +0000 UTC m=+258.762412421" Jul 06 23:53:23.970189 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:23.970081 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" event={"ID":"28db77d9-53cf-4f52-83a5-ac62cc15d21b","Type":"ContainerStarted","Data":"294ca79f052f42b2bc05580cf3af0b63f153557bcc1b087b48bf6005cae4d645"} Jul 06 23:53:23.970189 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:23.970155 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:23.988885 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:23.988821 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" podStartSLOduration=1.767341665 podStartE2EDuration="12.988805434s" totalImagesPullingTime="11.221463769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:53:23.987770443 +0000 UTC m=+261.779512180" watchObservedRunningTime="2026-07-06 23:53:23.988805434 +0000 UTC m=+261.780547173" Jul 06 23:53:29.977031 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:29.976989 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dpknv" Jul 06 23:53:30.870784 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.870748 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j"] Jul 06 23:53:30.871073 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.871061 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerName="extract" Jul 06 23:53:30.871117 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.871075 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerName="extract" Jul 06 23:53:30.871117 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.871091 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerName="pull" Jul 06 23:53:30.871117 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.871097 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerName="pull" Jul 06 23:53:30.871117 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.871111 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerName="util" Jul 06 23:53:30.871117 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.871116 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerName="util" Jul 06 23:53:30.871266 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.871178 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="452088f5-07c6-4d9a-8b05-7913c89ee9cd" containerName="extract" Jul 06 23:53:30.873304 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.873287 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:30.875329 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.875307 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:53:30.876013 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.875993 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:53:30.876129 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.875998 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nsbj9\"" Jul 06 23:53:30.881466 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.881444 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j"] Jul 06 23:53:30.959967 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.959920 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:30.959967 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.959964 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:30.960183 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:30.960049 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzjp8\" (UniqueName: \"kubernetes.io/projected/55c5f7af-0f6a-40fd-8e68-3d58d4342465-kube-api-access-fzjp8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:31.060822 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:31.060785 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:31.060822 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:31.060823 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:31.061229 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:31.060966 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzjp8\" (UniqueName: \"kubernetes.io/projected/55c5f7af-0f6a-40fd-8e68-3d58d4342465-kube-api-access-fzjp8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:31.061229 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:31.061150 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:31.061229 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:31.061177 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:31.073028 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:31.072999 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzjp8\" (UniqueName: \"kubernetes.io/projected/55c5f7af-0f6a-40fd-8e68-3d58d4342465-kube-api-access-fzjp8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:31.184043 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:31.183951 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:31.319309 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:31.319231 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j"] Jul 06 23:53:31.323687 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:53:31.323588 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c5f7af_0f6a_40fd_8e68_3d58d4342465.slice/crio-d4fd65381162cd79ef6cb9c4d29d73c37117152cd741cbbac21f86c12f27f2ef WatchSource:0}: Error finding container d4fd65381162cd79ef6cb9c4d29d73c37117152cd741cbbac21f86c12f27f2ef: Status 404 returned error can't find the container with id d4fd65381162cd79ef6cb9c4d29d73c37117152cd741cbbac21f86c12f27f2ef Jul 06 23:53:32.007673 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:32.007636 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerID="644a8591ed17046ded45a122d9459faef09c4920e843920433ba85fed7e3756f" exitCode=0 Jul 06 23:53:32.007835 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:32.007719 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" event={"ID":"55c5f7af-0f6a-40fd-8e68-3d58d4342465","Type":"ContainerDied","Data":"644a8591ed17046ded45a122d9459faef09c4920e843920433ba85fed7e3756f"} Jul 06 23:53:32.007835 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:32.007777 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" event={"ID":"55c5f7af-0f6a-40fd-8e68-3d58d4342465","Type":"ContainerStarted","Data":"d4fd65381162cd79ef6cb9c4d29d73c37117152cd741cbbac21f86c12f27f2ef"} Jul 06 23:53:33.014520 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:33.014423 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerID="9362fbb63a399871bbeaf03248c7ab1094cc955b147ccf5479e49d7d93323908" exitCode=0 Jul 06 23:53:33.014520 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:33.014487 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" event={"ID":"55c5f7af-0f6a-40fd-8e68-3d58d4342465","Type":"ContainerDied","Data":"9362fbb63a399871bbeaf03248c7ab1094cc955b147ccf5479e49d7d93323908"} Jul 06 23:53:34.021130 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:34.021094 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerID="92e9357545b1375fd7c6b2fe5bd87c9678284b5f0c7b604bd582d60bd735d7bc" exitCode=0 Jul 06 23:53:34.021511 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:34.021182 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" event={"ID":"55c5f7af-0f6a-40fd-8e68-3d58d4342465","Type":"ContainerDied","Data":"92e9357545b1375fd7c6b2fe5bd87c9678284b5f0c7b604bd582d60bd735d7bc"} Jul 06 23:53:35.160251 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.160223 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:35.296811 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.296720 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzjp8\" (UniqueName: \"kubernetes.io/projected/55c5f7af-0f6a-40fd-8e68-3d58d4342465-kube-api-access-fzjp8\") pod \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " Jul 06 23:53:35.296811 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.296766 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-util\") pod \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " Jul 06 23:53:35.296811 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.296792 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-bundle\") pod \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\" (UID: \"55c5f7af-0f6a-40fd-8e68-3d58d4342465\") " Jul 06 23:53:35.297593 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.297485 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-bundle" (OuterVolumeSpecName: "bundle") pod "55c5f7af-0f6a-40fd-8e68-3d58d4342465" (UID: "55c5f7af-0f6a-40fd-8e68-3d58d4342465"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:53:35.298997 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.298971 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c5f7af-0f6a-40fd-8e68-3d58d4342465-kube-api-access-fzjp8" (OuterVolumeSpecName: "kube-api-access-fzjp8") pod "55c5f7af-0f6a-40fd-8e68-3d58d4342465" (UID: "55c5f7af-0f6a-40fd-8e68-3d58d4342465"). InnerVolumeSpecName "kube-api-access-fzjp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:53:35.305375 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.305348 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-util" (OuterVolumeSpecName: "util") pod "55c5f7af-0f6a-40fd-8e68-3d58d4342465" (UID: "55c5f7af-0f6a-40fd-8e68-3d58d4342465"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:53:35.397554 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.397511 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzjp8\" (UniqueName: \"kubernetes.io/projected/55c5f7af-0f6a-40fd-8e68-3d58d4342465-kube-api-access-fzjp8\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:53:35.397554 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.397545 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-util\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:53:35.397554 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:35.397555 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55c5f7af-0f6a-40fd-8e68-3d58d4342465-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:53:36.032622 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:36.032583 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" Jul 06 23:53:36.032801 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:36.032624 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8jn9j" event={"ID":"55c5f7af-0f6a-40fd-8e68-3d58d4342465","Type":"ContainerDied","Data":"d4fd65381162cd79ef6cb9c4d29d73c37117152cd741cbbac21f86c12f27f2ef"} Jul 06 23:53:36.032801 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:36.032677 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4fd65381162cd79ef6cb9c4d29d73c37117152cd741cbbac21f86c12f27f2ef" Jul 06 23:53:48.346215 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.346173 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj"] Jul 06 23:53:48.346755 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.346643 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerName="util" Jul 06 23:53:48.346755 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.346663 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerName="util" Jul 06 23:53:48.346755 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.346684 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerName="pull" Jul 06 23:53:48.346755 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.346693 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerName="pull" Jul 06 23:53:48.346755 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.346716 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerName="extract" Jul 06 23:53:48.346755 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.346722 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerName="extract" Jul 06 23:53:48.347024 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.346785 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c5f7af-0f6a-40fd-8e68-3d58d4342465" containerName="extract" Jul 06 23:53:48.352162 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.352144 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.355370 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.355352 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 23:53:48.355757 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.355740 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 23:53:48.355857 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.355760 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 23:53:48.355857 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.355761 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 23:53:48.355857 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.355812 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8sfwg\"" Jul 06 23:53:48.370060 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.370012 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj"] Jul 06 23:53:48.507209 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.507155 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92451211-1b70-4a64-b9d4-12bfb1689f4c-tmp\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.507677 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.507276 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92451211-1b70-4a64-b9d4-12bfb1689f4c-manifests\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.507677 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.507329 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92451211-1b70-4a64-b9d4-12bfb1689f4c-webhook-cert\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.507677 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.507444 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92451211-1b70-4a64-b9d4-12bfb1689f4c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.507677 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.507491 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57854\" (UniqueName: \"kubernetes.io/projected/92451211-1b70-4a64-b9d4-12bfb1689f4c-kube-api-access-57854\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.608998 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.608897 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92451211-1b70-4a64-b9d4-12bfb1689f4c-manifests\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.608998 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.608937 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92451211-1b70-4a64-b9d4-12bfb1689f4c-webhook-cert\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.608998 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.608982 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92451211-1b70-4a64-b9d4-12bfb1689f4c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.609275 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.609006 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57854\" (UniqueName: \"kubernetes.io/projected/92451211-1b70-4a64-b9d4-12bfb1689f4c-kube-api-access-57854\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.609275 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.609079 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92451211-1b70-4a64-b9d4-12bfb1689f4c-tmp\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.609410 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.609382 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92451211-1b70-4a64-b9d4-12bfb1689f4c-manifests\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.611562 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.611535 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92451211-1b70-4a64-b9d4-12bfb1689f4c-tmp\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.611884 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.611863 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92451211-1b70-4a64-b9d4-12bfb1689f4c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.611967 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.611923 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92451211-1b70-4a64-b9d4-12bfb1689f4c-webhook-cert\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.622893 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.622862 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57854\" (UniqueName: \"kubernetes.io/projected/92451211-1b70-4a64-b9d4-12bfb1689f4c-kube-api-access-57854\") pod \"opendatahub-operator-controller-manager-64648fd55c-xcxnj\" (UID: \"92451211-1b70-4a64-b9d4-12bfb1689f4c\") " pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.669818 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.669774 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:48.828444 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:48.828418 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj"] Jul 06 23:53:48.830521 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:53:48.830496 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92451211_1b70_4a64_b9d4_12bfb1689f4c.slice/crio-babd1b657c3bfc0e430895ac2aca5c2eb34466e39f63626b339bc14439444795 WatchSource:0}: Error finding container babd1b657c3bfc0e430895ac2aca5c2eb34466e39f63626b339bc14439444795: Status 404 returned error can't find the container with id babd1b657c3bfc0e430895ac2aca5c2eb34466e39f63626b339bc14439444795 Jul 06 23:53:49.092181 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:49.092132 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" event={"ID":"92451211-1b70-4a64-b9d4-12bfb1689f4c","Type":"ContainerStarted","Data":"babd1b657c3bfc0e430895ac2aca5c2eb34466e39f63626b339bc14439444795"} Jul 06 23:53:52.110325 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:52.110229 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" event={"ID":"92451211-1b70-4a64-b9d4-12bfb1689f4c","Type":"ContainerStarted","Data":"74814e866ce39a89870cd26b0a5f8d9d980702fac9d6e6c6f6f2bfe405205ce8"} Jul 06 23:53:53.116892 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:53.116855 2584 generic.go:356] "Generic (PLEG): container finished" podID="92451211-1b70-4a64-b9d4-12bfb1689f4c" containerID="74814e866ce39a89870cd26b0a5f8d9d980702fac9d6e6c6f6f2bfe405205ce8" exitCode=0 Jul 06 23:53:53.117273 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:53.116928 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" event={"ID":"92451211-1b70-4a64-b9d4-12bfb1689f4c","Type":"ContainerDied","Data":"74814e866ce39a89870cd26b0a5f8d9d980702fac9d6e6c6f6f2bfe405205ce8"} Jul 06 23:53:54.124033 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:54.123989 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" event={"ID":"92451211-1b70-4a64-b9d4-12bfb1689f4c","Type":"ContainerStarted","Data":"e1f81b83abc97829d2260d0f89f666d56920d784de2b16f79d15fb66697d1d77"} Jul 06 23:53:54.124512 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:54.124096 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:53:54.147386 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:53:54.147327 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" podStartSLOduration=1.916672095 podStartE2EDuration="6.147310035s" totalImagesPullingTime="3.189573076s" totalInitContainerRuntime="1.041064864s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:53:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:53:54.145891322 +0000 UTC m=+291.937633076" watchObservedRunningTime="2026-07-06 23:53:54.147310035 +0000 UTC m=+291.939051773" Jul 06 23:54:02.585345 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:02.585313 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 23:54:05.131881 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:05.131849 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64648fd55c-xcxnj" Jul 06 23:54:07.599767 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.599730 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz"] Jul 06 23:54:07.603174 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.603154 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.606055 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.606032 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 23:54:07.606570 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.606554 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 23:54:07.606570 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.606568 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 23:54:07.606768 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.606576 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 23:54:07.617845 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.617818 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz"] Jul 06 23:54:07.671583 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.671547 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5acefd7c-4b5e-454a-a19b-774c3a2e6060-tls-certs\") pod \"kube-auth-proxy-5c55d5ff9-krvcz\" (UID: \"5acefd7c-4b5e-454a-a19b-774c3a2e6060\") " pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.671779 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.671595 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5acefd7c-4b5e-454a-a19b-774c3a2e6060-tmp\") pod \"kube-auth-proxy-5c55d5ff9-krvcz\" (UID: \"5acefd7c-4b5e-454a-a19b-774c3a2e6060\") " pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.671779 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.671645 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fzh2\" (UniqueName: \"kubernetes.io/projected/5acefd7c-4b5e-454a-a19b-774c3a2e6060-kube-api-access-7fzh2\") pod \"kube-auth-proxy-5c55d5ff9-krvcz\" (UID: \"5acefd7c-4b5e-454a-a19b-774c3a2e6060\") " pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.772681 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.772641 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5acefd7c-4b5e-454a-a19b-774c3a2e6060-tmp\") pod \"kube-auth-proxy-5c55d5ff9-krvcz\" (UID: \"5acefd7c-4b5e-454a-a19b-774c3a2e6060\") " pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.772681 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.772686 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fzh2\" (UniqueName: \"kubernetes.io/projected/5acefd7c-4b5e-454a-a19b-774c3a2e6060-kube-api-access-7fzh2\") pod \"kube-auth-proxy-5c55d5ff9-krvcz\" (UID: \"5acefd7c-4b5e-454a-a19b-774c3a2e6060\") " pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.772955 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.772779 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5acefd7c-4b5e-454a-a19b-774c3a2e6060-tls-certs\") pod \"kube-auth-proxy-5c55d5ff9-krvcz\" (UID: \"5acefd7c-4b5e-454a-a19b-774c3a2e6060\") " pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.775157 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.775128 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5acefd7c-4b5e-454a-a19b-774c3a2e6060-tmp\") pod \"kube-auth-proxy-5c55d5ff9-krvcz\" (UID: \"5acefd7c-4b5e-454a-a19b-774c3a2e6060\") " pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.775379 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.775359 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5acefd7c-4b5e-454a-a19b-774c3a2e6060-tls-certs\") pod \"kube-auth-proxy-5c55d5ff9-krvcz\" (UID: \"5acefd7c-4b5e-454a-a19b-774c3a2e6060\") " pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.794174 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.794144 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fzh2\" (UniqueName: \"kubernetes.io/projected/5acefd7c-4b5e-454a-a19b-774c3a2e6060-kube-api-access-7fzh2\") pod \"kube-auth-proxy-5c55d5ff9-krvcz\" (UID: \"5acefd7c-4b5e-454a-a19b-774c3a2e6060\") " pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:07.913348 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:07.913314 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" Jul 06 23:54:08.069564 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.069538 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fvz8r"] Jul 06 23:54:08.071683 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:54:08.071654 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5acefd7c_4b5e_454a_a19b_774c3a2e6060.slice/crio-26ab2fcab73a895c60d4227547a39737a453d789a4e29dab61a3916a5367d722 WatchSource:0}: Error finding container 26ab2fcab73a895c60d4227547a39737a453d789a4e29dab61a3916a5367d722: Status 404 returned error can't find the container with id 26ab2fcab73a895c60d4227547a39737a453d789a4e29dab61a3916a5367d722 Jul 06 23:54:08.073796 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.073780 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:54:08.074517 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.074497 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz"] Jul 06 23:54:08.074657 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.074640 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:08.079748 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.079724 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-skrgt\"" Jul 06 23:54:08.084136 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.084117 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 06 23:54:08.101128 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.101092 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fvz8r"] Jul 06 23:54:08.175542 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.175447 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62cl8\" (UniqueName: \"kubernetes.io/projected/4fb5d1d4-cf5a-48f1-904e-53badd88f9d7-kube-api-access-62cl8\") pod \"odh-model-controller-7998c67dc4-fvz8r\" (UID: \"4fb5d1d4-cf5a-48f1-904e-53badd88f9d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:08.175861 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.175839 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb5d1d4-cf5a-48f1-904e-53badd88f9d7-cert\") pod \"odh-model-controller-7998c67dc4-fvz8r\" (UID: \"4fb5d1d4-cf5a-48f1-904e-53badd88f9d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:08.191492 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.191451 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" event={"ID":"5acefd7c-4b5e-454a-a19b-774c3a2e6060","Type":"ContainerStarted","Data":"26ab2fcab73a895c60d4227547a39737a453d789a4e29dab61a3916a5367d722"} Jul 06 23:54:08.276822 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.276787 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62cl8\" (UniqueName: \"kubernetes.io/projected/4fb5d1d4-cf5a-48f1-904e-53badd88f9d7-kube-api-access-62cl8\") pod \"odh-model-controller-7998c67dc4-fvz8r\" (UID: \"4fb5d1d4-cf5a-48f1-904e-53badd88f9d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:08.276986 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.276853 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb5d1d4-cf5a-48f1-904e-53badd88f9d7-cert\") pod \"odh-model-controller-7998c67dc4-fvz8r\" (UID: \"4fb5d1d4-cf5a-48f1-904e-53badd88f9d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:08.276986 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:54:08.276965 2584 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 23:54:08.277062 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:54:08.277034 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fb5d1d4-cf5a-48f1-904e-53badd88f9d7-cert podName:4fb5d1d4-cf5a-48f1-904e-53badd88f9d7 nodeName:}" failed. No retries permitted until 2026-07-06 23:54:08.777016349 +0000 UTC m=+306.568758065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4fb5d1d4-cf5a-48f1-904e-53badd88f9d7-cert") pod "odh-model-controller-7998c67dc4-fvz8r" (UID: "4fb5d1d4-cf5a-48f1-904e-53badd88f9d7") : secret "odh-model-controller-webhook-cert" not found Jul 06 23:54:08.290928 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.290898 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62cl8\" (UniqueName: \"kubernetes.io/projected/4fb5d1d4-cf5a-48f1-904e-53badd88f9d7-kube-api-access-62cl8\") pod \"odh-model-controller-7998c67dc4-fvz8r\" (UID: \"4fb5d1d4-cf5a-48f1-904e-53badd88f9d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:08.781343 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.781298 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb5d1d4-cf5a-48f1-904e-53badd88f9d7-cert\") pod \"odh-model-controller-7998c67dc4-fvz8r\" (UID: \"4fb5d1d4-cf5a-48f1-904e-53badd88f9d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:08.784534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.784500 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb5d1d4-cf5a-48f1-904e-53badd88f9d7-cert\") pod \"odh-model-controller-7998c67dc4-fvz8r\" (UID: \"4fb5d1d4-cf5a-48f1-904e-53badd88f9d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:08.903683 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.903639 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vs6jp"] Jul 06 23:54:08.907662 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.907634 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:08.910559 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.910523 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 23:54:08.929588 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.929557 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vs6jp"] Jul 06 23:54:08.983773 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.983730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c60e73f-1335-4e3d-90cf-b0603a2a3cbc-tls-certs\") pod \"model-serving-api-54d89bd5fc-vs6jp\" (UID: \"6c60e73f-1335-4e3d-90cf-b0603a2a3cbc\") " pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:08.983966 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.983848 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-798mk\" (UniqueName: \"kubernetes.io/projected/6c60e73f-1335-4e3d-90cf-b0603a2a3cbc-kube-api-access-798mk\") pod \"model-serving-api-54d89bd5fc-vs6jp\" (UID: \"6c60e73f-1335-4e3d-90cf-b0603a2a3cbc\") " pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:08.986901 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:08.986537 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:09.084883 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.084849 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c60e73f-1335-4e3d-90cf-b0603a2a3cbc-tls-certs\") pod \"model-serving-api-54d89bd5fc-vs6jp\" (UID: \"6c60e73f-1335-4e3d-90cf-b0603a2a3cbc\") " pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:09.085075 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.084934 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-798mk\" (UniqueName: \"kubernetes.io/projected/6c60e73f-1335-4e3d-90cf-b0603a2a3cbc-kube-api-access-798mk\") pod \"model-serving-api-54d89bd5fc-vs6jp\" (UID: \"6c60e73f-1335-4e3d-90cf-b0603a2a3cbc\") " pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:09.085075 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:54:09.085010 2584 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 06 23:54:09.085191 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:54:09.085091 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c60e73f-1335-4e3d-90cf-b0603a2a3cbc-tls-certs podName:6c60e73f-1335-4e3d-90cf-b0603a2a3cbc nodeName:}" failed. No retries permitted until 2026-07-06 23:54:09.585069275 +0000 UTC m=+307.376810998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6c60e73f-1335-4e3d-90cf-b0603a2a3cbc-tls-certs") pod "model-serving-api-54d89bd5fc-vs6jp" (UID: "6c60e73f-1335-4e3d-90cf-b0603a2a3cbc") : secret "model-serving-api-tls" not found Jul 06 23:54:09.097057 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.096750 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-798mk\" (UniqueName: \"kubernetes.io/projected/6c60e73f-1335-4e3d-90cf-b0603a2a3cbc-kube-api-access-798mk\") pod \"model-serving-api-54d89bd5fc-vs6jp\" (UID: \"6c60e73f-1335-4e3d-90cf-b0603a2a3cbc\") " pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:09.161199 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.161173 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fvz8r"] Jul 06 23:54:09.163130 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:54:09.163103 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb5d1d4_cf5a_48f1_904e_53badd88f9d7.slice/crio-6689fb22af41dd4ee73de679d80b06c4ccd4c745f2bb8394f907e2b6679ad6b7 WatchSource:0}: Error finding container 6689fb22af41dd4ee73de679d80b06c4ccd4c745f2bb8394f907e2b6679ad6b7: Status 404 returned error can't find the container with id 6689fb22af41dd4ee73de679d80b06c4ccd4c745f2bb8394f907e2b6679ad6b7 Jul 06 23:54:09.198776 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.198740 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" event={"ID":"4fb5d1d4-cf5a-48f1-904e-53badd88f9d7","Type":"ContainerStarted","Data":"6689fb22af41dd4ee73de679d80b06c4ccd4c745f2bb8394f907e2b6679ad6b7"} Jul 06 23:54:09.229473 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.229434 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb"] Jul 06 23:54:09.234569 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.234543 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.237048 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.236951 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 23:54:09.237048 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.236980 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 23:54:09.237048 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.237004 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 23:54:09.237302 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.236951 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 23:54:09.237373 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.237346 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fd9n7\"" Jul 06 23:54:09.247875 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.247850 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb"] Jul 06 23:54:09.287059 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.287020 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.287059 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.287065 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tkzn\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-kube-api-access-8tkzn\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.287317 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.287102 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-cacerts\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.287317 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.287176 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-istio-token\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.287317 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.287235 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.287317 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.287271 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.287317 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.287300 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/874962cc-8b61-4346-a115-07aefe0ca440-local-certs\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.388121 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.388081 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.388313 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.388136 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.388313 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.388170 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/874962cc-8b61-4346-a115-07aefe0ca440-local-certs\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.388313 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.388248 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.388313 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.388286 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tkzn\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-kube-api-access-8tkzn\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.388534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.388327 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-cacerts\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.388534 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.388376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-istio-token\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.388869 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.388847 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.391064 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.391039 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/874962cc-8b61-4346-a115-07aefe0ca440-local-certs\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.391572 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.391547 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-cacerts\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.391795 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.391775 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.392055 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.392031 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.396183 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.396159 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-istio-token\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.396774 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.396749 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tkzn\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-kube-api-access-8tkzn\") pod \"istiod-openshift-gateway-7574459656-dmrmb\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.547927 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.547885 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:09.590979 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.590897 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c60e73f-1335-4e3d-90cf-b0603a2a3cbc-tls-certs\") pod \"model-serving-api-54d89bd5fc-vs6jp\" (UID: \"6c60e73f-1335-4e3d-90cf-b0603a2a3cbc\") " pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:09.594626 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.594566 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c60e73f-1335-4e3d-90cf-b0603a2a3cbc-tls-certs\") pod \"model-serving-api-54d89bd5fc-vs6jp\" (UID: \"6c60e73f-1335-4e3d-90cf-b0603a2a3cbc\") " pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:09.725242 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.725208 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb"] Jul 06 23:54:09.727992 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:54:09.727958 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod874962cc_8b61_4346_a115_07aefe0ca440.slice/crio-ecc1ebb88d37d1b1c99b40cfbb7e75c93d0198bed7c6061281a948d950a13a41 WatchSource:0}: Error finding container ecc1ebb88d37d1b1c99b40cfbb7e75c93d0198bed7c6061281a948d950a13a41: Status 404 returned error can't find the container with id ecc1ebb88d37d1b1c99b40cfbb7e75c93d0198bed7c6061281a948d950a13a41 Jul 06 23:54:09.821373 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:09.821295 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:10.206685 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:10.206583 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" event={"ID":"874962cc-8b61-4346-a115-07aefe0ca440","Type":"ContainerStarted","Data":"ecc1ebb88d37d1b1c99b40cfbb7e75c93d0198bed7c6061281a948d950a13a41"} Jul 06 23:54:10.809048 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:10.808868 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vs6jp"] Jul 06 23:54:11.214277 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:11.214189 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" event={"ID":"5acefd7c-4b5e-454a-a19b-774c3a2e6060","Type":"ContainerStarted","Data":"1ba2f04b8ec4770e547883cbe98c0570701277c22c5982d65e11d4bc2240f859"} Jul 06 23:54:11.229715 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:11.229636 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c55d5ff9-krvcz" podStartSLOduration=1.608310103 podStartE2EDuration="4.22959237s" totalImagesPullingTime="2.621282267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:54:11.229040007 +0000 UTC m=+309.020781767" watchObservedRunningTime="2026-07-06 23:54:11.22959237 +0000 UTC m=+309.021334109" Jul 06 23:54:11.649296 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:54:11.649256 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c60e73f_1335_4e3d_90cf_b0603a2a3cbc.slice/crio-e0ecb2556e5b0d3a99b2c0a00b068e702576e13e46a702e701af1fa6ea769a50 WatchSource:0}: Error finding container e0ecb2556e5b0d3a99b2c0a00b068e702576e13e46a702e701af1fa6ea769a50: Status 404 returned error can't find the container with id e0ecb2556e5b0d3a99b2c0a00b068e702576e13e46a702e701af1fa6ea769a50 Jul 06 23:54:12.221549 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:12.221508 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" event={"ID":"6c60e73f-1335-4e3d-90cf-b0603a2a3cbc","Type":"ContainerStarted","Data":"e0ecb2556e5b0d3a99b2c0a00b068e702576e13e46a702e701af1fa6ea769a50"} Jul 06 23:54:13.729820 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:13.729773 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 06 23:54:13.730146 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:13.729852 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 06 23:54:14.235498 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.235451 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" event={"ID":"874962cc-8b61-4346-a115-07aefe0ca440","Type":"ContainerStarted","Data":"a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6"} Jul 06 23:54:14.235728 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.235644 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:14.237225 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.237201 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" event={"ID":"6c60e73f-1335-4e3d-90cf-b0603a2a3cbc","Type":"ContainerStarted","Data":"f7dc155776604a2d6712d6ca589856ee3057a5547c5b4acb27dd8ccf8bc8c435"} Jul 06 23:54:14.237369 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.237273 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:14.237830 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.237805 2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-dmrmb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 23:54:14.237926 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.237857 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" podUID="874962cc-8b61-4346-a115-07aefe0ca440" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 23:54:14.238792 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.238771 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" event={"ID":"4fb5d1d4-cf5a-48f1-904e-53badd88f9d7","Type":"ContainerStarted","Data":"8215c7360fbcba4a1c2504db7445f83474b65ace50714f2e49d247aa6775fd4e"} Jul 06 23:54:14.238933 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.238912 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:14.314053 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.313991 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" podStartSLOduration=2.1411805 podStartE2EDuration="6.313969525s" totalImagesPullingTime="4.172789025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:54:14.313786185 +0000 UTC m=+312.105527943" watchObservedRunningTime="2026-07-06 23:54:14.313969525 +0000 UTC m=+312.105711264" Jul 06 23:54:14.315080 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.315031 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" podStartSLOduration=1.315842427 podStartE2EDuration="5.315017614s" totalImagesPullingTime="3.999175187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:54:14.284493106 +0000 UTC m=+312.076234866" watchObservedRunningTime="2026-07-06 23:54:14.315017614 +0000 UTC m=+312.106759330" Jul 06 23:54:14.332522 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:14.332453 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" podStartSLOduration=4.210679467 podStartE2EDuration="6.332435605s" totalImagesPullingTime="2.121756138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:54:14.330855431 +0000 UTC m=+312.122597196" watchObservedRunningTime="2026-07-06 23:54:14.332435605 +0000 UTC m=+312.124177343" Jul 06 23:54:15.244172 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:15.244144 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:17.403484 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.403445 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f447c9d54-nddws"] Jul 06 23:54:17.407079 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.407063 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.414732 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.414692 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wkzmh\"" Jul 06 23:54:17.414859 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.414801 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:54:17.414980 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.414941 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 23:54:17.415089 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.415035 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 23:54:17.416358 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.416332 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 23:54:17.418455 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.418436 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 23:54:17.434933 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.434893 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f447c9d54-nddws"] Jul 06 23:54:17.463879 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.463836 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-manager-config\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.463879 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.463882 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-metrics-cert\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.464116 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.463909 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghmw\" (UniqueName: \"kubernetes.io/projected/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-kube-api-access-gghmw\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.464116 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.463970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-cert\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.565080 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.565045 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-manager-config\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.565080 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.565085 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-metrics-cert\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.565292 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.565110 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gghmw\" (UniqueName: \"kubernetes.io/projected/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-kube-api-access-gghmw\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.565292 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.565144 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-cert\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.565951 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.565888 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-manager-config\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.567835 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.567813 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-cert\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.567835 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.567824 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-metrics-cert\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.578535 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.578513 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghmw\" (UniqueName: \"kubernetes.io/projected/ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb-kube-api-access-gghmw\") pod \"lws-controller-manager-f447c9d54-nddws\" (UID: \"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb\") " pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.717171 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.717083 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:17.889954 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:17.889923 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f447c9d54-nddws"] Jul 06 23:54:17.891797 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:54:17.891763 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff27c7f7_a5f5_4489_91ef_f8a7e9c396eb.slice/crio-6da3500f65ca8c57cd5406d8b719fd0a2522336c808f07c5a28c855e74f434ff WatchSource:0}: Error finding container 6da3500f65ca8c57cd5406d8b719fd0a2522336c808f07c5a28c855e74f434ff: Status 404 returned error can't find the container with id 6da3500f65ca8c57cd5406d8b719fd0a2522336c808f07c5a28c855e74f434ff Jul 06 23:54:18.259221 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:18.259184 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" event={"ID":"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb","Type":"ContainerStarted","Data":"6da3500f65ca8c57cd5406d8b719fd0a2522336c808f07c5a28c855e74f434ff"} Jul 06 23:54:19.519175 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.519138 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb"] Jul 06 23:54:19.519577 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.519303 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" podUID="874962cc-8b61-4346-a115-07aefe0ca440" containerName="discovery" containerID="cri-o://a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6" gracePeriod=30 Jul 06 23:54:19.792714 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.792688 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:19.886189 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.886088 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-ca-configmap\") pod \"874962cc-8b61-4346-a115-07aefe0ca440\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " Jul 06 23:54:19.886366 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.886250 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tkzn\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-kube-api-access-8tkzn\") pod \"874962cc-8b61-4346-a115-07aefe0ca440\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " Jul 06 23:54:19.886366 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.886280 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-cacerts\") pod \"874962cc-8b61-4346-a115-07aefe0ca440\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " Jul 06 23:54:19.886366 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.886320 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-dns-cert\") pod \"874962cc-8b61-4346-a115-07aefe0ca440\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " Jul 06 23:54:19.886532 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.886371 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-kubeconfig\") pod \"874962cc-8b61-4346-a115-07aefe0ca440\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " Jul 06 23:54:19.886532 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.886397 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/874962cc-8b61-4346-a115-07aefe0ca440-local-certs\") pod \"874962cc-8b61-4346-a115-07aefe0ca440\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " Jul 06 23:54:19.886532 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.886439 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-istio-token\") pod \"874962cc-8b61-4346-a115-07aefe0ca440\" (UID: \"874962cc-8b61-4346-a115-07aefe0ca440\") " Jul 06 23:54:19.886532 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.886510 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "874962cc-8b61-4346-a115-07aefe0ca440" (UID: "874962cc-8b61-4346-a115-07aefe0ca440"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:54:19.886839 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.886751 2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-ca-configmap\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:54:19.888832 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.888790 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/874962cc-8b61-4346-a115-07aefe0ca440-local-certs" (OuterVolumeSpecName: "local-certs") pod "874962cc-8b61-4346-a115-07aefe0ca440" (UID: "874962cc-8b61-4346-a115-07aefe0ca440"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:54:19.888962 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.888881 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "874962cc-8b61-4346-a115-07aefe0ca440" (UID: "874962cc-8b61-4346-a115-07aefe0ca440"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:54:19.889255 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.889233 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-cacerts" (OuterVolumeSpecName: "cacerts") pod "874962cc-8b61-4346-a115-07aefe0ca440" (UID: "874962cc-8b61-4346-a115-07aefe0ca440"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:54:19.889329 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.889290 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "874962cc-8b61-4346-a115-07aefe0ca440" (UID: "874962cc-8b61-4346-a115-07aefe0ca440"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:54:19.889329 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.889306 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-kube-api-access-8tkzn" (OuterVolumeSpecName: "kube-api-access-8tkzn") pod "874962cc-8b61-4346-a115-07aefe0ca440" (UID: "874962cc-8b61-4346-a115-07aefe0ca440"). InnerVolumeSpecName "kube-api-access-8tkzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:54:19.889397 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.889377 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-istio-token" (OuterVolumeSpecName: "istio-token") pod "874962cc-8b61-4346-a115-07aefe0ca440" (UID: "874962cc-8b61-4346-a115-07aefe0ca440"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:54:19.988074 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.988038 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tkzn\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-kube-api-access-8tkzn\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:54:19.988074 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.988070 2584 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-cacerts\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:54:19.988074 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.988083 2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-csr-dns-cert\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:54:19.988311 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.988096 2584 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/874962cc-8b61-4346-a115-07aefe0ca440-istio-kubeconfig\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:54:19.988311 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.988109 2584 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/874962cc-8b61-4346-a115-07aefe0ca440-local-certs\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:54:19.988311 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:19.988120 2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/874962cc-8b61-4346-a115-07aefe0ca440-istio-token\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:54:20.270587 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.270503 2584 generic.go:356] "Generic (PLEG): container finished" podID="874962cc-8b61-4346-a115-07aefe0ca440" containerID="a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6" exitCode=0 Jul 06 23:54:20.270587 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.270536 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" event={"ID":"874962cc-8b61-4346-a115-07aefe0ca440","Type":"ContainerDied","Data":"a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6"} Jul 06 23:54:20.270587 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.270555 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" Jul 06 23:54:20.270921 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.270590 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb" event={"ID":"874962cc-8b61-4346-a115-07aefe0ca440","Type":"ContainerDied","Data":"ecc1ebb88d37d1b1c99b40cfbb7e75c93d0198bed7c6061281a948d950a13a41"} Jul 06 23:54:20.270921 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.270644 2584 scope.go:117] "RemoveContainer" containerID="a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6" Jul 06 23:54:20.272406 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.272318 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" event={"ID":"ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb","Type":"ContainerStarted","Data":"a4a12f6cba48112d8f79d4f6409047cbf795d2f85b460af39e0d48f03a96b34b"} Jul 06 23:54:20.272539 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.272431 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:54:20.279907 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.279892 2584 scope.go:117] "RemoveContainer" containerID="a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6" Jul 06 23:54:20.280185 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:54:20.280166 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6\": container with ID starting with a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6 not found: ID does not exist" containerID="a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6" Jul 06 23:54:20.280236 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.280197 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6"} err="failed to get container status \"a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6\": rpc error: code = NotFound desc = could not find container \"a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6\": container with ID starting with a55ed082f36ffd781fceb0014a8dad32669d5208c40219ad2133f75181c8c5b6 not found: ID does not exist" Jul 06 23:54:20.308024 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.307988 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb"] Jul 06 23:54:20.323359 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.323325 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dmrmb"] Jul 06 23:54:20.368048 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.367995 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" podStartSLOduration=1.9614440210000001 podStartE2EDuration="3.367978353s" totalImagesPullingTime="1.406534332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:54:20.364895316 +0000 UTC m=+318.156637054" watchObservedRunningTime="2026-07-06 23:54:20.367978353 +0000 UTC m=+318.159720090" Jul 06 23:54:20.696318 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:20.696282 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="874962cc-8b61-4346-a115-07aefe0ca440" path="/var/lib/kubelet/pods/874962cc-8b61-4346-a115-07aefe0ca440/volumes" Jul 06 23:54:25.245505 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:25.245471 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fvz8r" Jul 06 23:54:25.247284 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:25.247265 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vs6jp" Jul 06 23:54:31.280489 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:54:31.280451 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f447c9d54-nddws" Jul 06 23:55:20.835306 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.835273 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w"] Jul 06 23:55:20.836028 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.835644 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="874962cc-8b61-4346-a115-07aefe0ca440" containerName="discovery" Jul 06 23:55:20.836028 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.835657 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="874962cc-8b61-4346-a115-07aefe0ca440" containerName="discovery" Jul 06 23:55:20.836028 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.835742 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="874962cc-8b61-4346-a115-07aefe0ca440" containerName="discovery" Jul 06 23:55:20.840342 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.840315 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:20.842850 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.842826 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 23:55:20.843336 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.843318 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 23:55:20.843441 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.843321 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2kgkj\"" Jul 06 23:55:20.848621 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.848575 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w"] Jul 06 23:55:20.917376 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.917344 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:20.917550 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.917400 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjbrg\" (UniqueName: \"kubernetes.io/projected/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-kube-api-access-gjbrg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:20.917550 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:20.917459 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:21.018672 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.018636 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:21.018851 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.018701 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjbrg\" (UniqueName: \"kubernetes.io/projected/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-kube-api-access-gjbrg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:21.018851 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.018730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:21.019006 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.018985 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:21.019048 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.019019 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:21.029197 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.029171 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjbrg\" (UniqueName: \"kubernetes.io/projected/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-kube-api-access-gjbrg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:21.150952 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.150925 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:21.295379 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.295351 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w"] Jul 06 23:55:21.297792 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:55:21.297762 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1c5413_f6ca_48e0_aa59_65f6f9b0d7ff.slice/crio-d9363f1f7e42c9f1ee8f88afffedafa6621e5d30797cd92fe8b02d56da48cff5 WatchSource:0}: Error finding container d9363f1f7e42c9f1ee8f88afffedafa6621e5d30797cd92fe8b02d56da48cff5: Status 404 returned error can't find the container with id d9363f1f7e42c9f1ee8f88afffedafa6621e5d30797cd92fe8b02d56da48cff5 Jul 06 23:55:21.440769 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.440734 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6"] Jul 06 23:55:21.444189 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.444172 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.453080 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.453039 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6"] Jul 06 23:55:21.523777 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.523743 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.523949 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.523783 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.523949 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.523828 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb69s\" (UniqueName: \"kubernetes.io/projected/bba4f820-736e-4a74-88b4-88038cae6a16-kube-api-access-zb69s\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.583021 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.582981 2584 generic.go:356] "Generic (PLEG): container finished" podID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerID="7f42397aaf918514c3587b130a960b428ceaad16c1274b5fa371f7b2d59ef9ed" exitCode=0 Jul 06 23:55:21.583215 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.583074 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" event={"ID":"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff","Type":"ContainerDied","Data":"7f42397aaf918514c3587b130a960b428ceaad16c1274b5fa371f7b2d59ef9ed"} Jul 06 23:55:21.583215 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.583136 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" event={"ID":"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff","Type":"ContainerStarted","Data":"d9363f1f7e42c9f1ee8f88afffedafa6621e5d30797cd92fe8b02d56da48cff5"} Jul 06 23:55:21.625162 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.625122 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.625349 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.625181 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.625349 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.625227 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb69s\" (UniqueName: \"kubernetes.io/projected/bba4f820-736e-4a74-88b4-88038cae6a16-kube-api-access-zb69s\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.625526 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.625506 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.625597 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.625575 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.634348 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.634326 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb69s\" (UniqueName: \"kubernetes.io/projected/bba4f820-736e-4a74-88b4-88038cae6a16-kube-api-access-zb69s\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.777802 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.777720 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:21.916485 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:21.916455 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6"] Jul 06 23:55:21.917904 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:55:21.917879 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba4f820_736e_4a74_88b4_88038cae6a16.slice/crio-8bb255531b7b25f2e0a4442f10df0b364151746181da8d267e82851e40258ba5 WatchSource:0}: Error finding container 8bb255531b7b25f2e0a4442f10df0b364151746181da8d267e82851e40258ba5: Status 404 returned error can't find the container with id 8bb255531b7b25f2e0a4442f10df0b364151746181da8d267e82851e40258ba5 Jul 06 23:55:22.103198 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.103161 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v"] Jul 06 23:55:22.106970 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.106950 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.123430 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.123401 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v"] Jul 06 23:55:22.230967 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.230931 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8ngh\" (UniqueName: \"kubernetes.io/projected/d213be82-5e7f-422f-9283-d24a65ae6ac3-kube-api-access-h8ngh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.231156 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.230998 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.231156 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.231046 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.331566 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.331537 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.331758 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.331638 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.331758 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.331729 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8ngh\" (UniqueName: \"kubernetes.io/projected/d213be82-5e7f-422f-9283-d24a65ae6ac3-kube-api-access-h8ngh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.332140 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.332018 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.332271 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.332247 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.341717 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.341696 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8ngh\" (UniqueName: \"kubernetes.io/projected/d213be82-5e7f-422f-9283-d24a65ae6ac3-kube-api-access-h8ngh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.416858 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.416820 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:22.554855 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.554820 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v"] Jul 06 23:55:22.557095 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:55:22.557065 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd213be82_5e7f_422f_9283_d24a65ae6ac3.slice/crio-a4d19eb9e3243d0426d987cc3d85de51938c9c8d11c22491aec1ef6df9640b0d WatchSource:0}: Error finding container a4d19eb9e3243d0426d987cc3d85de51938c9c8d11c22491aec1ef6df9640b0d: Status 404 returned error can't find the container with id a4d19eb9e3243d0426d987cc3d85de51938c9c8d11c22491aec1ef6df9640b0d Jul 06 23:55:22.589961 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.589882 2584 generic.go:356] "Generic (PLEG): container finished" podID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerID="726a430cf8de20940ab5e0601071f492a4d74a5a4a66bda46199c35c79540f68" exitCode=0 Jul 06 23:55:22.589961 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.589950 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" event={"ID":"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff","Type":"ContainerDied","Data":"726a430cf8de20940ab5e0601071f492a4d74a5a4a66bda46199c35c79540f68"} Jul 06 23:55:22.591473 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.591422 2584 generic.go:356] "Generic (PLEG): container finished" podID="bba4f820-736e-4a74-88b4-88038cae6a16" containerID="247d6880fa86eed84b9dbfd1c873dfc4fe0655aa500b448adabb5b81c3caee67" exitCode=0 Jul 06 23:55:22.591553 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.591493 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" event={"ID":"bba4f820-736e-4a74-88b4-88038cae6a16","Type":"ContainerDied","Data":"247d6880fa86eed84b9dbfd1c873dfc4fe0655aa500b448adabb5b81c3caee67"} Jul 06 23:55:22.591553 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.591527 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" event={"ID":"bba4f820-736e-4a74-88b4-88038cae6a16","Type":"ContainerStarted","Data":"8bb255531b7b25f2e0a4442f10df0b364151746181da8d267e82851e40258ba5"} Jul 06 23:55:22.592968 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.592920 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" event={"ID":"d213be82-5e7f-422f-9283-d24a65ae6ac3","Type":"ContainerStarted","Data":"a4d19eb9e3243d0426d987cc3d85de51938c9c8d11c22491aec1ef6df9640b0d"} Jul 06 23:55:22.645836 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.645806 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg"] Jul 06 23:55:22.658770 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.658031 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.660276 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.660244 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg"] Jul 06 23:55:22.736631 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.736570 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdpmk\" (UniqueName: \"kubernetes.io/projected/58ead077-ccf6-442b-9fe2-c370bdc198a1-kube-api-access-kdpmk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.736778 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.736691 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.736778 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.736733 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.838104 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.838070 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.838299 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.838124 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.838299 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.838212 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdpmk\" (UniqueName: \"kubernetes.io/projected/58ead077-ccf6-442b-9fe2-c370bdc198a1-kube-api-access-kdpmk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.838561 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.838532 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.838654 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.838540 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.848031 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.847977 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdpmk\" (UniqueName: \"kubernetes.io/projected/58ead077-ccf6-442b-9fe2-c370bdc198a1-kube-api-access-kdpmk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:22.970482 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:22.970440 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:23.116567 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.116544 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg"] Jul 06 23:55:23.117701 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:55:23.117675 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ead077_ccf6_442b_9fe2_c370bdc198a1.slice/crio-b88657c3653fe9629e942faa6b6d66eecabf1c1fb3866ae1739b1dc741dade1b WatchSource:0}: Error finding container b88657c3653fe9629e942faa6b6d66eecabf1c1fb3866ae1739b1dc741dade1b: Status 404 returned error can't find the container with id b88657c3653fe9629e942faa6b6d66eecabf1c1fb3866ae1739b1dc741dade1b Jul 06 23:55:23.600065 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.600031 2584 generic.go:356] "Generic (PLEG): container finished" podID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerID="49b00f381a18edcb2ec048353e4b8162e95cef7939027b4073278fa7501b070b" exitCode=0 Jul 06 23:55:23.600252 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.600120 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" event={"ID":"58ead077-ccf6-442b-9fe2-c370bdc198a1","Type":"ContainerDied","Data":"49b00f381a18edcb2ec048353e4b8162e95cef7939027b4073278fa7501b070b"} Jul 06 23:55:23.600252 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.600177 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" event={"ID":"58ead077-ccf6-442b-9fe2-c370bdc198a1","Type":"ContainerStarted","Data":"b88657c3653fe9629e942faa6b6d66eecabf1c1fb3866ae1739b1dc741dade1b"} Jul 06 23:55:23.602324 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.602303 2584 generic.go:356] "Generic (PLEG): container finished" podID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerID="0f891830c593624d76c7f3d13e8a7a84402030de392e44732e6b55147e402b66" exitCode=0 Jul 06 23:55:23.602437 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.602368 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" event={"ID":"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff","Type":"ContainerDied","Data":"0f891830c593624d76c7f3d13e8a7a84402030de392e44732e6b55147e402b66"} Jul 06 23:55:23.604169 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.604146 2584 generic.go:356] "Generic (PLEG): container finished" podID="bba4f820-736e-4a74-88b4-88038cae6a16" containerID="4387e113cf5afb67269af63b0044cef061e406981f261076d34bdeb4007a22b8" exitCode=0 Jul 06 23:55:23.604262 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.604223 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" event={"ID":"bba4f820-736e-4a74-88b4-88038cae6a16","Type":"ContainerDied","Data":"4387e113cf5afb67269af63b0044cef061e406981f261076d34bdeb4007a22b8"} Jul 06 23:55:23.605718 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.605692 2584 generic.go:356] "Generic (PLEG): container finished" podID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerID="b2c3044cd9732e16e2679f7f1c201a961d23ea940397e6a8331525bfac4c975a" exitCode=0 Jul 06 23:55:23.605794 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:23.605728 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" event={"ID":"d213be82-5e7f-422f-9283-d24a65ae6ac3","Type":"ContainerDied","Data":"b2c3044cd9732e16e2679f7f1c201a961d23ea940397e6a8331525bfac4c975a"} Jul 06 23:55:24.613331 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.613295 2584 generic.go:356] "Generic (PLEG): container finished" podID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerID="e723bb1b8b625130ebc7f82000494274fb94b62e13494c7d0d04f632e2af1c4d" exitCode=0 Jul 06 23:55:24.613810 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.613373 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" event={"ID":"58ead077-ccf6-442b-9fe2-c370bdc198a1","Type":"ContainerDied","Data":"e723bb1b8b625130ebc7f82000494274fb94b62e13494c7d0d04f632e2af1c4d"} Jul 06 23:55:24.615991 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.615966 2584 generic.go:356] "Generic (PLEG): container finished" podID="bba4f820-736e-4a74-88b4-88038cae6a16" containerID="b939bc724b277dd066a3955a42c225c4d50a790d9bca35453c54eae93530805a" exitCode=0 Jul 06 23:55:24.616119 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.616053 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" event={"ID":"bba4f820-736e-4a74-88b4-88038cae6a16","Type":"ContainerDied","Data":"b939bc724b277dd066a3955a42c225c4d50a790d9bca35453c54eae93530805a"} Jul 06 23:55:24.618151 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.618125 2584 generic.go:356] "Generic (PLEG): container finished" podID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerID="b222eb6f0968650a25c593f0e622f72025ad6b1dfd725e6a36235ca8c58c6707" exitCode=0 Jul 06 23:55:24.618250 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.618198 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" event={"ID":"d213be82-5e7f-422f-9283-d24a65ae6ac3","Type":"ContainerDied","Data":"b222eb6f0968650a25c593f0e622f72025ad6b1dfd725e6a36235ca8c58c6707"} Jul 06 23:55:24.770594 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.770567 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:24.857538 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.857505 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-util\") pod \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " Jul 06 23:55:24.857716 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.857562 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjbrg\" (UniqueName: \"kubernetes.io/projected/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-kube-api-access-gjbrg\") pod \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " Jul 06 23:55:24.857716 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.857662 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-bundle\") pod \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\" (UID: \"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff\") " Jul 06 23:55:24.858194 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.858169 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-bundle" (OuterVolumeSpecName: "bundle") pod "7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" (UID: "7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:55:24.859964 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.859938 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-kube-api-access-gjbrg" (OuterVolumeSpecName: "kube-api-access-gjbrg") pod "7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" (UID: "7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff"). InnerVolumeSpecName "kube-api-access-gjbrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:55:24.863276 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.863240 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-util" (OuterVolumeSpecName: "util") pod "7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" (UID: "7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:55:24.959340 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.959260 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-util\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:24.959340 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.959293 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjbrg\" (UniqueName: \"kubernetes.io/projected/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-kube-api-access-gjbrg\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:24.959340 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:24.959303 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:25.626827 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.626783 2584 generic.go:356] "Generic (PLEG): container finished" podID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerID="9e629299b830bcf1010dda50ec25bcf88d9dbb3d57cb2008b0834f48887e3361" exitCode=0 Jul 06 23:55:25.627275 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.626860 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" event={"ID":"58ead077-ccf6-442b-9fe2-c370bdc198a1","Type":"ContainerDied","Data":"9e629299b830bcf1010dda50ec25bcf88d9dbb3d57cb2008b0834f48887e3361"} Jul 06 23:55:25.628724 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.628702 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" Jul 06 23:55:25.628840 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.628699 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w" event={"ID":"7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff","Type":"ContainerDied","Data":"d9363f1f7e42c9f1ee8f88afffedafa6621e5d30797cd92fe8b02d56da48cff5"} Jul 06 23:55:25.628840 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.628827 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9363f1f7e42c9f1ee8f88afffedafa6621e5d30797cd92fe8b02d56da48cff5" Jul 06 23:55:25.630902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.630878 2584 generic.go:356] "Generic (PLEG): container finished" podID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerID="48e8e2e4bbd59b9ed2011340cf4a3b345686e80c1cf8ca021a808e396ffc943b" exitCode=0 Jul 06 23:55:25.631025 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.630938 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" event={"ID":"d213be82-5e7f-422f-9283-d24a65ae6ac3","Type":"ContainerDied","Data":"48e8e2e4bbd59b9ed2011340cf4a3b345686e80c1cf8ca021a808e396ffc943b"} Jul 06 23:55:25.766075 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.766044 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:25.865576 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.865545 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-bundle\") pod \"bba4f820-736e-4a74-88b4-88038cae6a16\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " Jul 06 23:55:25.865752 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.865596 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb69s\" (UniqueName: \"kubernetes.io/projected/bba4f820-736e-4a74-88b4-88038cae6a16-kube-api-access-zb69s\") pod \"bba4f820-736e-4a74-88b4-88038cae6a16\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " Jul 06 23:55:25.865752 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.865669 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-util\") pod \"bba4f820-736e-4a74-88b4-88038cae6a16\" (UID: \"bba4f820-736e-4a74-88b4-88038cae6a16\") " Jul 06 23:55:25.866120 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.866089 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-bundle" (OuterVolumeSpecName: "bundle") pod "bba4f820-736e-4a74-88b4-88038cae6a16" (UID: "bba4f820-736e-4a74-88b4-88038cae6a16"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:55:25.867997 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.867971 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba4f820-736e-4a74-88b4-88038cae6a16-kube-api-access-zb69s" (OuterVolumeSpecName: "kube-api-access-zb69s") pod "bba4f820-736e-4a74-88b4-88038cae6a16" (UID: "bba4f820-736e-4a74-88b4-88038cae6a16"). InnerVolumeSpecName "kube-api-access-zb69s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:55:25.871357 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.871332 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-util" (OuterVolumeSpecName: "util") pod "bba4f820-736e-4a74-88b4-88038cae6a16" (UID: "bba4f820-736e-4a74-88b4-88038cae6a16"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:55:25.966788 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.966702 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:25.966788 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.966731 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb69s\" (UniqueName: \"kubernetes.io/projected/bba4f820-736e-4a74-88b4-88038cae6a16-kube-api-access-zb69s\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:25.966788 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:25.966741 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4f820-736e-4a74-88b4-88038cae6a16-util\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:26.640842 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.640798 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" event={"ID":"bba4f820-736e-4a74-88b4-88038cae6a16","Type":"ContainerDied","Data":"8bb255531b7b25f2e0a4442f10df0b364151746181da8d267e82851e40258ba5"} Jul 06 23:55:26.640842 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.640838 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6" Jul 06 23:55:26.641325 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.640860 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bb255531b7b25f2e0a4442f10df0b364151746181da8d267e82851e40258ba5" Jul 06 23:55:26.798837 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.798813 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:26.800844 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.800824 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:26.876347 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.876313 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdpmk\" (UniqueName: \"kubernetes.io/projected/58ead077-ccf6-442b-9fe2-c370bdc198a1-kube-api-access-kdpmk\") pod \"58ead077-ccf6-442b-9fe2-c370bdc198a1\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " Jul 06 23:55:26.876522 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.876356 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-bundle\") pod \"58ead077-ccf6-442b-9fe2-c370bdc198a1\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " Jul 06 23:55:26.876522 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.876402 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-util\") pod \"d213be82-5e7f-422f-9283-d24a65ae6ac3\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " Jul 06 23:55:26.876522 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.876425 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8ngh\" (UniqueName: \"kubernetes.io/projected/d213be82-5e7f-422f-9283-d24a65ae6ac3-kube-api-access-h8ngh\") pod \"d213be82-5e7f-422f-9283-d24a65ae6ac3\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " Jul 06 23:55:26.876522 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.876450 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-util\") pod \"58ead077-ccf6-442b-9fe2-c370bdc198a1\" (UID: \"58ead077-ccf6-442b-9fe2-c370bdc198a1\") " Jul 06 23:55:26.876522 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.876479 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-bundle\") pod \"d213be82-5e7f-422f-9283-d24a65ae6ac3\" (UID: \"d213be82-5e7f-422f-9283-d24a65ae6ac3\") " Jul 06 23:55:26.877090 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.877024 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-bundle" (OuterVolumeSpecName: "bundle") pod "d213be82-5e7f-422f-9283-d24a65ae6ac3" (UID: "d213be82-5e7f-422f-9283-d24a65ae6ac3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:55:26.877325 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.877127 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-bundle" (OuterVolumeSpecName: "bundle") pod "58ead077-ccf6-442b-9fe2-c370bdc198a1" (UID: "58ead077-ccf6-442b-9fe2-c370bdc198a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:55:26.878709 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.878681 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58ead077-ccf6-442b-9fe2-c370bdc198a1-kube-api-access-kdpmk" (OuterVolumeSpecName: "kube-api-access-kdpmk") pod "58ead077-ccf6-442b-9fe2-c370bdc198a1" (UID: "58ead077-ccf6-442b-9fe2-c370bdc198a1"). InnerVolumeSpecName "kube-api-access-kdpmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:55:26.879100 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.879077 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d213be82-5e7f-422f-9283-d24a65ae6ac3-kube-api-access-h8ngh" (OuterVolumeSpecName: "kube-api-access-h8ngh") pod "d213be82-5e7f-422f-9283-d24a65ae6ac3" (UID: "d213be82-5e7f-422f-9283-d24a65ae6ac3"). InnerVolumeSpecName "kube-api-access-h8ngh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:55:26.881343 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.881305 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-util" (OuterVolumeSpecName: "util") pod "d213be82-5e7f-422f-9283-d24a65ae6ac3" (UID: "d213be82-5e7f-422f-9283-d24a65ae6ac3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:55:26.883353 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.883334 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-util" (OuterVolumeSpecName: "util") pod "58ead077-ccf6-442b-9fe2-c370bdc198a1" (UID: "58ead077-ccf6-442b-9fe2-c370bdc198a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:55:26.977902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.977797 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdpmk\" (UniqueName: \"kubernetes.io/projected/58ead077-ccf6-442b-9fe2-c370bdc198a1-kube-api-access-kdpmk\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:26.977902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.977845 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:26.977902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.977857 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-util\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:26.977902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.977867 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8ngh\" (UniqueName: \"kubernetes.io/projected/d213be82-5e7f-422f-9283-d24a65ae6ac3-kube-api-access-h8ngh\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:26.977902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.977876 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ead077-ccf6-442b-9fe2-c370bdc198a1-util\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:26.977902 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:26.977885 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d213be82-5e7f-422f-9283-d24a65ae6ac3-bundle\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:55:27.648147 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:27.648113 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" Jul 06 23:55:27.648544 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:27.648147 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg" event={"ID":"58ead077-ccf6-442b-9fe2-c370bdc198a1","Type":"ContainerDied","Data":"b88657c3653fe9629e942faa6b6d66eecabf1c1fb3866ae1739b1dc741dade1b"} Jul 06 23:55:27.648544 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:27.648194 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b88657c3653fe9629e942faa6b6d66eecabf1c1fb3866ae1739b1dc741dade1b" Jul 06 23:55:27.650084 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:27.650059 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" Jul 06 23:55:27.650084 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:27.650075 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v" event={"ID":"d213be82-5e7f-422f-9283-d24a65ae6ac3","Type":"ContainerDied","Data":"a4d19eb9e3243d0426d987cc3d85de51938c9c8d11c22491aec1ef6df9640b0d"} Jul 06 23:55:27.650251 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:27.650116 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4d19eb9e3243d0426d987cc3d85de51938c9c8d11c22491aec1ef6df9640b0d" Jul 06 23:55:48.834958 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.834921 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-89g24"] Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835271 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba4f820-736e-4a74-88b4-88038cae6a16" containerName="util" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835282 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba4f820-736e-4a74-88b4-88038cae6a16" containerName="util" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835292 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerName="util" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835297 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerName="util" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835304 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerName="pull" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835310 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerName="pull" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835318 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerName="util" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835323 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerName="util" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835329 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba4f820-736e-4a74-88b4-88038cae6a16" containerName="extract" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835334 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba4f820-736e-4a74-88b4-88038cae6a16" containerName="extract" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835339 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerName="extract" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835343 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerName="extract" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835352 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerName="extract" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835356 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerName="extract" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835363 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba4f820-736e-4a74-88b4-88038cae6a16" containerName="pull" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835367 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba4f820-736e-4a74-88b4-88038cae6a16" containerName="pull" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835372 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerName="pull" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835377 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerName="pull" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835384 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerName="util" Jul 06 23:55:48.835388 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835391 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerName="util" Jul 06 23:55:48.836165 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835400 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerName="extract" Jul 06 23:55:48.836165 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835405 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerName="extract" Jul 06 23:55:48.836165 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835416 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerName="pull" Jul 06 23:55:48.836165 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835420 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerName="pull" Jul 06 23:55:48.836165 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835470 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d213be82-5e7f-422f-9283-d24a65ae6ac3" containerName="extract" Jul 06 23:55:48.836165 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835478 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="58ead077-ccf6-442b-9fe2-c370bdc198a1" containerName="extract" Jul 06 23:55:48.836165 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835485 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff" containerName="extract" Jul 06 23:55:48.836165 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.835501 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba4f820-736e-4a74-88b4-88038cae6a16" containerName="extract" Jul 06 23:55:48.839803 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.839785 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:48.844446 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.844420 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 23:55:48.844446 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.844434 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2kgkj\"" Jul 06 23:55:48.845053 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.845030 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 23:55:48.845053 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.845045 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 23:55:48.845212 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.845076 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 23:55:48.854241 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.854217 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-89g24"] Jul 06 23:55:48.979241 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.979183 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2520f89a-e180-4033-be86-bc499c50992a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:48.979241 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.979244 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2520f89a-e180-4033-be86-bc499c50992a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:48.979482 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:48.979374 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5kzz\" (UniqueName: \"kubernetes.io/projected/2520f89a-e180-4033-be86-bc499c50992a-kube-api-access-c5kzz\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:49.080445 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:49.080385 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2520f89a-e180-4033-be86-bc499c50992a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:49.080445 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:49.080442 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2520f89a-e180-4033-be86-bc499c50992a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:49.080789 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:49.080485 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5kzz\" (UniqueName: \"kubernetes.io/projected/2520f89a-e180-4033-be86-bc499c50992a-kube-api-access-c5kzz\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:49.080789 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:55:49.080545 2584 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 06 23:55:49.080789 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:55:49.080666 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2520f89a-e180-4033-be86-bc499c50992a-plugin-serving-cert podName:2520f89a-e180-4033-be86-bc499c50992a nodeName:}" failed. No retries permitted until 2026-07-06 23:55:49.580642588 +0000 UTC m=+407.372384307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/2520f89a-e180-4033-be86-bc499c50992a-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-89g24" (UID: "2520f89a-e180-4033-be86-bc499c50992a") : secret "plugin-serving-cert" not found Jul 06 23:55:49.081143 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:49.081123 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2520f89a-e180-4033-be86-bc499c50992a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:49.089061 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:49.089001 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5kzz\" (UniqueName: \"kubernetes.io/projected/2520f89a-e180-4033-be86-bc499c50992a-kube-api-access-c5kzz\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:49.585424 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:49.585389 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2520f89a-e180-4033-be86-bc499c50992a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:49.585644 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:55:49.585563 2584 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 06 23:55:49.585700 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:55:49.585685 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2520f89a-e180-4033-be86-bc499c50992a-plugin-serving-cert podName:2520f89a-e180-4033-be86-bc499c50992a nodeName:}" failed. No retries permitted until 2026-07-06 23:55:50.585667634 +0000 UTC m=+408.377409357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/2520f89a-e180-4033-be86-bc499c50992a-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-89g24" (UID: "2520f89a-e180-4033-be86-bc499c50992a") : secret "plugin-serving-cert" not found Jul 06 23:55:50.595009 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:50.594978 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2520f89a-e180-4033-be86-bc499c50992a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:50.597644 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:50.597597 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2520f89a-e180-4033-be86-bc499c50992a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-89g24\" (UID: \"2520f89a-e180-4033-be86-bc499c50992a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:50.649471 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:50.649424 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" Jul 06 23:55:50.791570 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:50.791541 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-89g24"] Jul 06 23:55:50.793265 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:55:50.793239 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2520f89a_e180_4033_be86_bc499c50992a.slice/crio-e5d9923f2afa2f5df8abb3993acdda3af21b5a84f52c4f1c4e66cfd19c7102b8 WatchSource:0}: Error finding container e5d9923f2afa2f5df8abb3993acdda3af21b5a84f52c4f1c4e66cfd19c7102b8: Status 404 returned error can't find the container with id e5d9923f2afa2f5df8abb3993acdda3af21b5a84f52c4f1c4e66cfd19c7102b8 Jul 06 23:55:51.777724 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:55:51.777644 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" event={"ID":"2520f89a-e180-4033-be86-bc499c50992a","Type":"ContainerStarted","Data":"e5d9923f2afa2f5df8abb3993acdda3af21b5a84f52c4f1c4e66cfd19c7102b8"} Jul 06 23:56:12.919312 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:12.919274 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" event={"ID":"2520f89a-e180-4033-be86-bc499c50992a","Type":"ContainerStarted","Data":"2f015c2da1112b7013dd8475e7f4975f1f302eb5bbcb9eea417bf9f04614df8c"} Jul 06 23:56:12.949510 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:12.949440 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-89g24" podStartSLOduration=3.6713435519999997 podStartE2EDuration="24.949422209s" totalImagesPullingTime="21.278078657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:12.94874959 +0000 UTC m=+430.740491329" watchObservedRunningTime="2026-07-06 23:56:12.949422209 +0000 UTC m=+430.741163997" Jul 06 23:56:36.419352 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.419265 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:56:36.444062 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.444032 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:56:36.444233 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.444149 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:56:36.446300 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.446271 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 23:56:36.451392 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.451367 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:56:36.517281 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.517241 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74ss6\" (UniqueName: \"kubernetes.io/projected/f623a181-0655-462e-bcde-99bec03d9ef5-kube-api-access-74ss6\") pod \"limitador-limitador-54d6d988d5-6d87v\" (UID: \"f623a181-0655-462e-bcde-99bec03d9ef5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:56:36.517281 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.517284 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f623a181-0655-462e-bcde-99bec03d9ef5-config-file\") pod \"limitador-limitador-54d6d988d5-6d87v\" (UID: \"f623a181-0655-462e-bcde-99bec03d9ef5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:56:36.618630 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.618561 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ss6\" (UniqueName: \"kubernetes.io/projected/f623a181-0655-462e-bcde-99bec03d9ef5-kube-api-access-74ss6\") pod \"limitador-limitador-54d6d988d5-6d87v\" (UID: \"f623a181-0655-462e-bcde-99bec03d9ef5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:56:36.618818 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.618638 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f623a181-0655-462e-bcde-99bec03d9ef5-config-file\") pod \"limitador-limitador-54d6d988d5-6d87v\" (UID: \"f623a181-0655-462e-bcde-99bec03d9ef5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:56:36.619222 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.619201 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f623a181-0655-462e-bcde-99bec03d9ef5-config-file\") pod \"limitador-limitador-54d6d988d5-6d87v\" (UID: \"f623a181-0655-462e-bcde-99bec03d9ef5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:56:36.626297 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.626268 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74ss6\" (UniqueName: \"kubernetes.io/projected/f623a181-0655-462e-bcde-99bec03d9ef5-kube-api-access-74ss6\") pod \"limitador-limitador-54d6d988d5-6d87v\" (UID: \"f623a181-0655-462e-bcde-99bec03d9ef5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:56:36.755309 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.755221 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:56:36.896147 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.896118 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:56:36.897918 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:56:36.897890 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf623a181_0655_462e_bcde_99bec03d9ef5.slice/crio-d75cdaf492a131e23b66638455c60bb6efc662b2803aa7656b5a048a62bd4a67 WatchSource:0}: Error finding container d75cdaf492a131e23b66638455c60bb6efc662b2803aa7656b5a048a62bd4a67: Status 404 returned error can't find the container with id d75cdaf492a131e23b66638455c60bb6efc662b2803aa7656b5a048a62bd4a67 Jul 06 23:56:36.963992 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.963954 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ztx25"] Jul 06 23:56:36.968598 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.968579 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ztx25" Jul 06 23:56:36.970635 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.970613 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t5sqk\"" Jul 06 23:56:36.975822 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:36.975769 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ztx25"] Jul 06 23:56:37.021722 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:37.021635 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc7nw\" (UniqueName: \"kubernetes.io/projected/f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56-kube-api-access-pc7nw\") pod \"authorino-75d556bd77-ztx25\" (UID: \"f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56\") " pod="kuadrant-system/authorino-75d556bd77-ztx25" Jul 06 23:56:37.048622 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:37.048573 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" event={"ID":"f623a181-0655-462e-bcde-99bec03d9ef5","Type":"ContainerStarted","Data":"d75cdaf492a131e23b66638455c60bb6efc662b2803aa7656b5a048a62bd4a67"} Jul 06 23:56:37.122113 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:37.122074 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc7nw\" (UniqueName: \"kubernetes.io/projected/f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56-kube-api-access-pc7nw\") pod \"authorino-75d556bd77-ztx25\" (UID: \"f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56\") " pod="kuadrant-system/authorino-75d556bd77-ztx25" Jul 06 23:56:37.130123 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:37.130098 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc7nw\" (UniqueName: \"kubernetes.io/projected/f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56-kube-api-access-pc7nw\") pod \"authorino-75d556bd77-ztx25\" (UID: \"f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56\") " pod="kuadrant-system/authorino-75d556bd77-ztx25" Jul 06 23:56:37.280232 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:37.280141 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ztx25" Jul 06 23:56:37.426206 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:37.426177 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ztx25"] Jul 06 23:56:37.428238 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:56:37.428209 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5ecb393_2e7d_4905_bf7d_fe6f3d9fbe56.slice/crio-d83ee8c6bae40a0408bca7b9b899b72c6ce063f889c6761da7f906cbada61a25 WatchSource:0}: Error finding container d83ee8c6bae40a0408bca7b9b899b72c6ce063f889c6761da7f906cbada61a25: Status 404 returned error can't find the container with id d83ee8c6bae40a0408bca7b9b899b72c6ce063f889c6761da7f906cbada61a25 Jul 06 23:56:38.056429 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:38.056387 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ztx25" event={"ID":"f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56","Type":"ContainerStarted","Data":"d83ee8c6bae40a0408bca7b9b899b72c6ce063f889c6761da7f906cbada61a25"} Jul 06 23:56:40.076106 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:40.075976 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" event={"ID":"f623a181-0655-462e-bcde-99bec03d9ef5","Type":"ContainerStarted","Data":"4e7a9eea7fb41a40dfe46e65534bf52dde4452190d56e04f72843c48314cccb7"} Jul 06 23:56:40.092573 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:40.092506 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" podStartSLOduration=1.357862801 podStartE2EDuration="4.09248811s" totalImagesPullingTime="2.734625309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:40.090399875 +0000 UTC m=+457.882141639" watchObservedRunningTime="2026-07-06 23:56:40.09248811 +0000 UTC m=+457.884229849" Jul 06 23:56:41.082359 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:41.082331 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:56:42.088977 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:42.088931 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ztx25" event={"ID":"f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56","Type":"ContainerStarted","Data":"90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86"} Jul 06 23:56:42.102882 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:42.102830 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ztx25" podStartSLOduration=2.023232551 podStartE2EDuration="6.102813477s" totalImagesPullingTime="4.079580926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:42.101336772 +0000 UTC m=+459.893078511" watchObservedRunningTime="2026-07-06 23:56:42.102813477 +0000 UTC m=+459.894555218" Jul 06 23:56:52.090336 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:56:52.090302 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6d87v" Jul 06 23:57:09.946260 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:09.946221 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-d5ckj"] Jul 06 23:57:09.950994 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:09.950971 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:09.953401 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:09.953377 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 23:57:09.960416 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:09.960391 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-d5ckj"] Jul 06 23:57:09.999530 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:09.999491 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-d5ckj"] Jul 06 23:57:09.999797 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:57:09.999776 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-txfbw tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-d5ckj" podUID="c2e6345c-cd4d-47b6-9f32-486d955578ab" Jul 06 23:57:10.018879 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.018851 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txfbw\" (UniqueName: \"kubernetes.io/projected/c2e6345c-cd4d-47b6-9f32-486d955578ab-kube-api-access-txfbw\") pod \"authorino-76877994-d5ckj\" (UID: \"c2e6345c-cd4d-47b6-9f32-486d955578ab\") " pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:10.019030 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.018885 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c2e6345c-cd4d-47b6-9f32-486d955578ab-tls-cert\") pod \"authorino-76877994-d5ckj\" (UID: \"c2e6345c-cd4d-47b6-9f32-486d955578ab\") " pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:10.120078 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.120033 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txfbw\" (UniqueName: \"kubernetes.io/projected/c2e6345c-cd4d-47b6-9f32-486d955578ab-kube-api-access-txfbw\") pod \"authorino-76877994-d5ckj\" (UID: \"c2e6345c-cd4d-47b6-9f32-486d955578ab\") " pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:10.120078 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.120082 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c2e6345c-cd4d-47b6-9f32-486d955578ab-tls-cert\") pod \"authorino-76877994-d5ckj\" (UID: \"c2e6345c-cd4d-47b6-9f32-486d955578ab\") " pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:10.122623 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.122579 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c2e6345c-cd4d-47b6-9f32-486d955578ab-tls-cert\") pod \"authorino-76877994-d5ckj\" (UID: \"c2e6345c-cd4d-47b6-9f32-486d955578ab\") " pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:10.128954 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.128934 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txfbw\" (UniqueName: \"kubernetes.io/projected/c2e6345c-cd4d-47b6-9f32-486d955578ab-kube-api-access-txfbw\") pod \"authorino-76877994-d5ckj\" (UID: \"c2e6345c-cd4d-47b6-9f32-486d955578ab\") " pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:10.237841 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.237744 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:10.244216 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.244192 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:10.321865 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.321834 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c2e6345c-cd4d-47b6-9f32-486d955578ab-tls-cert\") pod \"c2e6345c-cd4d-47b6-9f32-486d955578ab\" (UID: \"c2e6345c-cd4d-47b6-9f32-486d955578ab\") " Jul 06 23:57:10.322030 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.321888 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txfbw\" (UniqueName: \"kubernetes.io/projected/c2e6345c-cd4d-47b6-9f32-486d955578ab-kube-api-access-txfbw\") pod \"c2e6345c-cd4d-47b6-9f32-486d955578ab\" (UID: \"c2e6345c-cd4d-47b6-9f32-486d955578ab\") " Jul 06 23:57:10.324198 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.324161 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2e6345c-cd4d-47b6-9f32-486d955578ab-kube-api-access-txfbw" (OuterVolumeSpecName: "kube-api-access-txfbw") pod "c2e6345c-cd4d-47b6-9f32-486d955578ab" (UID: "c2e6345c-cd4d-47b6-9f32-486d955578ab"). InnerVolumeSpecName "kube-api-access-txfbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:57:10.324321 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.324203 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2e6345c-cd4d-47b6-9f32-486d955578ab-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c2e6345c-cd4d-47b6-9f32-486d955578ab" (UID: "c2e6345c-cd4d-47b6-9f32-486d955578ab"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:57:10.422831 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.422798 2584 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c2e6345c-cd4d-47b6-9f32-486d955578ab-tls-cert\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:57:10.422831 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:10.422825 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txfbw\" (UniqueName: \"kubernetes.io/projected/c2e6345c-cd4d-47b6-9f32-486d955578ab-kube-api-access-txfbw\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:57:11.242630 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:11.242585 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d5ckj" Jul 06 23:57:11.270955 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:11.270914 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-d5ckj"] Jul 06 23:57:11.273777 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:11.273749 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-d5ckj"] Jul 06 23:57:12.189556 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:12.189515 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ztx25"] Jul 06 23:57:12.189788 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:12.189744 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ztx25" podUID="f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56" containerName="authorino" containerID="cri-o://90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86" gracePeriod=30 Jul 06 23:57:12.432423 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:12.432397 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ztx25" Jul 06 23:57:12.541934 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:12.541848 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc7nw\" (UniqueName: \"kubernetes.io/projected/f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56-kube-api-access-pc7nw\") pod \"f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56\" (UID: \"f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56\") " Jul 06 23:57:12.544036 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:12.544010 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56-kube-api-access-pc7nw" (OuterVolumeSpecName: "kube-api-access-pc7nw") pod "f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56" (UID: "f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56"). InnerVolumeSpecName "kube-api-access-pc7nw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:57:12.643295 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:12.643251 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc7nw\" (UniqueName: \"kubernetes.io/projected/f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56-kube-api-access-pc7nw\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 06 23:57:12.697651 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:12.697595 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2e6345c-cd4d-47b6-9f32-486d955578ab" path="/var/lib/kubelet/pods/c2e6345c-cd4d-47b6-9f32-486d955578ab/volumes" Jul 06 23:57:13.254338 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:13.254302 2584 generic.go:356] "Generic (PLEG): container finished" podID="f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56" containerID="90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86" exitCode=0 Jul 06 23:57:13.254338 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:13.254343 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ztx25" Jul 06 23:57:13.254701 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:13.254379 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ztx25" event={"ID":"f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56","Type":"ContainerDied","Data":"90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86"} Jul 06 23:57:13.254701 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:13.254409 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ztx25" event={"ID":"f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56","Type":"ContainerDied","Data":"d83ee8c6bae40a0408bca7b9b899b72c6ce063f889c6761da7f906cbada61a25"} Jul 06 23:57:13.254701 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:13.254426 2584 scope.go:117] "RemoveContainer" containerID="90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86" Jul 06 23:57:13.263680 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:13.263660 2584 scope.go:117] "RemoveContainer" containerID="90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86" Jul 06 23:57:13.263969 ip-10-0-135-224 kubenswrapper[2584]: E0706 23:57:13.263953 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86\": container with ID starting with 90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86 not found: ID does not exist" containerID="90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86" Jul 06 23:57:13.264008 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:13.263978 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86"} err="failed to get container status \"90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86\": rpc error: code = NotFound desc = could not find container \"90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86\": container with ID starting with 90ff4fd8d88bd37d9fef72f70af058a0af3c0ee7770d976f2674171c3210ef86 not found: ID does not exist" Jul 06 23:57:13.269018 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:13.268994 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ztx25"] Jul 06 23:57:13.273371 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:13.273345 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ztx25"] Jul 06 23:57:14.696085 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:14.696052 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56" path="/var/lib/kubelet/pods/f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56/volumes" Jul 06 23:57:50.699047 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:57:50.699004 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:58:08.404427 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:58:08.404387 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:58:22.996917 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:58:22.996874 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:58:50.190051 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:58:50.190007 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:59:00.592705 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:00.592663 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:59:06.393385 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:06.393347 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:59:16.299664 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:16.299623 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 06 23:59:58.758437 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.758399 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b98dddb7-qxj84"] Jul 06 23:59:58.758947 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.758785 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56" containerName="authorino" Jul 06 23:59:58.758947 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.758797 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56" containerName="authorino" Jul 06 23:59:58.758947 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.758872 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5ecb393-2e7d-4905-bf7d-fe6f3d9fbe56" containerName="authorino" Jul 06 23:59:58.760780 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.760765 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b98dddb7-qxj84" Jul 06 23:59:58.763639 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.763594 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t5sqk\"" Jul 06 23:59:58.763764 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.763644 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 23:59:58.769674 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.769651 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b98dddb7-qxj84"] Jul 06 23:59:58.801408 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.801373 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60cddd5b-6f8b-424c-833e-93df1d382c2e-tls-cert\") pod \"authorino-8b98dddb7-qxj84\" (UID: \"60cddd5b-6f8b-424c-833e-93df1d382c2e\") " pod="kuadrant-system/authorino-8b98dddb7-qxj84" Jul 06 23:59:58.801583 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.801425 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-httnd\" (UniqueName: \"kubernetes.io/projected/60cddd5b-6f8b-424c-833e-93df1d382c2e-kube-api-access-httnd\") pod \"authorino-8b98dddb7-qxj84\" (UID: \"60cddd5b-6f8b-424c-833e-93df1d382c2e\") " pod="kuadrant-system/authorino-8b98dddb7-qxj84" Jul 06 23:59:58.902411 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.902375 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60cddd5b-6f8b-424c-833e-93df1d382c2e-tls-cert\") pod \"authorino-8b98dddb7-qxj84\" (UID: \"60cddd5b-6f8b-424c-833e-93df1d382c2e\") " pod="kuadrant-system/authorino-8b98dddb7-qxj84" Jul 06 23:59:58.902622 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.902426 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-httnd\" (UniqueName: \"kubernetes.io/projected/60cddd5b-6f8b-424c-833e-93df1d382c2e-kube-api-access-httnd\") pod \"authorino-8b98dddb7-qxj84\" (UID: \"60cddd5b-6f8b-424c-833e-93df1d382c2e\") " pod="kuadrant-system/authorino-8b98dddb7-qxj84" Jul 06 23:59:58.905128 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.905100 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60cddd5b-6f8b-424c-833e-93df1d382c2e-tls-cert\") pod \"authorino-8b98dddb7-qxj84\" (UID: \"60cddd5b-6f8b-424c-833e-93df1d382c2e\") " pod="kuadrant-system/authorino-8b98dddb7-qxj84" Jul 06 23:59:58.911872 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:58.911840 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-httnd\" (UniqueName: \"kubernetes.io/projected/60cddd5b-6f8b-424c-833e-93df1d382c2e-kube-api-access-httnd\") pod \"authorino-8b98dddb7-qxj84\" (UID: \"60cddd5b-6f8b-424c-833e-93df1d382c2e\") " pod="kuadrant-system/authorino-8b98dddb7-qxj84" Jul 06 23:59:59.071519 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:59.071428 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b98dddb7-qxj84" Jul 06 23:59:59.219033 ip-10-0-135-224 kubenswrapper[2584]: W0706 23:59:59.218995 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60cddd5b_6f8b_424c_833e_93df1d382c2e.slice/crio-2aef3933ad35ac6b393ecf493c19406d080eed72ead3e3479abaab1356d4b7c4 WatchSource:0}: Error finding container 2aef3933ad35ac6b393ecf493c19406d080eed72ead3e3479abaab1356d4b7c4: Status 404 returned error can't find the container with id 2aef3933ad35ac6b393ecf493c19406d080eed72ead3e3479abaab1356d4b7c4 Jul 06 23:59:59.220842 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:59.220819 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:59:59.222683 ip-10-0-135-224 kubenswrapper[2584]: I0706 23:59:59.222659 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b98dddb7-qxj84"] Jul 07 00:00:00.136333 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.136291 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b98dddb7-qxj84" event={"ID":"60cddd5b-6f8b-424c-833e-93df1d382c2e","Type":"ContainerStarted","Data":"75ff018f549ae2c43e296ccbf4b1e79ca85043446df811f63634c5f7576e7f90"} Jul 07 00:00:00.136936 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.136896 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b98dddb7-qxj84" event={"ID":"60cddd5b-6f8b-424c-833e-93df1d382c2e","Type":"ContainerStarted","Data":"2aef3933ad35ac6b393ecf493c19406d080eed72ead3e3479abaab1356d4b7c4"} Jul 07 00:00:00.159591 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.159536 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8b98dddb7-qxj84" podStartSLOduration=1.7556837330000001 podStartE2EDuration="2.159519494s" totalImagesPullingTime="403.835761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:00.157174101 +0000 UTC m=+657.948915842" watchObservedRunningTime="2026-07-07 00:00:00.159519494 +0000 UTC m=+657.951261231" Jul 07 00:00:00.208482 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.208440 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723040-rvphr"] Jul 07 00:00:00.211798 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.211764 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" Jul 07 00:00:00.224626 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.224587 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5mk6f\"" Jul 07 00:00:00.252585 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.252557 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723040-rvphr"] Jul 07 00:00:00.314420 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.314383 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29723040-5vnsf"] Jul 07 00:00:00.316240 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.316126 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt5xb\" (UniqueName: \"kubernetes.io/projected/87211671-9f42-4a33-8f32-aaa012173386-kube-api-access-mt5xb\") pod \"maas-api-key-cleanup-29723040-rvphr\" (UID: \"87211671-9f42-4a33-8f32-aaa012173386\") " pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" Jul 07 00:00:00.317467 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.317446 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:00.325459 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.325428 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\"" Jul 07 00:00:00.325585 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.325439 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-9s668\"" Jul 07 00:00:00.336399 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.336367 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29723040-5vnsf"] Jul 07 00:00:00.417360 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.417264 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbd4983a-8365-41a4-95e4-b0e8a02c020b-serviceca\") pod \"image-pruner-29723040-5vnsf\" (UID: \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\") " pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:00.417360 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.417341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgq58\" (UniqueName: \"kubernetes.io/projected/fbd4983a-8365-41a4-95e4-b0e8a02c020b-kube-api-access-hgq58\") pod \"image-pruner-29723040-5vnsf\" (UID: \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\") " pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:00.417546 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.417381 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt5xb\" (UniqueName: \"kubernetes.io/projected/87211671-9f42-4a33-8f32-aaa012173386-kube-api-access-mt5xb\") pod \"maas-api-key-cleanup-29723040-rvphr\" (UID: \"87211671-9f42-4a33-8f32-aaa012173386\") " pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" Jul 07 00:00:00.426682 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.426653 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt5xb\" (UniqueName: \"kubernetes.io/projected/87211671-9f42-4a33-8f32-aaa012173386-kube-api-access-mt5xb\") pod \"maas-api-key-cleanup-29723040-rvphr\" (UID: \"87211671-9f42-4a33-8f32-aaa012173386\") " pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" Jul 07 00:00:00.517980 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.517946 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgq58\" (UniqueName: \"kubernetes.io/projected/fbd4983a-8365-41a4-95e4-b0e8a02c020b-kube-api-access-hgq58\") pod \"image-pruner-29723040-5vnsf\" (UID: \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\") " pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:00.518155 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.518005 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbd4983a-8365-41a4-95e4-b0e8a02c020b-serviceca\") pod \"image-pruner-29723040-5vnsf\" (UID: \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\") " pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:00.518593 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.518575 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbd4983a-8365-41a4-95e4-b0e8a02c020b-serviceca\") pod \"image-pruner-29723040-5vnsf\" (UID: \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\") " pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:00.535387 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.535349 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgq58\" (UniqueName: \"kubernetes.io/projected/fbd4983a-8365-41a4-95e4-b0e8a02c020b-kube-api-access-hgq58\") pod \"image-pruner-29723040-5vnsf\" (UID: \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\") " pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:00.551050 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.551023 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" Jul 07 00:00:00.628640 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.628570 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:00.721660 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.721597 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723040-rvphr"] Jul 07 00:00:00.723929 ip-10-0-135-224 kubenswrapper[2584]: W0707 00:00:00.723892 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87211671_9f42_4a33_8f32_aaa012173386.slice/crio-8ced10b7676ada2df32b81f4e598f4b0892f45c1d36a896635c384f8cf1ee103 WatchSource:0}: Error finding container 8ced10b7676ada2df32b81f4e598f4b0892f45c1d36a896635c384f8cf1ee103: Status 404 returned error can't find the container with id 8ced10b7676ada2df32b81f4e598f4b0892f45c1d36a896635c384f8cf1ee103 Jul 07 00:00:00.810845 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:00.810815 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29723040-5vnsf"] Jul 07 00:00:00.813176 ip-10-0-135-224 kubenswrapper[2584]: W0707 00:00:00.813146 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd4983a_8365_41a4_95e4_b0e8a02c020b.slice/crio-bcb2296e50eca4bdda0f699a2cb175af4384f427f65580d96b4cc4b0fc085774 WatchSource:0}: Error finding container bcb2296e50eca4bdda0f699a2cb175af4384f427f65580d96b4cc4b0fc085774: Status 404 returned error can't find the container with id bcb2296e50eca4bdda0f699a2cb175af4384f427f65580d96b4cc4b0fc085774 Jul 07 00:00:01.146804 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:01.146756 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-5vnsf" event={"ID":"fbd4983a-8365-41a4-95e4-b0e8a02c020b","Type":"ContainerStarted","Data":"982ae2cd4fd13f8bae0525a931dd42c1bfcffd712897d1aee0887f53ae814189"} Jul 07 00:00:01.147364 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:01.146828 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-5vnsf" event={"ID":"fbd4983a-8365-41a4-95e4-b0e8a02c020b","Type":"ContainerStarted","Data":"bcb2296e50eca4bdda0f699a2cb175af4384f427f65580d96b4cc4b0fc085774"} Jul 07 00:00:01.148186 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:01.148164 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" event={"ID":"87211671-9f42-4a33-8f32-aaa012173386","Type":"ContainerStarted","Data":"8ced10b7676ada2df32b81f4e598f4b0892f45c1d36a896635c384f8cf1ee103"} Jul 07 00:00:01.170306 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:01.170243 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29723040-5vnsf" podStartSLOduration=1.1702213399999999 podStartE2EDuration="1.17022134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:01.16732441 +0000 UTC m=+658.959066176" watchObservedRunningTime="2026-07-07 00:00:01.17022134 +0000 UTC m=+658.961963277" Jul 07 00:00:02.156200 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:02.156166 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbd4983a-8365-41a4-95e4-b0e8a02c020b" containerID="982ae2cd4fd13f8bae0525a931dd42c1bfcffd712897d1aee0887f53ae814189" exitCode=0 Jul 07 00:00:02.156587 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:02.156221 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-5vnsf" event={"ID":"fbd4983a-8365-41a4-95e4-b0e8a02c020b","Type":"ContainerDied","Data":"982ae2cd4fd13f8bae0525a931dd42c1bfcffd712897d1aee0887f53ae814189"} Jul 07 00:00:03.306748 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:03.306719 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:03.343999 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:03.343963 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbd4983a-8365-41a4-95e4-b0e8a02c020b-serviceca\") pod \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\" (UID: \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\") " Jul 07 00:00:03.344168 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:03.344030 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgq58\" (UniqueName: \"kubernetes.io/projected/fbd4983a-8365-41a4-95e4-b0e8a02c020b-kube-api-access-hgq58\") pod \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\" (UID: \"fbd4983a-8365-41a4-95e4-b0e8a02c020b\") " Jul 07 00:00:03.344401 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:03.344365 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd4983a-8365-41a4-95e4-b0e8a02c020b-serviceca" (OuterVolumeSpecName: "serviceca") pod "fbd4983a-8365-41a4-95e4-b0e8a02c020b" (UID: "fbd4983a-8365-41a4-95e4-b0e8a02c020b"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:03.346376 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:03.346346 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd4983a-8365-41a4-95e4-b0e8a02c020b-kube-api-access-hgq58" (OuterVolumeSpecName: "kube-api-access-hgq58") pod "fbd4983a-8365-41a4-95e4-b0e8a02c020b" (UID: "fbd4983a-8365-41a4-95e4-b0e8a02c020b"). InnerVolumeSpecName "kube-api-access-hgq58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:03.444680 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:03.444559 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgq58\" (UniqueName: \"kubernetes.io/projected/fbd4983a-8365-41a4-95e4-b0e8a02c020b-kube-api-access-hgq58\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:00:03.444680 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:03.444596 2584 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbd4983a-8365-41a4-95e4-b0e8a02c020b-serviceca\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:00:04.169855 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:04.169824 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-5vnsf" Jul 07 00:00:04.169855 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:04.169830 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-5vnsf" event={"ID":"fbd4983a-8365-41a4-95e4-b0e8a02c020b","Type":"ContainerDied","Data":"bcb2296e50eca4bdda0f699a2cb175af4384f427f65580d96b4cc4b0fc085774"} Jul 07 00:00:04.170118 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:04.169877 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcb2296e50eca4bdda0f699a2cb175af4384f427f65580d96b4cc4b0fc085774" Jul 07 00:00:06.183033 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:06.182997 2584 generic.go:356] "Generic (PLEG): container finished" podID="87211671-9f42-4a33-8f32-aaa012173386" containerID="13759c5b9aeab58a6e4425a472f346f8bc9da25c12666bfeaaf01afadd76c2d5" exitCode=0 Jul 07 00:00:06.183430 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:06.183087 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" event={"ID":"87211671-9f42-4a33-8f32-aaa012173386","Type":"ContainerDied","Data":"13759c5b9aeab58a6e4425a472f346f8bc9da25c12666bfeaaf01afadd76c2d5"} Jul 07 00:00:07.322979 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:07.322947 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" Jul 07 00:00:07.382702 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:07.382665 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt5xb\" (UniqueName: \"kubernetes.io/projected/87211671-9f42-4a33-8f32-aaa012173386-kube-api-access-mt5xb\") pod \"87211671-9f42-4a33-8f32-aaa012173386\" (UID: \"87211671-9f42-4a33-8f32-aaa012173386\") " Jul 07 00:00:07.384990 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:07.384960 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87211671-9f42-4a33-8f32-aaa012173386-kube-api-access-mt5xb" (OuterVolumeSpecName: "kube-api-access-mt5xb") pod "87211671-9f42-4a33-8f32-aaa012173386" (UID: "87211671-9f42-4a33-8f32-aaa012173386"). InnerVolumeSpecName "kube-api-access-mt5xb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:07.483632 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:07.483524 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt5xb\" (UniqueName: \"kubernetes.io/projected/87211671-9f42-4a33-8f32-aaa012173386-kube-api-access-mt5xb\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:00:08.195134 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:08.195104 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" Jul 07 00:00:08.195134 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:08.195089 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723040-rvphr" event={"ID":"87211671-9f42-4a33-8f32-aaa012173386","Type":"ContainerDied","Data":"8ced10b7676ada2df32b81f4e598f4b0892f45c1d36a896635c384f8cf1ee103"} Jul 07 00:00:08.195390 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:08.195173 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ced10b7676ada2df32b81f4e598f4b0892f45c1d36a896635c384f8cf1ee103" Jul 07 00:00:27.795710 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:27.795657 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:00:37.489012 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:37.488968 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:00:48.891807 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:48.891768 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:00:57.393554 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:00:57.393465 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:01:08.492240 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:01:08.492199 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:01:36.094820 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:01:36.094778 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:01:47.892175 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:01:47.892131 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:02:21.885856 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:02:21.885816 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:02:29.084851 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:02:29.084760 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:02:39.389444 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:02:39.389404 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:02:47.795070 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:02:47.795035 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:02:56.894064 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:02:56.894027 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:03:07.796879 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:03:07.796841 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:03:17.892162 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:03:17.892120 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:03:27.489120 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:03:27.489080 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:03:50.187624 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:03:50.187576 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:04:01.292720 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:04:01.292620 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:04:24.591634 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:04:24.590019 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:04:34.393949 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:04:34.393908 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:04:40.798208 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:04:40.798168 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:04:50.596591 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:04:50.596554 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:05:00.686033 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:05:00.685995 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:05:09.891176 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:05:09.891134 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:05:20.390800 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:05:20.390763 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:05:29.398788 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:05:29.398702 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:07:16.598551 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:07:16.598499 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:07:27.674109 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:07:27.674074 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:07:38.787936 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:07:38.787903 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:07:47.590995 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:07:47.590956 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:07:55.797403 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:07:55.797361 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:08:06.190685 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:08:06.190646 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:08:18.493869 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:08:18.493830 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:08:26.898235 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:08:26.895580 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:08:36.490480 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:08:36.490437 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:08:46.495518 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:08:46.495478 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:08:58.696300 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:08:58.696264 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:09:06.046802 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:09:06.046765 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:09:24.192736 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:09:24.192702 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:09:32.800756 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:09:32.800708 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:09:43.606583 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:09:43.606539 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:09:55.393973 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:09:55.393888 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:10:09.095318 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:10:09.095279 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:10:18.188940 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:10:18.188895 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:10:26.789945 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:10:26.789901 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:10:36.593500 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:10:36.593460 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:10:44.995162 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:10:44.995110 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:10:56.200412 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:10:56.200377 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:11:08.800439 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:11:08.800400 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:11:17.806704 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:11:17.806665 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:11:26.897706 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:11:26.897628 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:11:36.696919 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:11:36.696890 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:11:48.585900 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:11:48.585858 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:11:56.710536 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:11:56.710490 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:12:08.197536 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:12:08.197496 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:12:19.493109 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:12:19.493066 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:12:29.899353 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:12:29.899315 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:12:41.798266 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:12:41.798220 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:12:53.696244 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:12:53.696168 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:13:03.295399 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:13:03.295361 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:13:11.292570 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:13:11.292529 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:13:34.194620 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:13:34.194576 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:13:46.484838 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:13:46.484798 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:15:00.179568 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.179527 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-b792t"] Jul 07 00:15:00.182081 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.179937 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd4983a-8365-41a4-95e4-b0e8a02c020b" containerName="image-pruner" Jul 07 00:15:00.182081 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.179951 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd4983a-8365-41a4-95e4-b0e8a02c020b" containerName="image-pruner" Jul 07 00:15:00.182081 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.179959 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87211671-9f42-4a33-8f32-aaa012173386" containerName="cleanup" Jul 07 00:15:00.182081 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.179965 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="87211671-9f42-4a33-8f32-aaa012173386" containerName="cleanup" Jul 07 00:15:00.182081 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.180030 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="87211671-9f42-4a33-8f32-aaa012173386" containerName="cleanup" Jul 07 00:15:00.182081 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.180039 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd4983a-8365-41a4-95e4-b0e8a02c020b" containerName="image-pruner" Jul 07 00:15:00.182801 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.182786 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-b792t" Jul 07 00:15:00.189440 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.189408 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5mk6f\"" Jul 07 00:15:00.203721 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.203689 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-b792t"] Jul 07 00:15:00.283872 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.283826 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t9x6\" (UniqueName: \"kubernetes.io/projected/ca91d016-fc83-4c5d-bf46-63f2e0983875-kube-api-access-5t9x6\") pod \"maas-api-key-cleanup-29723055-b792t\" (UID: \"ca91d016-fc83-4c5d-bf46-63f2e0983875\") " pod="opendatahub/maas-api-key-cleanup-29723055-b792t" Jul 07 00:15:00.384681 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.384643 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t9x6\" (UniqueName: \"kubernetes.io/projected/ca91d016-fc83-4c5d-bf46-63f2e0983875-kube-api-access-5t9x6\") pod \"maas-api-key-cleanup-29723055-b792t\" (UID: \"ca91d016-fc83-4c5d-bf46-63f2e0983875\") " pod="opendatahub/maas-api-key-cleanup-29723055-b792t" Jul 07 00:15:00.393445 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.393417 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t9x6\" (UniqueName: \"kubernetes.io/projected/ca91d016-fc83-4c5d-bf46-63f2e0983875-kube-api-access-5t9x6\") pod \"maas-api-key-cleanup-29723055-b792t\" (UID: \"ca91d016-fc83-4c5d-bf46-63f2e0983875\") " pod="opendatahub/maas-api-key-cleanup-29723055-b792t" Jul 07 00:15:00.492470 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.492346 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-b792t" Jul 07 00:15:00.628300 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:00.628274 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-b792t"] Jul 07 00:15:00.630556 ip-10-0-135-224 kubenswrapper[2584]: W0707 00:15:00.630525 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca91d016_fc83_4c5d_bf46_63f2e0983875.slice/crio-67e8bf328449f62dc346f9116ae90d69bfa1db4c4d6dbdff80290a7b49b3dd0f WatchSource:0}: Error finding container 67e8bf328449f62dc346f9116ae90d69bfa1db4c4d6dbdff80290a7b49b3dd0f: Status 404 returned error can't find the container with id 67e8bf328449f62dc346f9116ae90d69bfa1db4c4d6dbdff80290a7b49b3dd0f Jul 07 00:15:01.068777 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:01.068733 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-b792t" event={"ID":"ca91d016-fc83-4c5d-bf46-63f2e0983875","Type":"ContainerStarted","Data":"df00874dc98feb5dc7e9431f5bce51dab58d3934a22c4acf18ed69a403e955fb"} Jul 07 00:15:01.068994 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:01.068816 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-b792t" event={"ID":"ca91d016-fc83-4c5d-bf46-63f2e0983875","Type":"ContainerStarted","Data":"67e8bf328449f62dc346f9116ae90d69bfa1db4c4d6dbdff80290a7b49b3dd0f"} Jul 07 00:15:01.085636 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:01.085565 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723055-b792t" podStartSLOduration=1.085550147 podStartE2EDuration="1.085550147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:01.082294514 +0000 UTC m=+1558.874036251" watchObservedRunningTime="2026-07-07 00:15:01.085550147 +0000 UTC m=+1558.877291884" Jul 07 00:15:02.075478 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:02.075446 2584 generic.go:356] "Generic (PLEG): container finished" podID="ca91d016-fc83-4c5d-bf46-63f2e0983875" containerID="df00874dc98feb5dc7e9431f5bce51dab58d3934a22c4acf18ed69a403e955fb" exitCode=0 Jul 07 00:15:02.075975 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:02.075542 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-b792t" event={"ID":"ca91d016-fc83-4c5d-bf46-63f2e0983875","Type":"ContainerDied","Data":"df00874dc98feb5dc7e9431f5bce51dab58d3934a22c4acf18ed69a403e955fb"} Jul 07 00:15:03.218976 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:03.218950 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-b792t" Jul 07 00:15:03.311666 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:03.311585 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t9x6\" (UniqueName: \"kubernetes.io/projected/ca91d016-fc83-4c5d-bf46-63f2e0983875-kube-api-access-5t9x6\") pod \"ca91d016-fc83-4c5d-bf46-63f2e0983875\" (UID: \"ca91d016-fc83-4c5d-bf46-63f2e0983875\") " Jul 07 00:15:03.313911 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:03.313880 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca91d016-fc83-4c5d-bf46-63f2e0983875-kube-api-access-5t9x6" (OuterVolumeSpecName: "kube-api-access-5t9x6") pod "ca91d016-fc83-4c5d-bf46-63f2e0983875" (UID: "ca91d016-fc83-4c5d-bf46-63f2e0983875"). InnerVolumeSpecName "kube-api-access-5t9x6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:03.412662 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:03.412622 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t9x6\" (UniqueName: \"kubernetes.io/projected/ca91d016-fc83-4c5d-bf46-63f2e0983875-kube-api-access-5t9x6\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:15:04.087204 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:04.087173 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-b792t" Jul 07 00:15:04.087204 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:04.087174 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-b792t" event={"ID":"ca91d016-fc83-4c5d-bf46-63f2e0983875","Type":"ContainerDied","Data":"67e8bf328449f62dc346f9116ae90d69bfa1db4c4d6dbdff80290a7b49b3dd0f"} Jul 07 00:15:04.087462 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:04.087243 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67e8bf328449f62dc346f9116ae90d69bfa1db4c4d6dbdff80290a7b49b3dd0f" Jul 07 00:15:05.793626 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:05.793568 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:15:14.696584 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:14.696544 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:15:28.132966 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:28.132928 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:15:39.104404 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:15:39.104368 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:16:10.086188 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:16:10.086145 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:16:21.092322 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:16:21.092282 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:16:37.498201 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:16:37.498167 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:16:51.392326 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:16:51.392284 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:17:31.401973 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:17:31.401879 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:17:52.102145 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:17:52.102107 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:18:03.192075 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:18:03.192037 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:18:53.800982 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:18:53.800897 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:19:05.392944 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:19:05.392906 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:19:21.090803 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:19:21.090763 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:19:31.016152 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:19:31.016111 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:19:47.807648 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:19:47.807597 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:19:59.995548 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:19:59.995496 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:20:15.301007 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:20:15.300974 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:20:50.193266 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:20:50.193172 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:21:04.817919 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:04.817866 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:21:06.459396 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.459360 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm"] Jul 07 00:21:06.459888 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.459757 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca91d016-fc83-4c5d-bf46-63f2e0983875" containerName="cleanup" Jul 07 00:21:06.459888 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.459770 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca91d016-fc83-4c5d-bf46-63f2e0983875" containerName="cleanup" Jul 07 00:21:06.459888 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.459840 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca91d016-fc83-4c5d-bf46-63f2e0983875" containerName="cleanup" Jul 07 00:21:06.462978 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.462956 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:06.465421 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.465397 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5mk6f\"" Jul 07 00:21:06.465529 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.465450 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-146c41-serving-cert\"" Jul 07 00:21:06.473793 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.473765 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm"] Jul 07 00:21:06.551347 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.551307 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33bbbba2-874e-4789-ac74-5b5e65242b31-maas-api-tls\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:06.551347 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.551346 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp6h5\" (UniqueName: \"kubernetes.io/projected/33bbbba2-874e-4789-ac74-5b5e65242b31-kube-api-access-gp6h5\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:06.551640 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.551415 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33bbbba2-874e-4789-ac74-5b5e65242b31-openshift-service-ca\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:06.652668 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.652626 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33bbbba2-874e-4789-ac74-5b5e65242b31-maas-api-tls\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:06.652877 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.652675 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp6h5\" (UniqueName: \"kubernetes.io/projected/33bbbba2-874e-4789-ac74-5b5e65242b31-kube-api-access-gp6h5\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:06.652877 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.652741 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33bbbba2-874e-4789-ac74-5b5e65242b31-openshift-service-ca\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:06.652877 ip-10-0-135-224 kubenswrapper[2584]: E0707 00:21:06.652797 2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-146c41-serving-cert: secret "maas-api-e2e-api-b-146c41-serving-cert" not found Jul 07 00:21:06.653047 ip-10-0-135-224 kubenswrapper[2584]: E0707 00:21:06.652888 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33bbbba2-874e-4789-ac74-5b5e65242b31-maas-api-tls podName:33bbbba2-874e-4789-ac74-5b5e65242b31 nodeName:}" failed. No retries permitted until 2026-07-07 00:21:07.152868699 +0000 UTC m=+1924.944610414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/33bbbba2-874e-4789-ac74-5b5e65242b31-maas-api-tls") pod "maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" (UID: "33bbbba2-874e-4789-ac74-5b5e65242b31") : secret "maas-api-e2e-api-b-146c41-serving-cert" not found Jul 07 00:21:06.653391 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.653371 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33bbbba2-874e-4789-ac74-5b5e65242b31-openshift-service-ca\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:06.664483 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:06.664453 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp6h5\" (UniqueName: \"kubernetes.io/projected/33bbbba2-874e-4789-ac74-5b5e65242b31-kube-api-access-gp6h5\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:07.157060 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:07.157017 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33bbbba2-874e-4789-ac74-5b5e65242b31-maas-api-tls\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:07.159666 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:07.159640 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33bbbba2-874e-4789-ac74-5b5e65242b31-maas-api-tls\") pod \"maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:07.375651 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:07.375578 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:07.519167 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:07.519139 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm"] Jul 07 00:21:07.521140 ip-10-0-135-224 kubenswrapper[2584]: W0707 00:21:07.521115 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bbbba2_874e_4789_ac74_5b5e65242b31.slice/crio-1eeab3c9a33cfefbaa1b354c2147a1eed95c142651609ff420314c1e1c5b71d5 WatchSource:0}: Error finding container 1eeab3c9a33cfefbaa1b354c2147a1eed95c142651609ff420314c1e1c5b71d5: Status 404 returned error can't find the container with id 1eeab3c9a33cfefbaa1b354c2147a1eed95c142651609ff420314c1e1c5b71d5 Jul 07 00:21:07.522900 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:07.522882 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:21:08.063731 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:08.063637 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" event={"ID":"33bbbba2-874e-4789-ac74-5b5e65242b31","Type":"ContainerStarted","Data":"1eeab3c9a33cfefbaa1b354c2147a1eed95c142651609ff420314c1e1c5b71d5"} Jul 07 00:21:10.077702 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:10.077662 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" event={"ID":"33bbbba2-874e-4789-ac74-5b5e65242b31","Type":"ContainerStarted","Data":"1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621"} Jul 07 00:21:10.078116 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:10.077765 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:10.097662 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:10.097598 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" podStartSLOduration=2.242945357 podStartE2EDuration="4.097582741s" totalImagesPullingTime="1.854637384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:21:10.095335955 +0000 UTC m=+1927.887077706" watchObservedRunningTime="2026-07-07 00:21:10.097582741 +0000 UTC m=+1927.889324502" Jul 07 00:21:16.088638 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:16.088584 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:17.594771 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:17.594734 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:21:26.832525 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:26.832485 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm"] Jul 07 00:21:26.832960 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:26.832759 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" podUID="33bbbba2-874e-4789-ac74-5b5e65242b31" containerName="maas-api" containerID="cri-o://1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621" gracePeriod=30 Jul 07 00:21:27.080850 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.080821 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:27.169707 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.169667 2584 generic.go:356] "Generic (PLEG): container finished" podID="33bbbba2-874e-4789-ac74-5b5e65242b31" containerID="1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621" exitCode=0 Jul 07 00:21:27.169902 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.169715 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" Jul 07 00:21:27.169902 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.169747 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" event={"ID":"33bbbba2-874e-4789-ac74-5b5e65242b31","Type":"ContainerDied","Data":"1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621"} Jul 07 00:21:27.169902 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.169797 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm" event={"ID":"33bbbba2-874e-4789-ac74-5b5e65242b31","Type":"ContainerDied","Data":"1eeab3c9a33cfefbaa1b354c2147a1eed95c142651609ff420314c1e1c5b71d5"} Jul 07 00:21:27.169902 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.169820 2584 scope.go:117] "RemoveContainer" containerID="1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621" Jul 07 00:21:27.178985 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.178964 2584 scope.go:117] "RemoveContainer" containerID="1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621" Jul 07 00:21:27.179277 ip-10-0-135-224 kubenswrapper[2584]: E0707 00:21:27.179259 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621\": container with ID starting with 1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621 not found: ID does not exist" containerID="1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621" Jul 07 00:21:27.179334 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.179285 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621"} err="failed to get container status \"1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621\": rpc error: code = NotFound desc = could not find container \"1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621\": container with ID starting with 1bddb2cb9060d0712b4e6b9bb05fb6eba52cdb66a59b976a429b5499ba2cf621 not found: ID does not exist" Jul 07 00:21:27.237406 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.237366 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp6h5\" (UniqueName: \"kubernetes.io/projected/33bbbba2-874e-4789-ac74-5b5e65242b31-kube-api-access-gp6h5\") pod \"33bbbba2-874e-4789-ac74-5b5e65242b31\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " Jul 07 00:21:27.237642 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.237478 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33bbbba2-874e-4789-ac74-5b5e65242b31-openshift-service-ca\") pod \"33bbbba2-874e-4789-ac74-5b5e65242b31\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " Jul 07 00:21:27.237642 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.237517 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33bbbba2-874e-4789-ac74-5b5e65242b31-maas-api-tls\") pod \"33bbbba2-874e-4789-ac74-5b5e65242b31\" (UID: \"33bbbba2-874e-4789-ac74-5b5e65242b31\") " Jul 07 00:21:27.237898 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.237872 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33bbbba2-874e-4789-ac74-5b5e65242b31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33bbbba2-874e-4789-ac74-5b5e65242b31" (UID: "33bbbba2-874e-4789-ac74-5b5e65242b31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:21:27.239844 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.239808 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33bbbba2-874e-4789-ac74-5b5e65242b31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33bbbba2-874e-4789-ac74-5b5e65242b31" (UID: "33bbbba2-874e-4789-ac74-5b5e65242b31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:21:27.239965 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.239853 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33bbbba2-874e-4789-ac74-5b5e65242b31-kube-api-access-gp6h5" (OuterVolumeSpecName: "kube-api-access-gp6h5") pod "33bbbba2-874e-4789-ac74-5b5e65242b31" (UID: "33bbbba2-874e-4789-ac74-5b5e65242b31"). InnerVolumeSpecName "kube-api-access-gp6h5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:21:27.339001 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.338964 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33bbbba2-874e-4789-ac74-5b5e65242b31-maas-api-tls\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:21:27.339001 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.338994 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp6h5\" (UniqueName: \"kubernetes.io/projected/33bbbba2-874e-4789-ac74-5b5e65242b31-kube-api-access-gp6h5\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:21:27.339001 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.339003 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33bbbba2-874e-4789-ac74-5b5e65242b31-openshift-service-ca\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:21:27.499471 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.499435 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm"] Jul 07 00:21:27.506805 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:27.506778 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-146c41-8f8b4b559-bq9cm"] Jul 07 00:21:28.696717 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:28.696686 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33bbbba2-874e-4789-ac74-5b5e65242b31" path="/var/lib/kubelet/pods/33bbbba2-874e-4789-ac74-5b5e65242b31/volumes" Jul 07 00:21:29.800228 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:29.800190 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:21:42.105948 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:42.105909 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:21:55.190159 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:21:55.190066 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:22:13.702135 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:22:13.702088 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:22:34.305066 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:22:34.305023 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:22:50.065258 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:22:50.065218 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:23:04.405733 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:23:04.405701 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:23:21.588585 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:23:21.588547 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:23:38.510380 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:23:38.510291 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:23:55.991197 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:23:55.991161 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:24:12.903466 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:12.903427 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:24:30.296638 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:30.296584 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:24:36.399445 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.399405 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2"] Jul 07 00:24:36.399870 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.399855 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33bbbba2-874e-4789-ac74-5b5e65242b31" containerName="maas-api" Jul 07 00:24:36.399870 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.399871 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="33bbbba2-874e-4789-ac74-5b5e65242b31" containerName="maas-api" Jul 07 00:24:36.399945 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.399941 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="33bbbba2-874e-4789-ac74-5b5e65242b31" containerName="maas-api" Jul 07 00:24:36.402999 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.402958 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.405828 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.405803 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a7bd37\"/\"default-dockercfg-cfq69\"" Jul 07 00:24:36.405994 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.405834 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a7bd37\"/\"kube-root-ca.crt\"" Jul 07 00:24:36.405994 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.405846 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a7bd37\"/\"sub-test-model-a7bd37-kserve-self-signed-certs\"" Jul 07 00:24:36.405994 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.405851 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a7bd37\"/\"openshift-service-ca.crt\"" Jul 07 00:24:36.411721 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.411690 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2"] Jul 07 00:24:36.512884 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.512847 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-tmp-dir\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.513087 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.512936 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-dshm\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.513087 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.512963 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-model-cache\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.513087 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.512985 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pngzm\" (UniqueName: \"kubernetes.io/projected/29e02ca7-2d7f-44ca-b740-1114abb4a338-kube-api-access-pngzm\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.513205 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.513087 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-home\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.513205 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.513119 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29e02ca7-2d7f-44ca-b740-1114abb4a338-tls-certs\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.614497 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.614445 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-dshm\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.614497 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.614503 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-model-cache\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.614804 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.614538 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngzm\" (UniqueName: \"kubernetes.io/projected/29e02ca7-2d7f-44ca-b740-1114abb4a338-kube-api-access-pngzm\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.614804 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.614577 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-home\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.614804 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.614633 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29e02ca7-2d7f-44ca-b740-1114abb4a338-tls-certs\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.614804 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.614705 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-tmp-dir\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.615040 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.615006 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-home\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.615175 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.615014 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-model-cache\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.615175 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.615089 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-tmp-dir\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.617128 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.617101 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-dshm\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.617395 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.617375 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29e02ca7-2d7f-44ca-b740-1114abb4a338-tls-certs\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.622204 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.622173 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pngzm\" (UniqueName: \"kubernetes.io/projected/29e02ca7-2d7f-44ca-b740-1114abb4a338-kube-api-access-pngzm\") pod \"sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.713197 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.713097 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:36.850033 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:36.850000 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2"] Jul 07 00:24:36.851591 ip-10-0-135-224 kubenswrapper[2584]: W0707 00:24:36.851564 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29e02ca7_2d7f_44ca_b740_1114abb4a338.slice/crio-df586c40860f7fa073c4fb7be03fe249fd6c518c22f844ccd4fb8f83e25bc8c3 WatchSource:0}: Error finding container df586c40860f7fa073c4fb7be03fe249fd6c518c22f844ccd4fb8f83e25bc8c3: Status 404 returned error can't find the container with id df586c40860f7fa073c4fb7be03fe249fd6c518c22f844ccd4fb8f83e25bc8c3 Jul 07 00:24:37.189877 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:37.189839 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" event={"ID":"29e02ca7-2d7f-44ca-b740-1114abb4a338","Type":"ContainerStarted","Data":"df586c40860f7fa073c4fb7be03fe249fd6c518c22f844ccd4fb8f83e25bc8c3"} Jul 07 00:24:38.196443 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:38.196402 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" event={"ID":"29e02ca7-2d7f-44ca-b740-1114abb4a338","Type":"ContainerStarted","Data":"22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96"} Jul 07 00:24:38.212881 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:38.212829 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" podStartSLOduration=1.214620279 podStartE2EDuration="2.212811457s" totalImagesPullingTime="998.191178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:24:38.211946822 +0000 UTC m=+2136.003688560" watchObservedRunningTime="2026-07-07 00:24:38.212811457 +0000 UTC m=+2136.004553197" Jul 07 00:24:46.713631 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:46.713574 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:46.714059 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:46.713650 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:46.726811 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:46.726768 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:47.257132 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:47.257099 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:24:48.990776 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:24:48.990736 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:25:24.618853 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:25:24.618810 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:25:43.010672 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:25:43.010630 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:25:58.054157 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:25:58.054124 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2"] Jul 07 00:26:02.596674 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:02.596594 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:26:13.075104 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.075041 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" podUID="29e02ca7-2d7f-44ca-b740-1114abb4a338" containerName="main" containerID="cri-o://22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96" gracePeriod=45 Jul 07 00:26:13.326001 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.325934 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:26:13.491894 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.491859 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-home\") pod \"29e02ca7-2d7f-44ca-b740-1114abb4a338\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " Jul 07 00:26:13.492101 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.491921 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-tmp-dir\") pod \"29e02ca7-2d7f-44ca-b740-1114abb4a338\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " Jul 07 00:26:13.492101 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.491941 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29e02ca7-2d7f-44ca-b740-1114abb4a338-tls-certs\") pod \"29e02ca7-2d7f-44ca-b740-1114abb4a338\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " Jul 07 00:26:13.492101 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.491995 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-dshm\") pod \"29e02ca7-2d7f-44ca-b740-1114abb4a338\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " Jul 07 00:26:13.492101 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.492056 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-model-cache\") pod \"29e02ca7-2d7f-44ca-b740-1114abb4a338\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " Jul 07 00:26:13.492101 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.492085 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pngzm\" (UniqueName: \"kubernetes.io/projected/29e02ca7-2d7f-44ca-b740-1114abb4a338-kube-api-access-pngzm\") pod \"29e02ca7-2d7f-44ca-b740-1114abb4a338\" (UID: \"29e02ca7-2d7f-44ca-b740-1114abb4a338\") " Jul 07 00:26:13.492381 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.492198 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "29e02ca7-2d7f-44ca-b740-1114abb4a338" (UID: "29e02ca7-2d7f-44ca-b740-1114abb4a338"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:26:13.492381 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.492215 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-home" (OuterVolumeSpecName: "home") pod "29e02ca7-2d7f-44ca-b740-1114abb4a338" (UID: "29e02ca7-2d7f-44ca-b740-1114abb4a338"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:26:13.492381 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.492362 2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-tmp-dir\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:26:13.492494 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.492384 2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-home\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:26:13.492494 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.492359 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-model-cache" (OuterVolumeSpecName: "model-cache") pod "29e02ca7-2d7f-44ca-b740-1114abb4a338" (UID: "29e02ca7-2d7f-44ca-b740-1114abb4a338"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:26:13.494440 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.494413 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-dshm" (OuterVolumeSpecName: "dshm") pod "29e02ca7-2d7f-44ca-b740-1114abb4a338" (UID: "29e02ca7-2d7f-44ca-b740-1114abb4a338"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:26:13.494537 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.494478 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29e02ca7-2d7f-44ca-b740-1114abb4a338-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "29e02ca7-2d7f-44ca-b740-1114abb4a338" (UID: "29e02ca7-2d7f-44ca-b740-1114abb4a338"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:26:13.494537 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.494522 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e02ca7-2d7f-44ca-b740-1114abb4a338-kube-api-access-pngzm" (OuterVolumeSpecName: "kube-api-access-pngzm") pod "29e02ca7-2d7f-44ca-b740-1114abb4a338" (UID: "29e02ca7-2d7f-44ca-b740-1114abb4a338"). InnerVolumeSpecName "kube-api-access-pngzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:26:13.593561 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.593480 2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-model-cache\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:26:13.593561 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.593507 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pngzm\" (UniqueName: \"kubernetes.io/projected/29e02ca7-2d7f-44ca-b740-1114abb4a338-kube-api-access-pngzm\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:26:13.593561 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.593520 2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29e02ca7-2d7f-44ca-b740-1114abb4a338-tls-certs\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:26:13.593561 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.593529 2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29e02ca7-2d7f-44ca-b740-1114abb4a338-dshm\") on node \"ip-10-0-135-224.ec2.internal\" DevicePath \"\"" Jul 07 00:26:13.719980 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.719948 2584 generic.go:356] "Generic (PLEG): container finished" podID="29e02ca7-2d7f-44ca-b740-1114abb4a338" containerID="22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96" exitCode=0 Jul 07 00:26:13.720166 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.719994 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" Jul 07 00:26:13.720166 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.720010 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" event={"ID":"29e02ca7-2d7f-44ca-b740-1114abb4a338","Type":"ContainerDied","Data":"22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96"} Jul 07 00:26:13.720166 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.720042 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2" event={"ID":"29e02ca7-2d7f-44ca-b740-1114abb4a338","Type":"ContainerDied","Data":"df586c40860f7fa073c4fb7be03fe249fd6c518c22f844ccd4fb8f83e25bc8c3"} Jul 07 00:26:13.720166 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.720059 2584 scope.go:117] "RemoveContainer" containerID="22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96" Jul 07 00:26:13.730311 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.730287 2584 scope.go:117] "RemoveContainer" containerID="22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96" Jul 07 00:26:13.730580 ip-10-0-135-224 kubenswrapper[2584]: E0707 00:26:13.730563 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96\": container with ID starting with 22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96 not found: ID does not exist" containerID="22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96" Jul 07 00:26:13.730676 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.730589 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96"} err="failed to get container status \"22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96\": rpc error: code = NotFound desc = could not find container \"22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96\": container with ID starting with 22d214e22aa50bb5da04834ca3698c408f5b3675fb734553a7b959f43cc0ae96 not found: ID does not exist" Jul 07 00:26:13.743714 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.743687 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2"] Jul 07 00:26:13.749494 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:13.749467 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a7bd37/sub-test-model-a7bd37-kserve-64dc5fd58c-qjgp2"] Jul 07 00:26:14.698180 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:14.698146 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29e02ca7-2d7f-44ca-b740-1114abb4a338" path="/var/lib/kubelet/pods/29e02ca7-2d7f-44ca-b740-1114abb4a338/volumes" Jul 07 00:26:19.688662 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:19.688626 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:26:45.796860 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:26:45.796824 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:27:03.961452 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:27:03.961411 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:27:17.793683 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:27:17.793644 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:27:30.595344 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:27:30.595305 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:28:14.099740 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:14.099693 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6d87v"] Jul 07 00:28:17.519244 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:17.519209 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8b98dddb7-qxj84_60cddd5b-6f8b-424c-833e-93df1d382c2e/authorino/0.log" Jul 07 00:28:22.416150 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:22.416112 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723040-rvphr_87211671-9f42-4a33-8f32-aaa012173386/cleanup/0.log" Jul 07 00:28:22.525155 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:22.525124 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-b792t_ca91d016-fc83-4c5d-bf46-63f2e0983875/cleanup/0.log" Jul 07 00:28:22.760184 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:22.760106 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vs6jp_6c60e73f-1335-4e3d-90cf-b0603a2a3cbc/server/0.log" Jul 07 00:28:22.879187 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:22.879152 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fvz8r_4fb5d1d4-cf5a-48f1-904e-53badd88f9d7/manager/0.log" Jul 07 00:28:23.112847 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:23.112772 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64648fd55c-xcxnj_92451211-1b70-4a64-b9d4-12bfb1689f4c/copy-manifests/0.log" Jul 07 00:28:23.120871 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:23.120846 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64648fd55c-xcxnj_92451211-1b70-4a64-b9d4-12bfb1689f4c/manager/0.log" Jul 07 00:28:24.145626 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.145567 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v_d213be82-5e7f-422f-9283-d24a65ae6ac3/util/0.log" Jul 07 00:28:24.151856 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.151832 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v_d213be82-5e7f-422f-9283-d24a65ae6ac3/pull/0.log" Jul 07 00:28:24.157950 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.157929 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v_d213be82-5e7f-422f-9283-d24a65ae6ac3/extract/0.log" Jul 07 00:28:24.267130 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.267094 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6_bba4f820-736e-4a74-88b4-88038cae6a16/util/0.log" Jul 07 00:28:24.273035 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.272988 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6_bba4f820-736e-4a74-88b4-88038cae6a16/pull/0.log" Jul 07 00:28:24.278530 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.278508 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6_bba4f820-736e-4a74-88b4-88038cae6a16/extract/0.log" Jul 07 00:28:24.389771 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.389734 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg_58ead077-ccf6-442b-9fe2-c370bdc198a1/pull/0.log" Jul 07 00:28:24.395167 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.395145 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg_58ead077-ccf6-442b-9fe2-c370bdc198a1/extract/0.log" Jul 07 00:28:24.400023 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.399968 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg_58ead077-ccf6-442b-9fe2-c370bdc198a1/util/0.log" Jul 07 00:28:24.513451 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.513404 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w_7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff/extract/0.log" Jul 07 00:28:24.519201 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.519176 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w_7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff/util/0.log" Jul 07 00:28:24.524966 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.524948 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w_7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff/pull/0.log" Jul 07 00:28:24.642822 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.642780 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8b98dddb7-qxj84_60cddd5b-6f8b-424c-833e-93df1d382c2e/authorino/0.log" Jul 07 00:28:24.985442 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:24.985414 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-89g24_2520f89a-e180-4033-be86-bc499c50992a/kuadrant-console-plugin/0.log" Jul 07 00:28:25.355362 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:25.355276 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6d87v_f623a181-0655-462e-bcde-99bec03d9ef5/limitador/0.log" Jul 07 00:28:26.053552 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:26.053517 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c55d5ff9-krvcz_5acefd7c-4b5e-454a-a19b-774c3a2e6060/kube-auth-proxy/0.log" Jul 07 00:28:31.715431 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.715399 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f7d67/must-gather-sjf8h"] Jul 07 00:28:31.715846 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.715785 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29e02ca7-2d7f-44ca-b740-1114abb4a338" containerName="main" Jul 07 00:28:31.715846 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.715798 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="29e02ca7-2d7f-44ca-b740-1114abb4a338" containerName="main" Jul 07 00:28:31.715922 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.715866 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="29e02ca7-2d7f-44ca-b740-1114abb4a338" containerName="main" Jul 07 00:28:31.719454 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.719432 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7d67/must-gather-sjf8h" Jul 07 00:28:31.722314 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.722292 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f7d67\"/\"kube-root-ca.crt\"" Jul 07 00:28:31.722582 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.722563 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f7d67\"/\"default-dockercfg-bpjqr\"" Jul 07 00:28:31.722698 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.722684 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f7d67\"/\"openshift-service-ca.crt\"" Jul 07 00:28:31.729853 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.729828 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7d67/must-gather-sjf8h"] Jul 07 00:28:31.823394 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.823358 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/999e3665-a611-49a2-97e2-59edb7056905-must-gather-output\") pod \"must-gather-sjf8h\" (UID: \"999e3665-a611-49a2-97e2-59edb7056905\") " pod="openshift-must-gather-f7d67/must-gather-sjf8h" Jul 07 00:28:31.823565 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.823402 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4zx\" (UniqueName: \"kubernetes.io/projected/999e3665-a611-49a2-97e2-59edb7056905-kube-api-access-rd4zx\") pod \"must-gather-sjf8h\" (UID: \"999e3665-a611-49a2-97e2-59edb7056905\") " pod="openshift-must-gather-f7d67/must-gather-sjf8h" Jul 07 00:28:31.924362 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.924325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/999e3665-a611-49a2-97e2-59edb7056905-must-gather-output\") pod \"must-gather-sjf8h\" (UID: \"999e3665-a611-49a2-97e2-59edb7056905\") " pod="openshift-must-gather-f7d67/must-gather-sjf8h" Jul 07 00:28:31.924552 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.924374 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd4zx\" (UniqueName: \"kubernetes.io/projected/999e3665-a611-49a2-97e2-59edb7056905-kube-api-access-rd4zx\") pod \"must-gather-sjf8h\" (UID: \"999e3665-a611-49a2-97e2-59edb7056905\") " pod="openshift-must-gather-f7d67/must-gather-sjf8h" Jul 07 00:28:31.924729 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.924706 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/999e3665-a611-49a2-97e2-59edb7056905-must-gather-output\") pod \"must-gather-sjf8h\" (UID: \"999e3665-a611-49a2-97e2-59edb7056905\") " pod="openshift-must-gather-f7d67/must-gather-sjf8h" Jul 07 00:28:31.934692 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:31.934651 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd4zx\" (UniqueName: \"kubernetes.io/projected/999e3665-a611-49a2-97e2-59edb7056905-kube-api-access-rd4zx\") pod \"must-gather-sjf8h\" (UID: \"999e3665-a611-49a2-97e2-59edb7056905\") " pod="openshift-must-gather-f7d67/must-gather-sjf8h" Jul 07 00:28:32.029376 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:32.029283 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7d67/must-gather-sjf8h" Jul 07 00:28:32.168973 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:32.168941 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7d67/must-gather-sjf8h"] Jul 07 00:28:32.170192 ip-10-0-135-224 kubenswrapper[2584]: W0707 00:28:32.170162 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod999e3665_a611_49a2_97e2_59edb7056905.slice/crio-69b3bb0b94a211f373519ad133744333cb604d04fbc061f76d1a4b3b4daf9967 WatchSource:0}: Error finding container 69b3bb0b94a211f373519ad133744333cb604d04fbc061f76d1a4b3b4daf9967: Status 404 returned error can't find the container with id 69b3bb0b94a211f373519ad133744333cb604d04fbc061f76d1a4b3b4daf9967 Jul 07 00:28:32.172115 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:32.172095 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:28:32.479128 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:32.479098 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7d67/must-gather-sjf8h" event={"ID":"999e3665-a611-49a2-97e2-59edb7056905","Type":"ContainerStarted","Data":"69b3bb0b94a211f373519ad133744333cb604d04fbc061f76d1a4b3b4daf9967"} Jul 07 00:28:33.495780 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:33.495736 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7d67/must-gather-sjf8h" event={"ID":"999e3665-a611-49a2-97e2-59edb7056905","Type":"ContainerStarted","Data":"cf2de43ca9b61db02d8ad31059f5efc1fe627d8be4494ad38ae36386ce6ddd8b"} Jul 07 00:28:33.496237 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:33.495797 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7d67/must-gather-sjf8h" event={"ID":"999e3665-a611-49a2-97e2-59edb7056905","Type":"ContainerStarted","Data":"34109c510bb4b827c3cda938fbc073a96f09fda9c5773996679271db4449fce8"} Jul 07 00:28:33.512976 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:33.512923 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f7d67/must-gather-sjf8h" podStartSLOduration=1.8751018259999999 podStartE2EDuration="2.512905941s" totalImagesPullingTime="637.804115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:33.510301788 +0000 UTC m=+2371.302043526" watchObservedRunningTime="2026-07-07 00:28:33.512905941 +0000 UTC m=+2371.304647714" Jul 07 00:28:34.419912 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:34.419877 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g9g7s_e5847788-75fd-4e51-85a4-b41114a18582/global-pull-secret-syncer/0.log" Jul 07 00:28:34.537064 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:34.537020 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ntnf9_4a0f3e2d-73f8-4385-8467-527b5b0a0120/konnectivity-agent/0.log" Jul 07 00:28:34.621706 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:34.621673 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-224.ec2.internal_06a9ea5475b6b02a29732a9404f2a151/haproxy/0.log" Jul 07 00:28:39.200019 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.199988 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v_d213be82-5e7f-422f-9283-d24a65ae6ac3/extract/0.log" Jul 07 00:28:39.239179 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.239148 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v_d213be82-5e7f-422f-9283-d24a65ae6ac3/util/0.log" Jul 07 00:28:39.263239 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.263209 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kn28v_d213be82-5e7f-422f-9283-d24a65ae6ac3/pull/0.log" Jul 07 00:28:39.291731 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.291699 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6_bba4f820-736e-4a74-88b4-88038cae6a16/extract/0.log" Jul 07 00:28:39.321062 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.321031 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6_bba4f820-736e-4a74-88b4-88038cae6a16/util/0.log" Jul 07 00:28:39.346141 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.346114 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z82m6_bba4f820-736e-4a74-88b4-88038cae6a16/pull/0.log" Jul 07 00:28:39.384482 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.384441 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg_58ead077-ccf6-442b-9fe2-c370bdc198a1/extract/0.log" Jul 07 00:28:39.406955 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.406920 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg_58ead077-ccf6-442b-9fe2-c370bdc198a1/util/0.log" Jul 07 00:28:39.431745 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.431719 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737cvmg_58ead077-ccf6-442b-9fe2-c370bdc198a1/pull/0.log" Jul 07 00:28:39.455333 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.455251 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w_7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff/extract/0.log" Jul 07 00:28:39.478984 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.478951 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w_7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff/util/0.log" Jul 07 00:28:39.503258 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.503231 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nvf8w_7b1c5413-f6ca-48e0-aa59-65f6f9b0d7ff/pull/0.log" Jul 07 00:28:39.972628 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:39.972381 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8b98dddb7-qxj84_60cddd5b-6f8b-424c-833e-93df1d382c2e/authorino/0.log" Jul 07 00:28:40.062963 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:40.062936 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-89g24_2520f89a-e180-4033-be86-bc499c50992a/kuadrant-console-plugin/0.log" Jul 07 00:28:40.324807 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:40.324722 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6d87v_f623a181-0655-462e-bcde-99bec03d9ef5/limitador/0.log" Jul 07 00:28:42.075845 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.075812 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6c33848-79a1-4152-9438-02e1685e64c1/alertmanager/0.log" Jul 07 00:28:42.098462 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.098428 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6c33848-79a1-4152-9438-02e1685e64c1/config-reloader/0.log" Jul 07 00:28:42.122268 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.122232 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6c33848-79a1-4152-9438-02e1685e64c1/kube-rbac-proxy-web/0.log" Jul 07 00:28:42.146178 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.146150 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6c33848-79a1-4152-9438-02e1685e64c1/kube-rbac-proxy/0.log" Jul 07 00:28:42.170936 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.170902 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6c33848-79a1-4152-9438-02e1685e64c1/kube-rbac-proxy-metric/0.log" Jul 07 00:28:42.200742 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.200652 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6c33848-79a1-4152-9438-02e1685e64c1/prom-label-proxy/0.log" Jul 07 00:28:42.224206 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.224177 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6c33848-79a1-4152-9438-02e1685e64c1/init-config-reloader/0.log" Jul 07 00:28:42.307275 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.307228 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kzd46_14d32330-317f-4a76-9112-3b74784e8518/kube-state-metrics/0.log" Jul 07 00:28:42.325991 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.325913 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kzd46_14d32330-317f-4a76-9112-3b74784e8518/kube-rbac-proxy-main/0.log" Jul 07 00:28:42.353485 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.353453 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kzd46_14d32330-317f-4a76-9112-3b74784e8518/kube-rbac-proxy-self/0.log" Jul 07 00:28:42.452730 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.452691 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sfdq_15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf/node-exporter/0.log" Jul 07 00:28:42.496428 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.496391 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sfdq_15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf/kube-rbac-proxy/0.log" Jul 07 00:28:42.519433 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.519402 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sfdq_15ebcaed-6d0e-4d5b-b7b2-ef3543ff1caf/init-textfile/0.log" Jul 07 00:28:42.685888 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.685855 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-lxkfw_77bfbfcc-be10-482a-b570-6bbfaff158c3/kube-rbac-proxy-main/0.log" Jul 07 00:28:42.711777 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.711747 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-lxkfw_77bfbfcc-be10-482a-b570-6bbfaff158c3/kube-rbac-proxy-self/0.log" Jul 07 00:28:42.733405 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.733378 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-lxkfw_77bfbfcc-be10-482a-b570-6bbfaff158c3/openshift-state-metrics/0.log" Jul 07 00:28:42.940984 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.940895 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-rlvn8_4d386512-acaa-4d5d-9bf9-1a36fde717df/prometheus-operator/0.log" Jul 07 00:28:42.959665 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.959633 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-rlvn8_4d386512-acaa-4d5d-9bf9-1a36fde717df/kube-rbac-proxy/0.log" Jul 07 00:28:42.982162 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:42.982133 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-gp5jw_a0a09c2b-328c-437e-98b0-469fe11fc518/prometheus-operator-admission-webhook/0.log" Jul 07 00:28:43.008568 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:43.008535 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c76b54566-cdjjx_14913d44-1aae-4c39-8cf5-e34d7808bc4a/telemeter-client/0.log" Jul 07 00:28:43.030136 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:43.030103 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c76b54566-cdjjx_14913d44-1aae-4c39-8cf5-e34d7808bc4a/reload/0.log" Jul 07 00:28:43.053661 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:43.053596 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c76b54566-cdjjx_14913d44-1aae-4c39-8cf5-e34d7808bc4a/kube-rbac-proxy/0.log" Jul 07 00:28:44.384763 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.384734 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-pzjd2_bf334344-744b-4a9a-9190-a3994c049b70/networking-console-plugin/0.log" Jul 07 00:28:44.793008 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.792918 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb"] Jul 07 00:28:44.801778 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.801746 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.806942 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.806911 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb"] Jul 07 00:28:44.871092 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.871049 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-sys\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.871294 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.871209 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-podres\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.871294 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.871273 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-proc\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.871418 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.871311 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnts9\" (UniqueName: \"kubernetes.io/projected/286b56fd-7270-4710-9795-3258cafa4727-kube-api-access-dnts9\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.871418 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.871340 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-lib-modules\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.972904 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.972856 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-proc\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.973110 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.972924 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnts9\" (UniqueName: \"kubernetes.io/projected/286b56fd-7270-4710-9795-3258cafa4727-kube-api-access-dnts9\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.973110 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.972954 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-lib-modules\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.973110 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.972994 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-sys\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.973110 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.973096 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-podres\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.973334 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.973273 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-podres\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.973392 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.973336 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-proc\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.973392 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.973367 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-lib-modules\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.973392 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.973342 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/286b56fd-7270-4710-9795-3258cafa4727-sys\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:44.981512 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:44.981478 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnts9\" (UniqueName: \"kubernetes.io/projected/286b56fd-7270-4710-9795-3258cafa4727-kube-api-access-dnts9\") pod \"perf-node-gather-daemonset-84npb\" (UID: \"286b56fd-7270-4710-9795-3258cafa4727\") " pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:45.116753 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:45.116705 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:45.316527 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:45.316168 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb"] Jul 07 00:28:45.329217 ip-10-0-135-224 kubenswrapper[2584]: W0707 00:28:45.329180 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod286b56fd_7270_4710_9795_3258cafa4727.slice/crio-1069bdb01a8bed8cbbfef2aac4cc0bdff5b6e7d64b5e9ac4c3b7c69a16f4ab53 WatchSource:0}: Error finding container 1069bdb01a8bed8cbbfef2aac4cc0bdff5b6e7d64b5e9ac4c3b7c69a16f4ab53: Status 404 returned error can't find the container with id 1069bdb01a8bed8cbbfef2aac4cc0bdff5b6e7d64b5e9ac4c3b7c69a16f4ab53 Jul 07 00:28:45.606626 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:45.606566 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" event={"ID":"286b56fd-7270-4710-9795-3258cafa4727","Type":"ContainerStarted","Data":"2f76910293adaca42ccf37fdd33c5d72dbc54a85e07adebf4fbffcea17ca1195"} Jul 07 00:28:45.607156 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:45.606653 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" event={"ID":"286b56fd-7270-4710-9795-3258cafa4727","Type":"ContainerStarted","Data":"1069bdb01a8bed8cbbfef2aac4cc0bdff5b6e7d64b5e9ac4c3b7c69a16f4ab53"} Jul 07 00:28:45.607539 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:45.607510 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:45.623035 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:45.622972 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" podStartSLOduration=1.6229510550000001 podStartE2EDuration="1.622951055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:45.622284757 +0000 UTC m=+2383.414026496" watchObservedRunningTime="2026-07-07 00:28:45.622951055 +0000 UTC m=+2383.414692795" Jul 07 00:28:45.783914 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:45.783836 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-5q4qv_7f93043e-d1a1-4fe4-8105-21a472155afc/download-server/0.log" Jul 07 00:28:47.667989 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:47.667951 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tjgb4_a0d495b0-9d58-4063-893b-3235af97c343/dns/0.log" Jul 07 00:28:47.697802 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:47.697761 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tjgb4_a0d495b0-9d58-4063-893b-3235af97c343/kube-rbac-proxy/0.log" Jul 07 00:28:47.786584 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:47.786554 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fvtwk_4fafd82c-e4f9-4ae3-b9bf-53be91d68251/dns-node-resolver/0.log" Jul 07 00:28:48.401579 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:48.401542 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29723040-5vnsf_fbd4983a-8365-41a4-95e4-b0e8a02c020b/image-pruner/0.log" Jul 07 00:28:48.452918 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:48.452884 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6db75b4d8-2fdcc_bffbe712-4570-4901-8208-6f0b59f4e8c5/registry/0.log" Jul 07 00:28:48.501863 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:48.501831 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m4pbg_dc338a58-e895-4c9f-900f-15fa7e99427d/node-ca/0.log" Jul 07 00:28:49.617580 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:49.617552 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c55d5ff9-krvcz_5acefd7c-4b5e-454a-a19b-774c3a2e6060/kube-auth-proxy/0.log" Jul 07 00:28:50.533721 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:50.533678 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7h9m_c9fabb51-1838-44ae-81e7-70690bc4b093/serve-healthcheck-canary/0.log" Jul 07 00:28:51.219727 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:51.219666 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvblv_57d50ba7-0b96-4c1f-b99a-5106796e7609/kube-rbac-proxy/0.log" Jul 07 00:28:51.240806 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:51.240764 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvblv_57d50ba7-0b96-4c1f-b99a-5106796e7609/exporter/0.log" Jul 07 00:28:51.264374 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:51.264336 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvblv_57d50ba7-0b96-4c1f-b99a-5106796e7609/extractor/0.log" Jul 07 00:28:52.631590 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:52.630881 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f7d67/perf-node-gather-daemonset-84npb" Jul 07 00:28:53.816422 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:53.816325 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723040-rvphr_87211671-9f42-4a33-8f32-aaa012173386/cleanup/0.log" Jul 07 00:28:53.841862 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:53.841832 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-b792t_ca91d016-fc83-4c5d-bf46-63f2e0983875/cleanup/0.log" Jul 07 00:28:53.964721 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:53.964691 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vs6jp_6c60e73f-1335-4e3d-90cf-b0603a2a3cbc/server/0.log" Jul 07 00:28:54.071917 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:54.071823 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fvz8r_4fb5d1d4-cf5a-48f1-904e-53badd88f9d7/manager/0.log" Jul 07 00:28:54.165018 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:54.164987 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64648fd55c-xcxnj_92451211-1b70-4a64-b9d4-12bfb1689f4c/manager/0.log" Jul 07 00:28:54.189486 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:54.189457 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64648fd55c-xcxnj_92451211-1b70-4a64-b9d4-12bfb1689f4c/copy-manifests/0.log" Jul 07 00:28:55.671012 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:55.670982 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c55d5ff9-krvcz_5acefd7c-4b5e-454a-a19b-774c3a2e6060/kube-auth-proxy/0.log" Jul 07 00:28:55.729721 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:55.729684 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f447c9d54-nddws_ff27c7f7-a5f5-4489-91ef-f8a7e9c396eb/manager/0.log" Jul 07 00:28:57.136811 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:28:57.136783 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c55d5ff9-krvcz_5acefd7c-4b5e-454a-a19b-774c3a2e6060/kube-auth-proxy/0.log" Jul 07 00:29:00.599109 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:29:00.599073 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pxqhb_9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5/migrator/0.log" Jul 07 00:29:00.618722 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:29:00.618687 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pxqhb_9a3d9a49-ed7b-45af-94b1-d7717fbe2ab5/graceful-termination/0.log" Jul 07 00:29:01.996424 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:29:01.996400 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdkv6_e1340007-5311-40a0-968e-4b9e694f6bc4/kube-multus-additional-cni-plugins/0.log" Jul 07 00:29:02.014973 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:29:02.014947 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdkv6_e1340007-5311-40a0-968e-4b9e694f6bc4/egress-router-binary-copy/0.log" Jul 07 00:29:02.034646 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:29:02.034597 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdkv6_e1340007-5311-40a0-968e-4b9e694f6bc4/cni-plugins/0.log" Jul 07 00:29:02.053261 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:29:02.053232 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdkv6_e1340007-5311-40a0-968e-4b9e694f6bc4/bond-cni-plugin/0.log" Jul 07 00:29:02.071629 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:29:02.071590 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdkv6_e1340007-5311-40a0-968e-4b9e694f6bc4/routeoverride-cni/0.log" Jul 07 00:29:02.092352 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:29:02.092273 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdkv6_e1340007-5311-40a0-968e-4b9e694f6bc4/whereabouts-cni-bincopy/0.log" Jul 07 00:29:02.111006 ip-10-0-135-224 kubenswrapper[2584]: I0707 00:29:02.110976 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdkv6_e1340007-5311-40a0-968e-4b9e694f6bc4/whereabouts-cni/0.log"