Jul 10 15:53:21.475500 ip-10-0-135-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 15:53:21.475509 ip-10-0-135-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 15:53:21.475516 ip-10-0-135-133 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 15:53:21.475912 ip-10-0-135-133 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 15:53:31.528087 ip-10-0-135-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 10 15:53:31.528105 ip-10-0-135-133 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b5d908c0659140f4926463abba7550fe -- Jul 10 15:55:22.806063 ip-10-0-135-133 systemd[1]: Starting Kubernetes Kubelet... Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.176729 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183240 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183253 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183257 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183260 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183264 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183267 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183270 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:23.274358 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183272 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:23.252891 ip-10-0-135-133 systemd[1]: Started Kubernetes Kubelet. Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183275 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183277 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183280 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183282 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183285 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183287 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183290 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183293 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183296 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183301 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183305 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183308 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183311 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183314 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183317 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183319 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183322 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183327 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183331 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:23.277766 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183334 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183337 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183341 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183343 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183346 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183348 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183351 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183354 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183357 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183360 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183362 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183365 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183368 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183370 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183373 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183376 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183379 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183382 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183384 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183387 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:23.280415 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183389 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183392 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183394 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183398 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183401 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183404 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183406 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183408 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183411 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183414 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183417 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183422 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183425 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183428 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183432 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183436 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183439 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183442 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183445 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:23.283425 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183448 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183451 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183454 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183457 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183459 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183462 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183464 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183467 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183470 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183472 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183475 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183478 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183481 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183483 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183486 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183488 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183491 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183494 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183496 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:23.285871 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183499 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183501 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183504 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183506 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183509 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183511 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183514 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183516 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183519 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183521 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183523 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183526 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183529 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.183532 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184589 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184597 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184600 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184603 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184607 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184611 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:23.287893 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184614 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184616 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184619 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184622 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184625 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184627 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184630 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184633 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184635 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184638 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184642 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184651 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184655 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184658 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184660 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184663 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184666 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184671 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184673 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184676 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:23.293148 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184679 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184681 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184684 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184687 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184690 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184693 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184695 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184697 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184700 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184703 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184705 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184708 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184710 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184713 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184715 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184717 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184720 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184722 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184724 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184727 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:23.295941 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184729 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184733 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184735 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184738 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184741 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184744 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184748 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184750 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184753 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184756 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184760 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184764 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184767 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184771 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184774 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184777 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184780 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184783 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184786 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:23.299409 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184788 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184791 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184794 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184796 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184799 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184801 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184821 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184824 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184827 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184829 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184832 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184834 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184837 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184839 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184842 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184844 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184848 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184850 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184853 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184858 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:23.302086 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184860 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184863 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184867 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184869 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184872 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184874 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184877 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184880 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184882 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184885 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184887 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184890 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184892 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.184895 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185269 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185274 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185278 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185282 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185285 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:23.304217 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185288 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185290 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185293 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185295 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185298 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185300 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185303 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185305 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185308 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185310 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185313 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185316 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185320 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185322 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185325 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185328 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185331 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185334 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185336 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185339 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:23.308682 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185342 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185344 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185346 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185349 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185351 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185354 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185356 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185359 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185361 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185364 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185366 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185368 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185371 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185373 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185376 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185378 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185381 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185383 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185386 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185388 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:23.312229 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185391 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185393 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185396 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185398 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185402 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185405 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185408 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185412 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185415 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185417 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185420 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185423 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185425 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185428 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185430 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185433 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185435 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185438 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185441 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185444 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:23.315637 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185446 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185448 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185451 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185457 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185461 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185464 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185467 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185469 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185472 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185475 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185478 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185480 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185483 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185486 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185488 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185491 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185499 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185502 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185504 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:23.344038 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185508 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185510 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185513 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185516 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185520 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185522 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185525 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185528 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185531 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185534 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185537 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185540 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185542 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185545 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.185547 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185632 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185643 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185651 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185657 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185663 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 15:55:23.345380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185668 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185674 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185679 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185682 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185685 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185689 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185692 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185695 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185698 2582 flags.go:64] FLAG: --cgroup-root="" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185702 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185706 2582 flags.go:64] FLAG: --client-ca-file="" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185710 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185714 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185719 2582 flags.go:64] FLAG: --cluster-domain="" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185722 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185725 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185728 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185731 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185735 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185738 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185741 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185744 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185747 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185750 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 15:55:23.352637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185753 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185756 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185759 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185763 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185766 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185769 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185772 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185775 2582 flags.go:64] FLAG: --enable-server="true" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185778 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185782 2582 flags.go:64] FLAG: --event-burst="100" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185785 2582 flags.go:64] FLAG: --event-qps="50" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185788 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185791 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185794 2582 flags.go:64] FLAG: --eviction-hard="" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185797 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185800 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185817 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185822 2582 flags.go:64] FLAG: --eviction-soft="" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185825 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185828 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185834 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185837 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185840 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185843 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185846 2582 flags.go:64] FLAG: --feature-gates="" Jul 10 15:55:23.354149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185850 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185853 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185857 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185860 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185863 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185866 2582 flags.go:64] FLAG: --help="false" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185870 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-135-133.ec2.internal" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185873 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185876 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185879 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185882 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185885 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185888 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185891 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185894 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185897 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185900 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185903 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185906 2582 flags.go:64] FLAG: --kube-reserved="" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185909 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185912 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185915 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185918 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185921 2582 flags.go:64] FLAG: --lock-file="" Jul 10 15:55:23.355455 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185925 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185928 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185931 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185937 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185945 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185948 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185951 2582 flags.go:64] FLAG: --logging-format="text" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185954 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185957 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185960 2582 flags.go:64] FLAG: --manifest-url="" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185963 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185968 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185971 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185975 2582 flags.go:64] FLAG: --max-pods="110" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185978 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185981 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185983 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185987 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185989 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185992 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.185995 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186003 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186006 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186009 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 15:55:23.356755 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186012 2582 flags.go:64] FLAG: --pod-cidr="" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186014 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186019 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186022 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186025 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186028 2582 flags.go:64] FLAG: --port="10250" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186032 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186034 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f84ca4c8cded05a4" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186039 2582 flags.go:64] FLAG: --qos-reserved="" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186042 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186045 2582 flags.go:64] FLAG: --register-node="true" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186048 2582 flags.go:64] FLAG: --register-with-taints="" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186053 2582 flags.go:64] FLAG: --registry-burst="10" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186056 2582 flags.go:64] FLAG: --registry-qps="5" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186059 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186062 2582 flags.go:64] FLAG: --reserved-memory="" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186065 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186068 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186072 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186082 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186085 2582 flags.go:64] FLAG: --runonce="false" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186088 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186091 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186094 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186097 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 15:55:23.358038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186100 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186103 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186106 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186109 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186112 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186115 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186118 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186120 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186123 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186127 2582 flags.go:64] FLAG: --system-cgroups="" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186129 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186135 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186138 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186140 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186145 2582 flags.go:64] FLAG: --tls-min-version="" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186149 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186152 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186155 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186158 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186162 2582 flags.go:64] FLAG: --v="2" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186166 2582 flags.go:64] FLAG: --version="false" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186171 2582 flags.go:64] FLAG: --vmodule="" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186175 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.186178 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186289 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:23.359366 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186293 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186296 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186299 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186302 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186305 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186308 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186310 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186313 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186316 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186318 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186321 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186323 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186326 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186328 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186331 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186333 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186336 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186339 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186341 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186344 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:23.360721 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186346 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186349 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186353 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186356 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186358 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186362 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186367 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186370 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186372 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186375 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186378 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186380 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186383 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186386 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186388 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186391 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186393 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186396 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186398 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:23.361514 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186401 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186404 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186407 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186409 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186412 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186414 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186416 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186419 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186422 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186424 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186426 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186429 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186431 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186434 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186436 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186440 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186443 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186447 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186451 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:23.362311 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186455 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186458 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186460 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186463 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186466 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186468 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186471 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186473 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186476 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186478 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186481 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186484 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186486 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186488 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186491 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186494 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186496 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186499 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186501 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186504 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:23.363114 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186506 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186509 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186511 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186514 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186517 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186519 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186522 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186524 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186528 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186531 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186533 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186537 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186542 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186545 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186548 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186551 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186554 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186558 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186560 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:23.363918 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.186563 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.187225 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.194997 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.195014 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.195795 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.195818 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195895 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195902 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195906 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195910 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195914 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195918 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195921 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195925 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195929 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:23.366132 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195933 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195938 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195942 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195946 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195951 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195955 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195960 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195965 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195970 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195974 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195979 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195983 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195988 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195991 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.195995 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196000 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196004 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196013 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196017 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:23.367019 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196021 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196025 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196029 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196034 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196037 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196040 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196044 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196048 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196052 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196055 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196059 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196062 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196066 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196070 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196074 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196078 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196082 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196085 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196090 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196095 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:23.384462 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196099 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196103 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196107 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196113 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196116 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196120 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196124 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196128 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196132 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196136 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196140 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196143 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196147 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196151 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196154 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196158 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196162 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196165 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196168 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196172 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:23.385246 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196176 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196180 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196184 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196187 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196191 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196195 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196199 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196203 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196207 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196210 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196214 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196217 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196221 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196225 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196229 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196234 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196237 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196240 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196244 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196248 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:23.386047 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196254 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196258 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196262 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196266 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196269 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196274 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196277 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196281 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196285 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196288 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196292 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.196299 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196448 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196454 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196458 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:23.386849 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196462 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196466 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196472 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196476 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196480 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196483 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196487 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196490 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196493 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196497 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196501 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196506 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196511 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196516 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196521 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196525 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196529 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196532 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196535 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:23.387631 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196539 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196543 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196547 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196551 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196554 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196558 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196561 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196565 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196568 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196572 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196576 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196579 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196582 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196586 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196590 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196594 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196598 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196602 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196605 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196609 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:23.388418 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196612 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196616 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196619 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196623 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196627 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196630 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196635 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196639 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196643 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196646 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196650 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196654 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196658 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196661 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196665 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196669 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196673 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196677 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196680 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196683 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:23.389219 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196687 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196690 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196694 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196698 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196702 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196705 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196709 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196714 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196717 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196721 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196724 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196728 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196732 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196735 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196739 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196742 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196746 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196750 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196754 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196758 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:23.488725 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196761 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196764 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196768 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196772 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196776 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196779 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196783 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196787 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196790 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196796 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196801 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196817 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196821 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196825 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196829 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196836 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:23.489466 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:23.196841 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.196847 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.196964 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.200421 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.201994 2582 server.go:1019] "Starting client certificate rotation" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.202101 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.202135 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.204636 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.207532 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.221300 2582 log.go:25] "Validated CRI v1 runtime API" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.223632 2582 log.go:25] "Validated CRI v1 image API" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.224450 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 15:55:23.499711 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.226712 2582 fs.go:135] Filesystem UUIDs: map[1478c8d8-322e-4491-885a-beb2c679c0aa:/dev/nvme0n1p3 79f1a735-226c-4004-aba4-d81ca2f03d64:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 10 15:55:23.500494 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.226727 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 15:55:23.500494 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.231310 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.231678 2582 manager.go:216] Machine: {Timestamp:2026-07-10 15:55:23.230405845 +0000 UTC m=+0.315217896 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103203 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dbe1dd8a0bce2a3fc8361e402294f SystemUUID:ec2dbe1d-d8a0-bce2-a3fc-8361e402294f BootID:b5d908c0-6591-40f4-9264-63abba7550fe Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:de:4b:3a:66:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:de:4b:3a:66:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:a1:f8:c9:ca:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.231772 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.231859 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.235233 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.235262 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.235880 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.235890 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.235898 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.236628 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.238667 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.242016 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.242147 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.242174 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.242182 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.242197 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.242206 2582 kubelet.go:398] "Adding apiserver pod source" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.242214 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 15:55:23.501706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.242501 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.242518 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.244616 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247010 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247037 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247175 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247189 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247198 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247204 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247212 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247218 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247860 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247867 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247873 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247879 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247891 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.247899 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.248642 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.248648 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.252217 2582 server.go:1268] "Started kubelet" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.252348 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.252345 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.252348 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.252394 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.252442 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.252450 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.257168 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.257429 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sm585" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.258394 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.258614 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.260097 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-133.ec2.internal.18c0f8b862aedf66 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-133.ec2.internal,UID:ip-10-0-135-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-133.ec2.internal,},FirstTimestamp:2026-07-10 15:55:23.25201495 +0000 UTC m=+0.336827001,LastTimestamp:2026-07-10 15:55:23.25201495 +0000 UTC m=+0.336827001,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-133.ec2.internal,}" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.264103 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sm585" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.264325 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.264370 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.264380 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.265019 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.265036 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.265120 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.265157 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.265166 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 10 15:55:23.502489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.266098 2582 factory.go:153] Registering CRI-O factory Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.266115 2582 factory.go:223] Registration of the crio container factory successfully Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.266165 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.266175 2582 factory.go:55] Registering systemd factory Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.266182 2582 factory.go:223] Registration of the systemd container factory successfully Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.266213 2582 factory.go:103] Registering Raw factory Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.266229 2582 manager.go:1196] Started watching for new ooms in manager Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.266641 2582 manager.go:349] Starting recovery of all containers Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.268719 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.268740 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.276428 2582 manager.go:354] Recovery completed Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.287458 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.289225 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.289246 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.289256 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.289753 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.289762 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.289779 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.289863 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.290550 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.290570 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.290579 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.290851 2582 policy_none.go:49] "None policy: Start" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.290863 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.290873 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:23.291995 2582 policy_none.go:47] "Start" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.364432 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:23.503670 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.465062 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:23.604201 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.565269 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.254686 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:23.665472 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.374788 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.302821 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.491424 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.403024 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.503854 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.503237 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.607524 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.603444 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.726704 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.703660 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.740886 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.738834 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 15:55:25.845276 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.804093 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.904309 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.916565 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 15:50:24 +0000 UTC" deadline="2028-02-29 03:38:23.105858817 +0000 UTC" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.916605 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14363h42m57.189258431s" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.920583 2582 manager.go:337] "Starting Device Plugin manager" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.920613 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.920622 2582 server.go:87] "Starting device plugin registration server" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.921199 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.921217 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.921454 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.921541 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.921549 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.922880 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.922967 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.932735 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.932772 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.936782 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:25.942610 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-133.ec2.internal\" not found" node="ip-10-0-135-133.ec2.internal" Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.947377 2582 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-133.ec2.internal" not found Jul 10 15:55:25.982634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:25.976087 2582 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-133.ec2.internal" not found Jul 10 15:55:26.107824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.038962 2582 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-133.ec2.internal" not found Jul 10 15:55:26.107824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.092813 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:26.107824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.093699 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:26.107824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.093727 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:26.107824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.093738 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:26.107824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.093759 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.107824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.105113 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.107824 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:26.105131 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-133.ec2.internal\": node \"ip-10-0-135-133.ec2.internal\" not found" Jul 10 15:55:26.261741 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.131621 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 15:55:26.261741 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.132741 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 15:55:26.261741 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.132770 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 15:55:26.261741 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.132790 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 15:55:26.261741 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:26.132818 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 15:55:26.261741 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.140371 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:26.261741 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.233711 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"] Jul 10 15:55:26.261741 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.235411 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.261741 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.236618 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.488384 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.394870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/53237d582513d117bd08a5146cf4f447-config\") pod \"kube-apiserver-proxy-ip-10-0-135-133.ec2.internal\" (UID: \"53237d582513d117bd08a5146cf4f447\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.488384 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.394903 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/357eff29f0c7287183aafb08914a401a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"357eff29f0c7287183aafb08914a401a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.488384 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.394964 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357eff29f0c7287183aafb08914a401a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"357eff29f0c7287183aafb08914a401a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.488384 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.445458 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.488384 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.452747 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.488384 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.455873 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 15:55:26.488384 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.463228 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 15:55:26.495393 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.495378 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/53237d582513d117bd08a5146cf4f447-config\") pod \"kube-apiserver-proxy-ip-10-0-135-133.ec2.internal\" (UID: \"53237d582513d117bd08a5146cf4f447\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.495462 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.495399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/357eff29f0c7287183aafb08914a401a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"357eff29f0c7287183aafb08914a401a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.495519 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.495461 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357eff29f0c7287183aafb08914a401a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"357eff29f0c7287183aafb08914a401a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.495519 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.495469 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357eff29f0c7287183aafb08914a401a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"357eff29f0c7287183aafb08914a401a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.495519 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.495499 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/53237d582513d117bd08a5146cf4f447-config\") pod \"kube-apiserver-proxy-ip-10-0-135-133.ec2.internal\" (UID: \"53237d582513d117bd08a5146cf4f447\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.495519 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.495513 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/357eff29f0c7287183aafb08914a401a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"357eff29f0c7287183aafb08914a401a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.758867 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.758791 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.767160 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.767144 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" Jul 10 15:55:26.917140 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.917111 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 15:55:26.917523 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.917116 2582 apiserver.go:52] "Watching apiserver" Jul 10 15:55:26.923185 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.923168 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 15:55:26.923516 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.923497 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-t8nbw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52","openshift-cluster-node-tuning-operator/tuned-j87kc","openshift-image-registry/node-ca-2m2th","openshift-multus/multus-additional-cni-plugins-25qj9","openshift-multus/multus-s2xvp","openshift-network-diagnostics/network-check-target-95nwt","openshift-ovn-kubernetes/ovnkube-node-d88zt","kube-system/konnectivity-agent-cqntp","kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal","openshift-dns/node-resolver-hh9vx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal","openshift-multus/network-metrics-daemon-57mkr","openshift-network-operator/iptables-alerter-4cx9s"] Jul 10 15:55:26.924867 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.924853 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:26.924939 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:26.924914 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:26.926330 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.926316 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:26.927299 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.927283 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:26.928490 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.928472 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:26.929016 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.928996 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 15:55:26.929016 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.929014 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5dj4q\"" Jul 10 15:55:26.929219 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.929207 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 15:55:26.929266 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.929227 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 15:55:26.929627 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.929610 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 15:55:26.929985 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.929956 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 15:55:26.930141 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.930122 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j4m2z\"" Jul 10 15:55:26.930268 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.930242 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 15:55:26.930764 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.930748 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:26.931337 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.931319 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 15:55:26.931551 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.931532 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4nkn2\"" Jul 10 15:55:26.932015 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.931998 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 15:55:26.932076 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.932014 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 15:55:26.932464 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.932446 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s2xvp" Jul 10 15:55:26.933560 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.933544 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 15:55:26.933943 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.933916 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:26.934027 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:26.934008 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:26.934098 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.934043 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 15:55:26.934098 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.934056 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 15:55:26.934098 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.934063 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-646gw\"" Jul 10 15:55:26.934487 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.934465 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 15:55:26.934561 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.934540 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 15:55:26.935262 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.935245 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 15:55:26.935400 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.935250 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tq4h6\"" Jul 10 15:55:26.935400 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.935253 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:26.936362 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.936348 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:26.937710 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.937694 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:26.938066 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938049 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 15:55:26.938119 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938067 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 15:55:26.938119 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938099 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 15:55:26.938194 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938053 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 15:55:26.938410 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938398 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 15:55:26.938459 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938447 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 15:55:26.938645 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938629 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xxfdc\"" Jul 10 15:55:26.938899 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938874 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 15:55:26.938899 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938882 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:26.939046 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938911 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w655z\"" Jul 10 15:55:26.939046 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.938957 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 15:55:26.939046 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:26.938961 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:26.940034 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.940021 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n2rnx\"" Jul 10 15:55:26.940159 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.940143 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:26.940252 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.940237 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 15:55:26.940522 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.940508 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 15:55:26.942642 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.942619 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 15:55:26.942718 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.942683 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xvvj8\"" Jul 10 15:55:26.942872 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.942858 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 15:55:26.942986 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.942877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 15:55:26.955173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.955158 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rpsmj" Jul 10 15:55:26.963680 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:26.963664 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rpsmj" Jul 10 15:55:27.003122 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.003108 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 15:55:27.099546 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-etc-kubernetes\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.099645 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.099645 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099575 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-system-cni-dir\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.099645 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099613 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73c352b8-b4e1-4dcd-966e-54894064139f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.099645 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-slash\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.099793 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099652 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-log-socket\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.099793 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099691 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-socket-dir-parent\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.099793 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099715 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-var-lib-cni-multus\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.099793 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099729 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-lib-modules\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.099793 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099746 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73c352b8-b4e1-4dcd-966e-54894064139f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.099793 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099778 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30ff74b0-ac70-4771-86e2-dffa09292556-ovnkube-config\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.100022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099808 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/331ee3e5-9107-4c12-b1f1-6ff406857257-host-slash\") pod \"iptables-alerter-4cx9s\" (UID: \"331ee3e5-9107-4c12-b1f1-6ff406857257\") " pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.100022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099837 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8883484-f14a-4e4f-993e-db59ef228b7f-cni-binary-copy\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.100022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099860 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-conf-dir\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.100022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099885 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c808ae90-63ce-47cd-9895-1b478aa0d6de-tmp-dir\") pod \"node-resolver-hh9vx\" (UID: \"c808ae90-63ce-47cd-9895-1b478aa0d6de\") " pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.100022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099904 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73c352b8-b4e1-4dcd-966e-54894064139f-cni-binary-copy\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.100022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099952 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-kubelet\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.100022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30ff74b0-ac70-4771-86e2-dffa09292556-ovn-node-metrics-cert\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.100022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.099998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-device-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.100022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100021 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-sys-fs\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100042 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-sysconfig\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100057 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-cnibin\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100072 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg4dq\" (UniqueName: \"kubernetes.io/projected/73c352b8-b4e1-4dcd-966e-54894064139f-kube-api-access-wg4dq\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100087 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gmxf\" (UniqueName: \"kubernetes.io/projected/331ee3e5-9107-4c12-b1f1-6ff406857257-kube-api-access-5gmxf\") pod \"iptables-alerter-4cx9s\" (UID: \"331ee3e5-9107-4c12-b1f1-6ff406857257\") " pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100101 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-cni-dir\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100118 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-hostroot\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100134 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-os-release\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a280651-376b-4c63-84d9-190f0e77719c-serviceca\") pod \"node-ca-2m2th\" (UID: \"6a280651-376b-4c63-84d9-190f0e77719c\") " pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100165 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-var-lib-kubelet\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100195 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45xpm\" (UniqueName: \"kubernetes.io/projected/c808ae90-63ce-47cd-9895-1b478aa0d6de-kube-api-access-45xpm\") pod \"node-resolver-hh9vx\" (UID: \"c808ae90-63ce-47cd-9895-1b478aa0d6de\") " pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-tuned\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100244 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-run-netns\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100298 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c808ae90-63ce-47cd-9895-1b478aa0d6de-hosts-file\") pod \"node-resolver-hh9vx\" (UID: \"c808ae90-63ce-47cd-9895-1b478aa0d6de\") " pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100321 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-registration-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.100425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100345 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-modprobe-d\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100365 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a261c88-e3e3-45cd-8501-8a69827fffad-tmp\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100386 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-etc-selinux\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100408 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-run\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-sysctl-d\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-run-systemd\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100495 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/331ee3e5-9107-4c12-b1f1-6ff406857257-iptables-alerter-script\") pod \"iptables-alerter-4cx9s\" (UID: \"331ee3e5-9107-4c12-b1f1-6ff406857257\") " pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100529 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-os-release\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100561 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-daemon-config\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100584 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92w7d\" (UniqueName: \"kubernetes.io/projected/2814d1a1-a841-4022-b291-c7d78607bdfa-kube-api-access-92w7d\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100602 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-var-lib-openvswitch\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100627 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9t45\" (UniqueName: \"kubernetes.io/projected/a8883484-f14a-4e4f-993e-db59ef228b7f-kube-api-access-l9t45\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100643 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-sys\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100657 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-systemd-units\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100670 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100684 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30ff74b0-ac70-4771-86e2-dffa09292556-ovnkube-script-lib\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-var-lib-cni-bin\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ad63bd1-5947-49fb-9c85-94014575e90a-konnectivity-ca\") pod \"konnectivity-agent-cqntp\" (UID: \"1ad63bd1-5947-49fb-9c85-94014575e90a\") " pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100766 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-socket-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100794 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldzfz\" (UniqueName: \"kubernetes.io/projected/8fd489df-123e-4c80-978a-49e68e6c5627-kube-api-access-ldzfz\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-systemd\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100842 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-run-openvswitch\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100867 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-run-ovn\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100889 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30ff74b0-ac70-4771-86e2-dffa09292556-env-overrides\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a280651-376b-4c63-84d9-190f0e77719c-host\") pod \"node-ca-2m2th\" (UID: \"6a280651-376b-4c63-84d9-190f0e77719c\") " pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nv8v\" (UniqueName: \"kubernetes.io/projected/6a280651-376b-4c63-84d9-190f0e77719c-kube-api-access-7nv8v\") pod \"node-ca-2m2th\" (UID: \"6a280651-376b-4c63-84d9-190f0e77719c\") " pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.100973 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f088c170-6610-4e41-ad7c-0857e37b85c4-kubelet-config\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101008 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-host\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-node-log\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101053 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-cni-netd\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-system-cni-dir\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101103 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-run-netns\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.101587 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101124 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-run-multus-certs\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101147 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101182 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f088c170-6610-4e41-ad7c-0857e37b85c4-dbus\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101218 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-kubernetes\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101237 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-sysctl-conf\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101253 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p98tz\" (UniqueName: \"kubernetes.io/projected/1a261c88-e3e3-45cd-8501-8a69827fffad-kube-api-access-p98tz\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101267 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-etc-openvswitch\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101289 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101303 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-var-lib-kubelet\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101318 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-run-ovn-kubernetes\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101331 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-cni-bin\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101345 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-run-k8s-cni-cncf-io\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ad63bd1-5947-49fb-9c85-94014575e90a-agent-certs\") pod \"konnectivity-agent-cqntp\" (UID: \"1ad63bd1-5947-49fb-9c85-94014575e90a\") " pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101381 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxc9p\" (UniqueName: \"kubernetes.io/projected/30ff74b0-ac70-4771-86e2-dffa09292556-kube-api-access-rxc9p\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.102124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.101424 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-cnibin\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.201732 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201711 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-device-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.201874 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-sys-fs\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.201874 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-sysconfig\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.201874 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-cnibin\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.201874 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg4dq\" (UniqueName: \"kubernetes.io/projected/73c352b8-b4e1-4dcd-966e-54894064139f-kube-api-access-wg4dq\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.201874 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201835 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-sys-fs\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.201874 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201824 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-device-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.201874 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201851 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-sysconfig\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gmxf\" (UniqueName: \"kubernetes.io/projected/331ee3e5-9107-4c12-b1f1-6ff406857257-kube-api-access-5gmxf\") pod \"iptables-alerter-4cx9s\" (UID: \"331ee3e5-9107-4c12-b1f1-6ff406857257\") " pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201916 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-cnibin\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.201972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-cni-dir\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202012 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-hostroot\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202039 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-os-release\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202055 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-hostroot\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202058 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a280651-376b-4c63-84d9-190f0e77719c-serviceca\") pod \"node-ca-2m2th\" (UID: \"6a280651-376b-4c63-84d9-190f0e77719c\") " pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202115 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-os-release\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202122 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-var-lib-kubelet\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202140 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45xpm\" (UniqueName: \"kubernetes.io/projected/c808ae90-63ce-47cd-9895-1b478aa0d6de-kube-api-access-45xpm\") pod \"node-resolver-hh9vx\" (UID: \"c808ae90-63ce-47cd-9895-1b478aa0d6de\") " pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.202173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202177 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-var-lib-kubelet\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202200 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-cni-dir\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-tuned\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202239 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-run-netns\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202299 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-run-netns\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202315 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c808ae90-63ce-47cd-9895-1b478aa0d6de-hosts-file\") pod \"node-resolver-hh9vx\" (UID: \"c808ae90-63ce-47cd-9895-1b478aa0d6de\") " pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-registration-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-modprobe-d\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202383 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c808ae90-63ce-47cd-9895-1b478aa0d6de-hosts-file\") pod \"node-resolver-hh9vx\" (UID: \"c808ae90-63ce-47cd-9895-1b478aa0d6de\") " pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202398 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-registration-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202414 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a261c88-e3e3-45cd-8501-8a69827fffad-tmp\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202438 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-modprobe-d\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202448 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-etc-selinux\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202470 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-run\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202485 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-sysctl-d\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202501 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202506 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 15:55:27.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202552 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-run\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202558 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a280651-376b-4c63-84d9-190f0e77719c-serviceca\") pod \"node-ca-2m2th\" (UID: \"6a280651-376b-4c63-84d9-190f0e77719c\") " pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202579 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-etc-selinux\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202633 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-run-systemd\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202661 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/331ee3e5-9107-4c12-b1f1-6ff406857257-iptables-alerter-script\") pod \"iptables-alerter-4cx9s\" (UID: \"331ee3e5-9107-4c12-b1f1-6ff406857257\") " pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202680 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-sysctl-d\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202685 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-os-release\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202681 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202707 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-daemon-config\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202701 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-run-systemd\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92w7d\" (UniqueName: \"kubernetes.io/projected/2814d1a1-a841-4022-b291-c7d78607bdfa-kube-api-access-92w7d\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202737 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-os-release\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-var-lib-openvswitch\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202786 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9t45\" (UniqueName: \"kubernetes.io/projected/a8883484-f14a-4e4f-993e-db59ef228b7f-kube-api-access-l9t45\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202807 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-sys\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-systemd-units\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202838 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-var-lib-openvswitch\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.203618 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202891 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-sys\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202897 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30ff74b0-ac70-4771-86e2-dffa09292556-ovnkube-script-lib\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202919 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-var-lib-cni-bin\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202952 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ad63bd1-5947-49fb-9c85-94014575e90a-konnectivity-ca\") pod \"konnectivity-agent-cqntp\" (UID: \"1ad63bd1-5947-49fb-9c85-94014575e90a\") " pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.202981 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-socket-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203001 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldzfz\" (UniqueName: \"kubernetes.io/projected/8fd489df-123e-4c80-978a-49e68e6c5627-kube-api-access-ldzfz\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203024 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-systemd\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-run-openvswitch\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203070 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-run-ovn\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203090 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30ff74b0-ac70-4771-86e2-dffa09292556-env-overrides\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203113 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a280651-376b-4c63-84d9-190f0e77719c-host\") pod \"node-ca-2m2th\" (UID: \"6a280651-376b-4c63-84d9-190f0e77719c\") " pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203135 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nv8v\" (UniqueName: \"kubernetes.io/projected/6a280651-376b-4c63-84d9-190f0e77719c-kube-api-access-7nv8v\") pod \"node-ca-2m2th\" (UID: \"6a280651-376b-4c63-84d9-190f0e77719c\") " pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f088c170-6610-4e41-ad7c-0857e37b85c4-kubelet-config\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203217 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-host\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203237 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-node-log\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203253 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-systemd\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203295 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-cni-netd\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.204428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203299 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-var-lib-cni-bin\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203332 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-run-openvswitch\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203355 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-run-ovn\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203445 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-socket-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203522 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30ff74b0-ac70-4771-86e2-dffa09292556-ovnkube-script-lib\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203580 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-systemd-units\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203623 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203697 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f088c170-6610-4e41-ad7c-0857e37b85c4-kubelet-config\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203703 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a280651-376b-4c63-84d9-190f0e77719c-host\") pod \"node-ca-2m2th\" (UID: \"6a280651-376b-4c63-84d9-190f0e77719c\") " pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203720 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ad63bd1-5947-49fb-9c85-94014575e90a-konnectivity-ca\") pod \"konnectivity-agent-cqntp\" (UID: \"1ad63bd1-5947-49fb-9c85-94014575e90a\") " pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203752 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30ff74b0-ac70-4771-86e2-dffa09292556-env-overrides\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203768 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-host\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203791 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-node-log\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-cni-netd\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-system-cni-dir\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203961 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-run-netns\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.203993 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-run-multus-certs\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204020 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:27.205261 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204044 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f088c170-6610-4e41-ad7c-0857e37b85c4-dbus\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204063 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-run-netns\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-kubernetes\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204071 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-run-multus-certs\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.204203 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204211 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-daemon-config\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204135 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-system-cni-dir\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204119 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-kubernetes\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204175 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f088c170-6610-4e41-ad7c-0857e37b85c4-dbus\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204214 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-sysctl-conf\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204231 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/331ee3e5-9107-4c12-b1f1-6ff406857257-iptables-alerter-script\") pod \"iptables-alerter-4cx9s\" (UID: \"331ee3e5-9107-4c12-b1f1-6ff406857257\") " pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-sysctl-conf\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.204268 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs podName:2814d1a1-a841-4022-b291-c7d78607bdfa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:27.704248378 +0000 UTC m=+3.251937684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs") pod "network-metrics-daemon-57mkr" (UID: "2814d1a1-a841-4022-b291-c7d78607bdfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204313 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p98tz\" (UniqueName: \"kubernetes.io/projected/1a261c88-e3e3-45cd-8501-8a69827fffad-kube-api-access-p98tz\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204338 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-etc-openvswitch\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204363 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-var-lib-kubelet\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.206438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204416 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-etc-openvswitch\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204420 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-run-ovn-kubernetes\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204450 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-cni-bin\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.204477 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-run-k8s-cni-cncf-io\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204508 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-run-ovn-kubernetes\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204516 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ad63bd1-5947-49fb-9c85-94014575e90a-agent-certs\") pod \"konnectivity-agent-cqntp\" (UID: \"1ad63bd1-5947-49fb-9c85-94014575e90a\") " pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204532 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-cni-bin\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204466 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-var-lib-kubelet\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.204537 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret podName:f088c170-6610-4e41-ad7c-0857e37b85c4 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:27.704520814 +0000 UTC m=+3.252210123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret") pod "global-pull-secret-syncer-t8nbw" (UID: "f088c170-6610-4e41-ad7c-0857e37b85c4") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204549 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-run-k8s-cni-cncf-io\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxc9p\" (UniqueName: \"kubernetes.io/projected/30ff74b0-ac70-4771-86e2-dffa09292556-kube-api-access-rxc9p\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204600 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-cnibin\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-etc-kubernetes\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-system-cni-dir\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204670 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73c352b8-b4e1-4dcd-966e-54894064139f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.207278 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204676 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-etc-kubernetes\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204685 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-slash\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204702 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-log-socket\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204727 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-cnibin\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-socket-dir-parent\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204742 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c352b8-b4e1-4dcd-966e-54894064139f-system-cni-dir\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204759 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-var-lib-cni-multus\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204768 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fd489df-123e-4c80-978a-49e68e6c5627-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204800 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-lib-modules\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204839 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-host-var-lib-cni-multus\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204840 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-log-socket\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204802 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-slash\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204894 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-socket-dir-parent\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204909 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a261c88-e3e3-45cd-8501-8a69827fffad-lib-modules\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.204961 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73c352b8-b4e1-4dcd-966e-54894064139f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30ff74b0-ac70-4771-86e2-dffa09292556-ovnkube-config\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205068 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/331ee3e5-9107-4c12-b1f1-6ff406857257-host-slash\") pod \"iptables-alerter-4cx9s\" (UID: \"331ee3e5-9107-4c12-b1f1-6ff406857257\") " pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8883484-f14a-4e4f-993e-db59ef228b7f-cni-binary-copy\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205131 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-conf-dir\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c808ae90-63ce-47cd-9895-1b478aa0d6de-tmp-dir\") pod \"node-resolver-hh9vx\" (UID: \"c808ae90-63ce-47cd-9895-1b478aa0d6de\") " pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73c352b8-b4e1-4dcd-966e-54894064139f-cni-binary-copy\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205210 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-kubelet\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205236 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30ff74b0-ac70-4771-86e2-dffa09292556-ovn-node-metrics-cert\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205286 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73c352b8-b4e1-4dcd-966e-54894064139f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205491 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73c352b8-b4e1-4dcd-966e-54894064139f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205567 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/331ee3e5-9107-4c12-b1f1-6ff406857257-host-slash\") pod \"iptables-alerter-4cx9s\" (UID: \"331ee3e5-9107-4c12-b1f1-6ff406857257\") " pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205578 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8883484-f14a-4e4f-993e-db59ef228b7f-multus-conf-dir\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205671 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8883484-f14a-4e4f-993e-db59ef228b7f-cni-binary-copy\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205734 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ff74b0-ac70-4771-86e2-dffa09292556-host-kubelet\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205788 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30ff74b0-ac70-4771-86e2-dffa09292556-ovnkube-config\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.205842 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c808ae90-63ce-47cd-9895-1b478aa0d6de-tmp-dir\") pod \"node-resolver-hh9vx\" (UID: \"c808ae90-63ce-47cd-9895-1b478aa0d6de\") " pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.206075 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73c352b8-b4e1-4dcd-966e-54894064139f-cni-binary-copy\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.206087 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a261c88-e3e3-45cd-8501-8a69827fffad-etc-tuned\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.206101 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a261c88-e3e3-45cd-8501-8a69827fffad-tmp\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.206795 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ad63bd1-5947-49fb-9c85-94014575e90a-agent-certs\") pod \"konnectivity-agent-cqntp\" (UID: \"1ad63bd1-5947-49fb-9c85-94014575e90a\") " pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:27.208949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.207378 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30ff74b0-ac70-4771-86e2-dffa09292556-ovn-node-metrics-cert\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.209739 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.209199 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:27.209739 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.209220 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:27.209739 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.209247 2582 projected.go:196] Error preparing data for projected volume kube-api-access-qdcdc for pod openshift-network-diagnostics/network-check-target-95nwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:27.209739 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.209295 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc podName:a308af1b-a5a2-48e7-99fd-08e2d1207ab3 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:27.709283616 +0000 UTC m=+3.256972924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qdcdc" (UniqueName: "kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc") pod "network-check-target-95nwt" (UID: "a308af1b-a5a2-48e7-99fd-08e2d1207ab3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:27.211338 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.211319 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg4dq\" (UniqueName: \"kubernetes.io/projected/73c352b8-b4e1-4dcd-966e-54894064139f-kube-api-access-wg4dq\") pod \"multus-additional-cni-plugins-25qj9\" (UID: \"73c352b8-b4e1-4dcd-966e-54894064139f\") " pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.211491 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.211477 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45xpm\" (UniqueName: \"kubernetes.io/projected/c808ae90-63ce-47cd-9895-1b478aa0d6de-kube-api-access-45xpm\") pod \"node-resolver-hh9vx\" (UID: \"c808ae90-63ce-47cd-9895-1b478aa0d6de\") " pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.211596 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.211582 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92w7d\" (UniqueName: \"kubernetes.io/projected/2814d1a1-a841-4022-b291-c7d78607bdfa-kube-api-access-92w7d\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:27.211679 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.211661 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gmxf\" (UniqueName: \"kubernetes.io/projected/331ee3e5-9107-4c12-b1f1-6ff406857257-kube-api-access-5gmxf\") pod \"iptables-alerter-4cx9s\" (UID: \"331ee3e5-9107-4c12-b1f1-6ff406857257\") " pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.214769 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.214748 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p98tz\" (UniqueName: \"kubernetes.io/projected/1a261c88-e3e3-45cd-8501-8a69827fffad-kube-api-access-p98tz\") pod \"tuned-j87kc\" (UID: \"1a261c88-e3e3-45cd-8501-8a69827fffad\") " pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.214973 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.214924 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nv8v\" (UniqueName: \"kubernetes.io/projected/6a280651-376b-4c63-84d9-190f0e77719c-kube-api-access-7nv8v\") pod \"node-ca-2m2th\" (UID: \"6a280651-376b-4c63-84d9-190f0e77719c\") " pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.215778 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.215723 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldzfz\" (UniqueName: \"kubernetes.io/projected/8fd489df-123e-4c80-978a-49e68e6c5627-kube-api-access-ldzfz\") pod \"aws-ebs-csi-driver-node-85z52\" (UID: \"8fd489df-123e-4c80-978a-49e68e6c5627\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.216594 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.216134 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9t45\" (UniqueName: \"kubernetes.io/projected/a8883484-f14a-4e4f-993e-db59ef228b7f-kube-api-access-l9t45\") pod \"multus-s2xvp\" (UID: \"a8883484-f14a-4e4f-993e-db59ef228b7f\") " pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.218891 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.218867 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxc9p\" (UniqueName: \"kubernetes.io/projected/30ff74b0-ac70-4771-86e2-dffa09292556-kube-api-access-rxc9p\") pod \"ovnkube-node-d88zt\" (UID: \"30ff74b0-ac70-4771-86e2-dffa09292556\") " pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.252491 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.252476 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" Jul 10 15:55:27.266483 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.266393 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j87kc" Jul 10 15:55:27.287468 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.287450 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2m2th" Jul 10 15:55:27.307272 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.307251 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25qj9" Jul 10 15:55:27.315237 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.315220 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s2xvp" Jul 10 15:55:27.325761 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.325746 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:27.346016 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.345998 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:27.351445 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.351427 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hh9vx" Jul 10 15:55:27.365943 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.365909 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4cx9s" Jul 10 15:55:27.368483 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.368452 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357eff29f0c7287183aafb08914a401a.slice/crio-d076ec3966a77291a39446a5faa0349422dcc6e331ab778fcec0ad286ae3bf44 WatchSource:0}: Error finding container d076ec3966a77291a39446a5faa0349422dcc6e331ab778fcec0ad286ae3bf44: Status 404 returned error can't find the container with id d076ec3966a77291a39446a5faa0349422dcc6e331ab778fcec0ad286ae3bf44 Jul 10 15:55:27.369005 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.368985 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53237d582513d117bd08a5146cf4f447.slice/crio-1068200f73ad80a2a64b6ce05fa71a50bdc5928da1448c88dd136b164bf11d93 WatchSource:0}: Error finding container 1068200f73ad80a2a64b6ce05fa71a50bdc5928da1448c88dd136b164bf11d93: Status 404 returned error can't find the container with id 1068200f73ad80a2a64b6ce05fa71a50bdc5928da1448c88dd136b164bf11d93 Jul 10 15:55:27.369541 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.369524 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc808ae90_63ce_47cd_9895_1b478aa0d6de.slice/crio-ccf8421ab2a61609060d7bd8ecae79c5c98c739b991a1d6976f12f06ea0a4c30 WatchSource:0}: Error finding container ccf8421ab2a61609060d7bd8ecae79c5c98c739b991a1d6976f12f06ea0a4c30: Status 404 returned error can't find the container with id ccf8421ab2a61609060d7bd8ecae79c5c98c739b991a1d6976f12f06ea0a4c30 Jul 10 15:55:27.370687 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.370598 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad63bd1_5947_49fb_9c85_94014575e90a.slice/crio-83934580a0fdbb953d90a500687163e1a5356693a9ccebdace41f3c16ada3b33 WatchSource:0}: Error finding container 83934580a0fdbb953d90a500687163e1a5356693a9ccebdace41f3c16ada3b33: Status 404 returned error can't find the container with id 83934580a0fdbb953d90a500687163e1a5356693a9ccebdace41f3c16ada3b33 Jul 10 15:55:27.372847 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.372832 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 15:55:27.377092 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.377074 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331ee3e5_9107_4c12_b1f1_6ff406857257.slice/crio-d2b89146be6470bd55b28984b0460be2dbf4eb8a79c34d3cabd61864f3b96d85 WatchSource:0}: Error finding container d2b89146be6470bd55b28984b0460be2dbf4eb8a79c34d3cabd61864f3b96d85: Status 404 returned error can't find the container with id d2b89146be6470bd55b28984b0460be2dbf4eb8a79c34d3cabd61864f3b96d85 Jul 10 15:55:27.607510 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.607477 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a261c88_e3e3_45cd_8501_8a69827fffad.slice/crio-988287ba273672b3b133f4ea50ac04fe543a918aa20d6eaae792be453555383a WatchSource:0}: Error finding container 988287ba273672b3b133f4ea50ac04fe543a918aa20d6eaae792be453555383a: Status 404 returned error can't find the container with id 988287ba273672b3b133f4ea50ac04fe543a918aa20d6eaae792be453555383a Jul 10 15:55:27.654539 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.654516 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ff74b0_ac70_4771_86e2_dffa09292556.slice/crio-666b78b5060409c2c29da22107d4cea1be73bd35790da0f86965c18979c49464 WatchSource:0}: Error finding container 666b78b5060409c2c29da22107d4cea1be73bd35790da0f86965c18979c49464: Status 404 returned error can't find the container with id 666b78b5060409c2c29da22107d4cea1be73bd35790da0f86965c18979c49464 Jul 10 15:55:27.672421 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.672400 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c352b8_b4e1_4dcd_966e_54894064139f.slice/crio-0770f7b66bd39641770adcf46e0f561674a22958b439c16c436eebcfb3929871 WatchSource:0}: Error finding container 0770f7b66bd39641770adcf46e0f561674a22958b439c16c436eebcfb3929871: Status 404 returned error can't find the container with id 0770f7b66bd39641770adcf46e0f561674a22958b439c16c436eebcfb3929871 Jul 10 15:55:27.709100 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.709080 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:27.709187 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.709112 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:27.709232 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.709217 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:27.709272 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.709256 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:27.709272 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.709267 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs podName:2814d1a1-a841-4022-b291-c7d78607bdfa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:28.709253301 +0000 UTC m=+4.256942588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs") pod "network-metrics-daemon-57mkr" (UID: "2814d1a1-a841-4022-b291-c7d78607bdfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:27.709347 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.709289 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret podName:f088c170-6610-4e41-ad7c-0857e37b85c4 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:28.709277742 +0000 UTC m=+4.256967034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret") pod "global-pull-secret-syncer-t8nbw" (UID: "f088c170-6610-4e41-ad7c-0857e37b85c4") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:27.809761 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.809689 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:27.809970 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.809850 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:27.809970 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.809870 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:27.809970 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.809882 2582 projected.go:196] Error preparing data for projected volume kube-api-access-qdcdc for pod openshift-network-diagnostics/network-check-target-95nwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:27.809970 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:27.809957 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc podName:a308af1b-a5a2-48e7-99fd-08e2d1207ab3 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:28.809922561 +0000 UTC m=+4.357611849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdcdc" (UniqueName: "kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc") pod "network-check-target-95nwt" (UID: "a308af1b-a5a2-48e7-99fd-08e2d1207ab3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:27.831862 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.831830 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd489df_123e_4c80_978a_49e68e6c5627.slice/crio-fd77b91925d819bb42b4b6424d7617be51e078cf9f348e71b7079947f549028f WatchSource:0}: Error finding container fd77b91925d819bb42b4b6424d7617be51e078cf9f348e71b7079947f549028f: Status 404 returned error can't find the container with id fd77b91925d819bb42b4b6424d7617be51e078cf9f348e71b7079947f549028f Jul 10 15:55:27.837884 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:55:27.837857 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a280651_376b_4c63_84d9_190f0e77719c.slice/crio-ca28ee4680e0b03fdd6178a72425546729350d1daff708bb069f3b59a258b16d WatchSource:0}: Error finding container ca28ee4680e0b03fdd6178a72425546729350d1daff708bb069f3b59a258b16d: Status 404 returned error can't find the container with id ca28ee4680e0b03fdd6178a72425546729350d1daff708bb069f3b59a258b16d Jul 10 15:55:27.966493 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.966386 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 15:50:26 +0000 UTC" deadline="2028-01-31 16:50:31.832026674 +0000 UTC" Jul 10 15:55:27.966493 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:27.966451 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13680h55m3.865579576s" Jul 10 15:55:28.136658 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.136048 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:28.136658 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.136174 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:28.137132 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.136972 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:28.137132 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.137071 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:28.145670 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.145623 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s2xvp" event={"ID":"a8883484-f14a-4e4f-993e-db59ef228b7f","Type":"ContainerStarted","Data":"5e7b9769695fdff04de794ae895fbc98edb063f2a1cf701f573c72a6482ae617"} Jul 10 15:55:28.153418 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.153329 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2m2th" event={"ID":"6a280651-376b-4c63-84d9-190f0e77719c","Type":"ContainerStarted","Data":"ca28ee4680e0b03fdd6178a72425546729350d1daff708bb069f3b59a258b16d"} Jul 10 15:55:28.158726 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.158657 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" event={"ID":"8fd489df-123e-4c80-978a-49e68e6c5627","Type":"ContainerStarted","Data":"fd77b91925d819bb42b4b6424d7617be51e078cf9f348e71b7079947f549028f"} Jul 10 15:55:28.163467 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.163406 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25qj9" event={"ID":"73c352b8-b4e1-4dcd-966e-54894064139f","Type":"ContainerStarted","Data":"0770f7b66bd39641770adcf46e0f561674a22958b439c16c436eebcfb3929871"} Jul 10 15:55:28.169911 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.169766 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" event={"ID":"30ff74b0-ac70-4771-86e2-dffa09292556","Type":"ContainerStarted","Data":"666b78b5060409c2c29da22107d4cea1be73bd35790da0f86965c18979c49464"} Jul 10 15:55:28.177486 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.177425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j87kc" event={"ID":"1a261c88-e3e3-45cd-8501-8a69827fffad","Type":"ContainerStarted","Data":"988287ba273672b3b133f4ea50ac04fe543a918aa20d6eaae792be453555383a"} Jul 10 15:55:28.196654 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.196624 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4cx9s" event={"ID":"331ee3e5-9107-4c12-b1f1-6ff406857257","Type":"ContainerStarted","Data":"d2b89146be6470bd55b28984b0460be2dbf4eb8a79c34d3cabd61864f3b96d85"} Jul 10 15:55:28.212789 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.212472 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cqntp" event={"ID":"1ad63bd1-5947-49fb-9c85-94014575e90a","Type":"ContainerStarted","Data":"83934580a0fdbb953d90a500687163e1a5356693a9ccebdace41f3c16ada3b33"} Jul 10 15:55:28.217172 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.217091 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hh9vx" event={"ID":"c808ae90-63ce-47cd-9895-1b478aa0d6de","Type":"ContainerStarted","Data":"ccf8421ab2a61609060d7bd8ecae79c5c98c739b991a1d6976f12f06ea0a4c30"} Jul 10 15:55:28.222810 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.222784 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" event={"ID":"357eff29f0c7287183aafb08914a401a","Type":"ContainerStarted","Data":"d076ec3966a77291a39446a5faa0349422dcc6e331ab778fcec0ad286ae3bf44"} Jul 10 15:55:28.243037 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.242812 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" event={"ID":"53237d582513d117bd08a5146cf4f447","Type":"ContainerStarted","Data":"1068200f73ad80a2a64b6ce05fa71a50bdc5928da1448c88dd136b164bf11d93"} Jul 10 15:55:28.717097 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.717063 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:28.717282 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.717112 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:28.717282 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.717215 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:28.717282 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.717241 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:28.717282 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.717282 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs podName:2814d1a1-a841-4022-b291-c7d78607bdfa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:30.717260719 +0000 UTC m=+6.264950023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs") pod "network-metrics-daemon-57mkr" (UID: "2814d1a1-a841-4022-b291-c7d78607bdfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:28.717481 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.717301 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret podName:f088c170-6610-4e41-ad7c-0857e37b85c4 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:30.717291852 +0000 UTC m=+6.264981140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret") pod "global-pull-secret-syncer-t8nbw" (UID: "f088c170-6610-4e41-ad7c-0857e37b85c4") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:28.818690 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.818123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:28.818690 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.818292 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:28.818690 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.818311 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:28.818690 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.818323 2582 projected.go:196] Error preparing data for projected volume kube-api-access-qdcdc for pod openshift-network-diagnostics/network-check-target-95nwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:28.818690 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:28.818378 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc podName:a308af1b-a5a2-48e7-99fd-08e2d1207ab3 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:30.818359831 +0000 UTC m=+6.366049120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdcdc" (UniqueName: "kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc") pod "network-check-target-95nwt" (UID: "a308af1b-a5a2-48e7-99fd-08e2d1207ab3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:28.967077 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.967015 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 15:50:26 +0000 UTC" deadline="2028-04-07 16:52:51.086573434 +0000 UTC" Jul 10 15:55:28.967077 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:28.967051 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15288h57m22.119526984s" Jul 10 15:55:29.133467 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:29.133256 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:29.133467 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:29.133389 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:30.133766 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:30.133735 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:30.134598 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:30.133781 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:30.134598 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.133865 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:30.134598 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.134299 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:30.739188 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:30.738443 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:30.739188 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:30.738495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:30.739188 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.738649 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:30.739188 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.738709 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret podName:f088c170-6610-4e41-ad7c-0857e37b85c4 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:34.738690217 +0000 UTC m=+10.286379506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret") pod "global-pull-secret-syncer-t8nbw" (UID: "f088c170-6610-4e41-ad7c-0857e37b85c4") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:30.739188 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.739099 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:30.739188 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.739155 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs podName:2814d1a1-a841-4022-b291-c7d78607bdfa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:34.739137577 +0000 UTC m=+10.286826868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs") pod "network-metrics-daemon-57mkr" (UID: "2814d1a1-a841-4022-b291-c7d78607bdfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:30.839338 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:30.839305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:30.839519 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.839461 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:30.839519 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.839483 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:30.839519 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.839496 2582 projected.go:196] Error preparing data for projected volume kube-api-access-qdcdc for pod openshift-network-diagnostics/network-check-target-95nwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:30.839682 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:30.839556 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc podName:a308af1b-a5a2-48e7-99fd-08e2d1207ab3 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:34.839537882 +0000 UTC m=+10.387227172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdcdc" (UniqueName: "kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc") pod "network-check-target-95nwt" (UID: "a308af1b-a5a2-48e7-99fd-08e2d1207ab3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:31.134626 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:31.134080 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:31.134626 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:31.134222 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:32.133860 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:32.133822 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:32.134061 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:32.133981 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:32.134061 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:32.134035 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:32.134174 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:32.134152 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:33.133269 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:33.133234 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:33.133698 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:33.133367 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:34.133258 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:34.133228 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:34.133441 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.133365 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:34.133911 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:34.133727 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:34.133911 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.133826 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:34.771656 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:34.771105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:34.771656 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:34.771154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:34.771656 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.771268 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:34.771656 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.771308 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:34.771656 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.771334 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret podName:f088c170-6610-4e41-ad7c-0857e37b85c4 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:42.771315477 +0000 UTC m=+18.319004784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret") pod "global-pull-secret-syncer-t8nbw" (UID: "f088c170-6610-4e41-ad7c-0857e37b85c4") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:34.771656 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.771375 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs podName:2814d1a1-a841-4022-b291-c7d78607bdfa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:42.77135686 +0000 UTC m=+18.319046150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs") pod "network-metrics-daemon-57mkr" (UID: "2814d1a1-a841-4022-b291-c7d78607bdfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:34.872092 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:34.872062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:34.872289 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.872208 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:34.872289 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.872229 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:34.872289 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.872240 2582 projected.go:196] Error preparing data for projected volume kube-api-access-qdcdc for pod openshift-network-diagnostics/network-check-target-95nwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:34.872437 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:34.872298 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc podName:a308af1b-a5a2-48e7-99fd-08e2d1207ab3 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:42.872280154 +0000 UTC m=+18.419969441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdcdc" (UniqueName: "kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc") pod "network-check-target-95nwt" (UID: "a308af1b-a5a2-48e7-99fd-08e2d1207ab3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:35.133152 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:35.133067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:35.133294 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:35.133198 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:36.134312 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:36.134271 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:36.134760 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:36.134383 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:36.134760 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:36.134755 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:36.134873 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:36.134852 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:37.133380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:37.133346 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:37.133543 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:37.133478 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:38.136421 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:38.136395 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:38.136874 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:38.136395 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:38.136874 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:38.136516 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:38.136874 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:38.136597 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:39.133384 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:39.133357 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:39.133542 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:39.133475 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:40.136509 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:40.136483 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:40.136955 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:40.136483 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:40.136955 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:40.136593 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:40.136955 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:40.136661 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:41.133922 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:41.133882 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:41.134100 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:41.134023 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:42.133412 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:42.133380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:42.133864 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.133536 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:42.133864 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:42.133595 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:42.133864 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.133672 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:42.833602 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:42.833376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:42.833783 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:42.833619 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:42.833783 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.833541 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:42.833783 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.833734 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:42.833783 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.833757 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs podName:2814d1a1-a841-4022-b291-c7d78607bdfa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:58.83373225 +0000 UTC m=+34.381421536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs") pod "network-metrics-daemon-57mkr" (UID: "2814d1a1-a841-4022-b291-c7d78607bdfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:42.833783 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.833782 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret podName:f088c170-6610-4e41-ad7c-0857e37b85c4 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:58.83376632 +0000 UTC m=+34.381455610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret") pod "global-pull-secret-syncer-t8nbw" (UID: "f088c170-6610-4e41-ad7c-0857e37b85c4") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:42.933940 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:42.933889 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:42.934125 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.934047 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:42.934125 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.934068 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:42.934125 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.934079 2582 projected.go:196] Error preparing data for projected volume kube-api-access-qdcdc for pod openshift-network-diagnostics/network-check-target-95nwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:42.934272 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:42.934145 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc podName:a308af1b-a5a2-48e7-99fd-08e2d1207ab3 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:58.934126973 +0000 UTC m=+34.481816260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdcdc" (UniqueName: "kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc") pod "network-check-target-95nwt" (UID: "a308af1b-a5a2-48e7-99fd-08e2d1207ab3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:43.133853 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:43.133759 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:43.134317 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:43.133886 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:44.133277 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:44.133245 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:44.133462 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:44.133369 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:44.133462 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:44.133436 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:44.133573 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:44.133548 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:45.133779 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:45.133745 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:45.134187 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:45.133863 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:46.136669 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:46.136631 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:46.137130 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:46.136631 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:46.137130 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:46.136769 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:46.137130 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:46.136843 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:47.133756 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:47.133712 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:47.133956 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:47.133850 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:48.134561 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.133836 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:48.134561 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:48.134229 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:48.134561 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.134066 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:48.134561 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:48.134322 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:48.297460 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.297278 2582 generic.go:356] "Generic (PLEG): container finished" podID="73c352b8-b4e1-4dcd-966e-54894064139f" containerID="e373ddfb505708ab10616331b7c38c7a427b9e27218e81b33ccba44e30b02213" exitCode=0 Jul 10 15:55:48.297581 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.297362 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25qj9" event={"ID":"73c352b8-b4e1-4dcd-966e-54894064139f","Type":"ContainerDied","Data":"e373ddfb505708ab10616331b7c38c7a427b9e27218e81b33ccba44e30b02213"} Jul 10 15:55:48.299834 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.299810 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" event={"ID":"30ff74b0-ac70-4771-86e2-dffa09292556","Type":"ContainerStarted","Data":"f4402b10e627bed9a1b620b5b10828b02cdf19141422d0860ecca042c96f035d"} Jul 10 15:55:48.299958 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.299877 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" event={"ID":"30ff74b0-ac70-4771-86e2-dffa09292556","Type":"ContainerStarted","Data":"45f32516d68d49732a9a2675075ef3fc8ee09e053746bd83f82f5312a84e810f"} Jul 10 15:55:48.299958 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.299923 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" event={"ID":"30ff74b0-ac70-4771-86e2-dffa09292556","Type":"ContainerStarted","Data":"a4b74091cfebec6bc08c59bde542c099b756437721b5b838ed66abeca760b2a1"} Jul 10 15:55:48.300070 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.299978 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" event={"ID":"30ff74b0-ac70-4771-86e2-dffa09292556","Type":"ContainerStarted","Data":"b7d41cf98a83530022ff300d21191b74adc0c69a84d350b45f9d6b92ead4b4f5"} Jul 10 15:55:48.301227 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.301194 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j87kc" event={"ID":"1a261c88-e3e3-45cd-8501-8a69827fffad","Type":"ContainerStarted","Data":"1429f23046e2857cf980fbe09880e119b5ffaac16f24306a215b899cc9d5b8d7"} Jul 10 15:55:48.302525 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.302504 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cqntp" event={"ID":"1ad63bd1-5947-49fb-9c85-94014575e90a","Type":"ContainerStarted","Data":"839befd817bf55401e37dffafd3bae76086d37b0a3d9ee102efdac783e591559"} Jul 10 15:55:48.303905 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.303885 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hh9vx" event={"ID":"c808ae90-63ce-47cd-9895-1b478aa0d6de","Type":"ContainerStarted","Data":"8825fe513defe8780592d0c1f4b34db1914d27f1d6b89a0413fc2dd25103d3b7"} Jul 10 15:55:48.305277 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.305256 2582 generic.go:356] "Generic (PLEG): container finished" podID="357eff29f0c7287183aafb08914a401a" containerID="89ae9592964e1a8d47b0c021b64770e1d76c3efed7de499dd921130ae7f94762" exitCode=0 Jul 10 15:55:48.305364 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.305317 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" event={"ID":"357eff29f0c7287183aafb08914a401a","Type":"ContainerDied","Data":"89ae9592964e1a8d47b0c021b64770e1d76c3efed7de499dd921130ae7f94762"} Jul 10 15:55:48.306553 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.306534 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" event={"ID":"53237d582513d117bd08a5146cf4f447","Type":"ContainerStarted","Data":"309482e67652ce75ce425056948cea179ce8208aab813a02bac30962bcc8b64b"} Jul 10 15:55:48.308059 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.308040 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s2xvp" event={"ID":"a8883484-f14a-4e4f-993e-db59ef228b7f","Type":"ContainerStarted","Data":"fc657631b922dc2b31ecd8eb8e7dcbf9631a7f04efd05e93bb78439423558904"} Jul 10 15:55:48.309469 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.309446 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2m2th" event={"ID":"6a280651-376b-4c63-84d9-190f0e77719c","Type":"ContainerStarted","Data":"3e4f0a41104b9f201d3355390d516407785478b8d470b014e9203e94d8865325"} Jul 10 15:55:48.310845 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.310827 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" event={"ID":"8fd489df-123e-4c80-978a-49e68e6c5627","Type":"ContainerStarted","Data":"1ede1a7af93650a441c21a50a57c47044eb6e36e79970f801b8bfee90b668632"} Jul 10 15:55:48.339849 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.339808 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j87kc" podStartSLOduration=2.279220206 podStartE2EDuration="22.33979334s" totalImagesPullingTime="20.060573134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:48.33917893 +0000 UTC m=+23.886868238" watchObservedRunningTime="2026-07-10 15:55:48.33979334 +0000 UTC m=+23.887482649" Jul 10 15:55:48.372826 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.372772 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2m2th" podStartSLOduration=2.610400518 podStartE2EDuration="22.372753032s" totalImagesPullingTime="19.762352514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:48.355682902 +0000 UTC m=+23.903372211" watchObservedRunningTime="2026-07-10 15:55:48.372753032 +0000 UTC m=+23.920442342" Jul 10 15:55:48.373719 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.373388 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" podStartSLOduration=22.373375872 podStartE2EDuration="22.373375872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:48.372571864 +0000 UTC m=+23.920261174" watchObservedRunningTime="2026-07-10 15:55:48.373375872 +0000 UTC m=+23.921065182" Jul 10 15:55:48.395049 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.395008 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s2xvp" podStartSLOduration=2.730061326 podStartE2EDuration="22.394993232s" totalImagesPullingTime="19.664931906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:48.394609368 +0000 UTC m=+23.942298677" watchObservedRunningTime="2026-07-10 15:55:48.394993232 +0000 UTC m=+23.942682540" Jul 10 15:55:48.409904 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.409867 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cqntp" podStartSLOduration=2.136888392 podStartE2EDuration="22.409852686s" totalImagesPullingTime="20.272964294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:48.409410727 +0000 UTC m=+23.957100035" watchObservedRunningTime="2026-07-10 15:55:48.409852686 +0000 UTC m=+23.957541993" Jul 10 15:55:48.426354 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:48.426314 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hh9vx" podStartSLOduration=2.15391853 podStartE2EDuration="22.426299032s" totalImagesPullingTime="20.272380502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:48.425593209 +0000 UTC m=+23.973282520" watchObservedRunningTime="2026-07-10 15:55:48.426299032 +0000 UTC m=+23.973988341" Jul 10 15:55:49.133600 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.133568 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:49.133820 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:49.133705 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:49.315381 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.315348 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" event={"ID":"30ff74b0-ac70-4771-86e2-dffa09292556","Type":"ContainerStarted","Data":"1dc23aba8fbed2be32f8cfa67d04e5d81419a9ad43e497f16fb145469a2fcad8"} Jul 10 15:55:49.315759 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.315441 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" event={"ID":"30ff74b0-ac70-4771-86e2-dffa09292556","Type":"ContainerStarted","Data":"0f5f600d92e2c2056936a8b935a29eaf750a3e31567691bc93a95cc97986c19d"} Jul 10 15:55:49.316765 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.316741 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4cx9s" event={"ID":"331ee3e5-9107-4c12-b1f1-6ff406857257","Type":"ContainerStarted","Data":"eedc2a3d9bfcb3c0f2e0ca2415aea32feefdc8ac8f7e2ac6d3fc1b97befd1cc3"} Jul 10 15:55:49.318358 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.318321 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" event={"ID":"357eff29f0c7287183aafb08914a401a","Type":"ContainerStarted","Data":"257775cc338a147d5aa374a06ff64838f5f8aedcb4b0dfa7271e94403f0ff717"} Jul 10 15:55:49.331886 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.331837 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4cx9s" podStartSLOduration=3.040641891 podStartE2EDuration="23.331825794s" totalImagesPullingTime="20.291183903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:49.331751913 +0000 UTC m=+24.879441221" watchObservedRunningTime="2026-07-10 15:55:49.331825794 +0000 UTC m=+24.879515103" Jul 10 15:55:49.346942 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.346890 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" podStartSLOduration=23.34687896 podStartE2EDuration="23.34687896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:49.346392204 +0000 UTC m=+24.894081516" watchObservedRunningTime="2026-07-10 15:55:49.34687896 +0000 UTC m=+24.894568269" Jul 10 15:55:49.551922 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.551900 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 15:55:49.931909 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.931795 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T15:55:49.551916943Z","UUID":"89cc91bd-2702-4cf2-88af-cdb4f3e4d92c","Handler":null,"Name":"","Endpoint":""} Jul 10 15:55:49.933412 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.933392 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 15:55:49.933545 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:49.933435 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 15:55:50.133791 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:50.133759 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:50.133983 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:50.133755 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:50.133983 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:50.133893 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:50.134102 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:50.133994 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:50.322552 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:50.322474 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" event={"ID":"8fd489df-123e-4c80-978a-49e68e6c5627","Type":"ContainerStarted","Data":"b21a3ca0827a89918097c38fc5192573c27098707db9a845620b557c4ea88705"} Jul 10 15:55:51.133584 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:51.133512 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:51.133812 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:51.133632 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:51.326867 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:51.326828 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" event={"ID":"8fd489df-123e-4c80-978a-49e68e6c5627","Type":"ContainerStarted","Data":"eaba578b5aadf0140302dcb81329dab53022d5458a2d0706cc6561ca5f2d02f5"} Jul 10 15:55:51.332396 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:51.332362 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" event={"ID":"30ff74b0-ac70-4771-86e2-dffa09292556","Type":"ContainerStarted","Data":"cf300f3a945b77bb874c9ddf30dc779431493a40ebc269774343840b7731bc7d"} Jul 10 15:55:51.349964 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:51.349908 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85z52" podStartSLOduration=2.957061258 podStartE2EDuration="25.349894032s" totalImagesPullingTime="22.392832774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:51.345423034 +0000 UTC m=+26.893112342" watchObservedRunningTime="2026-07-10 15:55:51.349894032 +0000 UTC m=+26.897583342" Jul 10 15:55:51.715789 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:51.715751 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:51.716442 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:51.716418 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:52.133880 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:52.133788 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:52.134061 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:52.133801 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:52.134061 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:52.133911 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:52.134061 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:52.134012 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:52.335153 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:52.335121 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:52.335569 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:52.335526 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cqntp" Jul 10 15:55:53.133517 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:53.133484 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:53.133675 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:53.133627 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:54.133341 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:54.133310 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:54.134053 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:54.133407 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:54.134053 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:54.133480 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:54.134053 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:54.133571 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:54.342815 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:54.342782 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" event={"ID":"30ff74b0-ac70-4771-86e2-dffa09292556","Type":"ContainerStarted","Data":"256adf78724fd66172ec61bc5125ff5bd19f8235c9fce3b2021439b3291acf9c"} Jul 10 15:55:54.343032 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:54.343020 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:54.344600 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:54.344575 2582 generic.go:356] "Generic (PLEG): container finished" podID="73c352b8-b4e1-4dcd-966e-54894064139f" containerID="3baa621713bcf91c05a2ea7eae66dad2978af5919cb87e776bfa3296f7d28d5b" exitCode=0 Jul 10 15:55:54.344715 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:54.344642 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25qj9" event={"ID":"73c352b8-b4e1-4dcd-966e-54894064139f","Type":"ContainerDied","Data":"3baa621713bcf91c05a2ea7eae66dad2978af5919cb87e776bfa3296f7d28d5b"} Jul 10 15:55:54.358482 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:54.358457 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:54.371476 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:54.371432 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" podStartSLOduration=8.309973274 podStartE2EDuration="28.3714126s" totalImagesPullingTime="20.061439326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:54.369649303 +0000 UTC m=+29.917338594" watchObservedRunningTime="2026-07-10 15:55:54.3714126 +0000 UTC m=+29.919101910" Jul 10 15:55:55.133444 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.133198 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:55.134040 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:55.133576 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:55.347431 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.347396 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:55.347636 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.347466 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:55.364221 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.364193 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:55:55.404568 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.404487 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8nbw"] Jul 10 15:55:55.404704 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.404601 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:55.404704 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:55.404680 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:55.408039 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.408012 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-57mkr"] Jul 10 15:55:55.408156 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.408148 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:55.408277 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:55.408254 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:55.408648 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.408628 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-95nwt"] Jul 10 15:55:55.408721 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:55.408711 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:55.408801 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:55.408783 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:56.350945 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:56.350898 2582 generic.go:356] "Generic (PLEG): container finished" podID="73c352b8-b4e1-4dcd-966e-54894064139f" containerID="6c579629ff49b74654730863c019ecc8dee9be6386127951777196f8db502562" exitCode=0 Jul 10 15:55:56.351351 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:56.350983 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25qj9" event={"ID":"73c352b8-b4e1-4dcd-966e-54894064139f","Type":"ContainerDied","Data":"6c579629ff49b74654730863c019ecc8dee9be6386127951777196f8db502562"} Jul 10 15:55:57.133869 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:57.133833 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:57.134447 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:57.133899 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:57.134447 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:57.133848 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:57.134447 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:57.134013 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:57.134447 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:57.134157 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:57.134447 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:57.134249 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:55:57.500189 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:57.500169 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hh9vx_c808ae90-63ce-47cd-9895-1b478aa0d6de/dns-node-resolver/0.log" Jul 10 15:55:58.271494 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:58.271463 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2m2th_6a280651-376b-4c63-84d9-190f0e77719c/node-ca/0.log" Jul 10 15:55:58.359537 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:58.359505 2582 generic.go:356] "Generic (PLEG): container finished" podID="73c352b8-b4e1-4dcd-966e-54894064139f" containerID="5d4fb72f925e6fc19d552feea3dba81b920c7da78806246764d98f9b400b6d08" exitCode=0 Jul 10 15:55:58.359537 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:58.359539 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25qj9" event={"ID":"73c352b8-b4e1-4dcd-966e-54894064139f","Type":"ContainerDied","Data":"5d4fb72f925e6fc19d552feea3dba81b920c7da78806246764d98f9b400b6d08"} Jul 10 15:55:58.849777 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:58.849747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:58.850224 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:58.849790 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:58.850224 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:58.849903 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:58.850224 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:58.849920 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:58.850224 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:58.849980 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs podName:2814d1a1-a841-4022-b291-c7d78607bdfa nodeName:}" failed. No retries permitted until 2026-07-10 15:56:30.849965173 +0000 UTC m=+66.397654463 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs") pod "network-metrics-daemon-57mkr" (UID: "2814d1a1-a841-4022-b291-c7d78607bdfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:58.850224 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:58.849997 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret podName:f088c170-6610-4e41-ad7c-0857e37b85c4 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:30.849990545 +0000 UTC m=+66.397679832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret") pod "global-pull-secret-syncer-t8nbw" (UID: "f088c170-6610-4e41-ad7c-0857e37b85c4") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:58.950149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:58.950111 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:58.950308 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:58.950254 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:58.950308 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:58.950273 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:58.950308 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:58.950282 2582 projected.go:196] Error preparing data for projected volume kube-api-access-qdcdc for pod openshift-network-diagnostics/network-check-target-95nwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:58.950460 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:58.950332 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc podName:a308af1b-a5a2-48e7-99fd-08e2d1207ab3 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:30.950315436 +0000 UTC m=+66.498004723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdcdc" (UniqueName: "kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc") pod "network-check-target-95nwt" (UID: "a308af1b-a5a2-48e7-99fd-08e2d1207ab3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:59.133338 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:59.133262 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:55:59.133338 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:59.133309 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:55:59.133338 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:55:59.133311 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:55:59.133579 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:59.133392 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:55:59.133579 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:59.133491 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:55:59.133579 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:55:59.133561 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:01.133315 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:01.133283 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:01.133730 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:01.133283 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:01.133730 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:01.133395 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:01.133730 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:01.133416 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:01.133730 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:01.133490 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:01.133730 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:01.133585 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:03.133687 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:03.133657 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:03.134003 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:03.133763 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:03.134003 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:03.133787 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:03.134003 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:03.133778 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:03.134003 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:03.133865 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:03.134003 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:03.133962 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:03.373258 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:03.373220 2582 generic.go:356] "Generic (PLEG): container finished" podID="73c352b8-b4e1-4dcd-966e-54894064139f" containerID="1feb3eb30dd905058c8afaaba661fe120135984401c6a8a49e26fb0337ac1c69" exitCode=0 Jul 10 15:56:03.373418 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:03.373286 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25qj9" event={"ID":"73c352b8-b4e1-4dcd-966e-54894064139f","Type":"ContainerDied","Data":"1feb3eb30dd905058c8afaaba661fe120135984401c6a8a49e26fb0337ac1c69"} Jul 10 15:56:04.378530 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:04.378496 2582 generic.go:356] "Generic (PLEG): container finished" podID="73c352b8-b4e1-4dcd-966e-54894064139f" containerID="15771a706f97e2d040a7d198119281bc0c5d8fced708558f3178dcfe8b4ad401" exitCode=0 Jul 10 15:56:04.378906 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:04.378551 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25qj9" event={"ID":"73c352b8-b4e1-4dcd-966e-54894064139f","Type":"ContainerDied","Data":"15771a706f97e2d040a7d198119281bc0c5d8fced708558f3178dcfe8b4ad401"} Jul 10 15:56:05.133786 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:05.133753 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:05.133786 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:05.133782 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:05.134003 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:05.133856 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:05.134003 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:05.133860 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:05.134003 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:05.133947 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:05.134119 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:05.134025 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:05.383260 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:05.383155 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25qj9" event={"ID":"73c352b8-b4e1-4dcd-966e-54894064139f","Type":"ContainerStarted","Data":"11f7d443f540a6fdd2c42e8d401ccad1fb60b0ecd31d9ddef19f9ed85ee3bb9d"} Jul 10 15:56:05.405858 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:05.405812 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-25qj9" podStartSLOduration=7.591120426 podStartE2EDuration="39.405797869s" totalImagesPullingTime="31.814677443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:05.405599358 +0000 UTC m=+40.953288666" watchObservedRunningTime="2026-07-10 15:56:05.405797869 +0000 UTC m=+40.953487176" Jul 10 15:56:07.133355 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:07.133319 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:07.133847 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:07.133362 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:07.133847 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:07.133399 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:07.133847 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:07.133470 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:07.133847 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:07.133489 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:07.133847 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:07.133542 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:09.133559 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:09.133527 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:09.133914 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:09.133527 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:09.133914 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:09.133635 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:09.133914 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:09.133527 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:09.133914 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:09.133766 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:09.133914 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:09.133692 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:11.133533 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:11.133504 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:11.134069 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:11.133594 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:11.134069 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:11.133608 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:11.134069 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:11.133594 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:11.134069 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:11.133726 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:11.134069 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:11.133795 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:13.133862 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:13.133830 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:13.134232 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:13.133915 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:13.134232 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:13.133925 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:13.134232 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:13.133919 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:13.134232 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:13.134006 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:13.134232 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:13.134059 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:15.133000 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:15.132971 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:15.133342 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:15.132979 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:15.133342 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:15.133056 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:15.133342 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:15.133068 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:15.133342 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:15.133144 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:15.133342 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:15.133218 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:17.133517 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:17.133479 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:17.133997 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:17.133523 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:17.133997 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:17.133583 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:17.133997 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:17.133603 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:17.133997 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:17.133655 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:17.133997 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:17.133698 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:19.133850 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:19.133820 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:19.134357 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:19.133824 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:19.134357 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:19.133946 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:19.134357 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:19.134038 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:19.134357 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:19.133832 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:19.134357 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:19.134149 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:21.133777 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.133740 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:21.134171 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.133841 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:21.134171 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.133850 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:21.134171 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:21.133850 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nbw" podUID="f088c170-6610-4e41-ad7c-0857e37b85c4" Jul 10 15:56:21.134171 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:21.133920 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95nwt" podUID="a308af1b-a5a2-48e7-99fd-08e2d1207ab3" Jul 10 15:56:21.134171 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:21.134013 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-57mkr" podUID="2814d1a1-a841-4022-b291-c7d78607bdfa" Jul 10 15:56:21.810405 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.810381 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeReady" Jul 10 15:56:21.810697 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.810500 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 15:56:21.866947 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.866901 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ghdxd"] Jul 10 15:56:21.868922 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.868891 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:21.869708 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.869685 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gtxc4"] Jul 10 15:56:21.871593 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.871577 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gtxc4" Jul 10 15:56:21.873148 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.873127 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 15:56:21.873267 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.873223 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 15:56:21.873377 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.873360 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n6slx\"" Jul 10 15:56:21.873435 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.873360 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 15:56:21.874402 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.874388 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 15:56:21.875073 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.875056 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k6hng\"" Jul 10 15:56:21.875170 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.875095 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 15:56:21.875307 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.875295 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 15:56:21.875558 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.875543 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 15:56:21.885588 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.885569 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ghdxd"] Jul 10 15:56:21.890409 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.890390 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gtxc4"] Jul 10 15:56:21.926532 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.926501 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:21.926532 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.926533 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-crio-socket\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:21.926732 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.926583 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7lzf\" (UniqueName: \"kubernetes.io/projected/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-kube-api-access-p7lzf\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:21.926732 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.926608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc40706-c6bc-4739-8b1f-bc1438b91219-cert\") pod \"ingress-canary-gtxc4\" (UID: \"bcc40706-c6bc-4739-8b1f-bc1438b91219\") " pod="openshift-ingress-canary/ingress-canary-gtxc4" Jul 10 15:56:21.926732 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.926640 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-data-volume\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:21.926732 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.926711 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:21.926860 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.926740 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmgz9\" (UniqueName: \"kubernetes.io/projected/bcc40706-c6bc-4739-8b1f-bc1438b91219-kube-api-access-mmgz9\") pod \"ingress-canary-gtxc4\" (UID: \"bcc40706-c6bc-4739-8b1f-bc1438b91219\") " pod="openshift-ingress-canary/ingress-canary-gtxc4" Jul 10 15:56:21.964942 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.964898 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s5wfj"] Jul 10 15:56:21.966758 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.966743 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:21.969945 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.969901 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tn9vq\"" Jul 10 15:56:21.969945 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.969917 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 15:56:21.970100 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.970076 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 15:56:21.983802 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:21.983770 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5wfj"] Jul 10 15:56:22.027483 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027457 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-data-volume\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.027642 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027500 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.027642 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62349f0c-8a86-41ff-b791-a3b2e0279717-tmp-dir\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.027722 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6zhp\" (UniqueName: \"kubernetes.io/projected/62349f0c-8a86-41ff-b791-a3b2e0279717-kube-api-access-v6zhp\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.027722 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027673 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmgz9\" (UniqueName: \"kubernetes.io/projected/bcc40706-c6bc-4739-8b1f-bc1438b91219-kube-api-access-mmgz9\") pod \"ingress-canary-gtxc4\" (UID: \"bcc40706-c6bc-4739-8b1f-bc1438b91219\") " pod="openshift-ingress-canary/ingress-canary-gtxc4" Jul 10 15:56:22.027722 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027704 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.027853 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-crio-socket\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.027853 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027763 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7lzf\" (UniqueName: \"kubernetes.io/projected/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-kube-api-access-p7lzf\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.027969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027848 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-data-volume\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.027969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027882 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc40706-c6bc-4739-8b1f-bc1438b91219-cert\") pod \"ingress-canary-gtxc4\" (UID: \"bcc40706-c6bc-4739-8b1f-bc1438b91219\") " pod="openshift-ingress-canary/ingress-canary-gtxc4" Jul 10 15:56:22.027969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027917 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62349f0c-8a86-41ff-b791-a3b2e0279717-config-volume\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.027969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027964 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62349f0c-8a86-41ff-b791-a3b2e0279717-metrics-tls\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.028149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.027986 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-crio-socket\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.028149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.028129 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.031699 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.031678 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.031827 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.031808 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc40706-c6bc-4739-8b1f-bc1438b91219-cert\") pod \"ingress-canary-gtxc4\" (UID: \"bcc40706-c6bc-4739-8b1f-bc1438b91219\") " pod="openshift-ingress-canary/ingress-canary-gtxc4" Jul 10 15:56:22.037309 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.037283 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmgz9\" (UniqueName: \"kubernetes.io/projected/bcc40706-c6bc-4739-8b1f-bc1438b91219-kube-api-access-mmgz9\") pod \"ingress-canary-gtxc4\" (UID: \"bcc40706-c6bc-4739-8b1f-bc1438b91219\") " pod="openshift-ingress-canary/ingress-canary-gtxc4" Jul 10 15:56:22.037397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.037300 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7lzf\" (UniqueName: \"kubernetes.io/projected/38fe9a80-c896-4e1e-8f8c-b25ebdfe967c-kube-api-access-p7lzf\") pod \"insights-runtime-extractor-ghdxd\" (UID: \"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c\") " pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.128493 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.128422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62349f0c-8a86-41ff-b791-a3b2e0279717-config-volume\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.128493 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.128454 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62349f0c-8a86-41ff-b791-a3b2e0279717-metrics-tls\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.128653 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.128498 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62349f0c-8a86-41ff-b791-a3b2e0279717-tmp-dir\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.128653 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.128521 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6zhp\" (UniqueName: \"kubernetes.io/projected/62349f0c-8a86-41ff-b791-a3b2e0279717-kube-api-access-v6zhp\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.128803 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.128784 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62349f0c-8a86-41ff-b791-a3b2e0279717-tmp-dir\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.129062 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.129045 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62349f0c-8a86-41ff-b791-a3b2e0279717-config-volume\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.130713 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.130683 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62349f0c-8a86-41ff-b791-a3b2e0279717-metrics-tls\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.137114 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.137095 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6zhp\" (UniqueName: \"kubernetes.io/projected/62349f0c-8a86-41ff-b791-a3b2e0279717-kube-api-access-v6zhp\") pod \"dns-default-s5wfj\" (UID: \"62349f0c-8a86-41ff-b791-a3b2e0279717\") " pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.180519 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.180497 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ghdxd" Jul 10 15:56:22.185148 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.185129 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gtxc4" Jul 10 15:56:22.275645 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.275387 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:22.349633 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.349602 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ghdxd"] Jul 10 15:56:22.363219 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.363091 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gtxc4"] Jul 10 15:56:22.365338 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:22.365310 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc40706_c6bc_4739_8b1f_bc1438b91219.slice/crio-f6e99412c243542bf974876775fcb02c8a7ce1a7b037a5765afb2800dad5aa1c WatchSource:0}: Error finding container f6e99412c243542bf974876775fcb02c8a7ce1a7b037a5765afb2800dad5aa1c: Status 404 returned error can't find the container with id f6e99412c243542bf974876775fcb02c8a7ce1a7b037a5765afb2800dad5aa1c Jul 10 15:56:22.411662 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.411588 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5wfj"] Jul 10 15:56:22.414526 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:22.414499 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62349f0c_8a86_41ff_b791_a3b2e0279717.slice/crio-0c261d133093bfd63cab378a506847fe44a13114ef789a21665f8df6f1be7890 WatchSource:0}: Error finding container 0c261d133093bfd63cab378a506847fe44a13114ef789a21665f8df6f1be7890: Status 404 returned error can't find the container with id 0c261d133093bfd63cab378a506847fe44a13114ef789a21665f8df6f1be7890 Jul 10 15:56:22.419345 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.419267 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5wfj" event={"ID":"62349f0c-8a86-41ff-b791-a3b2e0279717","Type":"ContainerStarted","Data":"0c261d133093bfd63cab378a506847fe44a13114ef789a21665f8df6f1be7890"} Jul 10 15:56:22.420245 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.420222 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gtxc4" event={"ID":"bcc40706-c6bc-4739-8b1f-bc1438b91219","Type":"ContainerStarted","Data":"f6e99412c243542bf974876775fcb02c8a7ce1a7b037a5765afb2800dad5aa1c"} Jul 10 15:56:22.421243 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:22.421217 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghdxd" event={"ID":"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c","Type":"ContainerStarted","Data":"5fd5eaa819a34b9c8b8d1b2ca8f7e275d27cf7700658613e6572a124e0a0f794"} Jul 10 15:56:23.133955 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.133659 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:23.133955 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.133908 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:23.133955 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.133958 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:23.139428 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.139396 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 15:56:23.139791 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.139706 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 15:56:23.143868 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.139891 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 15:56:23.143868 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.140120 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zp7tx\"" Jul 10 15:56:23.143868 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.140313 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 15:56:23.143868 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.140568 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9526x\"" Jul 10 15:56:23.854117 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.854076 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh"] Jul 10 15:56:23.869380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.869350 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh"] Jul 10 15:56:23.869547 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.869481 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" Jul 10 15:56:23.873214 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.873189 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kndb6\"" Jul 10 15:56:23.873424 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.873407 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 15:56:23.947604 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:23.947560 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bjpfh\" (UID: \"f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" Jul 10 15:56:24.048254 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:24.048217 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bjpfh\" (UID: \"f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" Jul 10 15:56:24.048428 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:24.048356 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 10 15:56:24.048428 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:24.048426 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c-tls-certificates podName:f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c nodeName:}" failed. No retries permitted until 2026-07-10 15:56:24.548407125 +0000 UTC m=+60.096096433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-bjpfh" (UID: "f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c") : secret "prometheus-operator-admission-webhook-tls" not found Jul 10 15:56:24.551581 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:24.551544 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bjpfh\" (UID: \"f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" Jul 10 15:56:24.554085 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:24.554057 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bjpfh\" (UID: \"f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" Jul 10 15:56:24.783771 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:24.783737 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kndb6\"" Jul 10 15:56:24.791488 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:24.791460 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" Jul 10 15:56:27.368013 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.367920 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d88zt" Jul 10 15:56:27.390654 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.390609 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-bd8gn"] Jul 10 15:56:27.397904 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.397884 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-bd8gn" Jul 10 15:56:27.403188 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.403159 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 15:56:27.403369 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.403345 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 15:56:27.403441 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.403419 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tqq9b\"" Jul 10 15:56:27.407376 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.407353 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-bd8gn"] Jul 10 15:56:27.474364 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.474221 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgjjv\" (UniqueName: \"kubernetes.io/projected/a74f3da0-f8dd-48ef-9e6b-f6208b2933f5-kube-api-access-tgjjv\") pod \"downloads-68c9cbb497-bd8gn\" (UID: \"a74f3da0-f8dd-48ef-9e6b-f6208b2933f5\") " pod="openshift-console/downloads-68c9cbb497-bd8gn" Jul 10 15:56:27.525498 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.524050 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh"] Jul 10 15:56:27.530819 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:27.530547 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5290af6_7b8b_4fa4_9627_0aab1b6d1e6c.slice/crio-418c9087b89d0b8d9f992a38477c539390d5f5e82fa22b275e4f128ba91c7176 WatchSource:0}: Error finding container 418c9087b89d0b8d9f992a38477c539390d5f5e82fa22b275e4f128ba91c7176: Status 404 returned error can't find the container with id 418c9087b89d0b8d9f992a38477c539390d5f5e82fa22b275e4f128ba91c7176 Jul 10 15:56:27.574634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.574606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgjjv\" (UniqueName: \"kubernetes.io/projected/a74f3da0-f8dd-48ef-9e6b-f6208b2933f5-kube-api-access-tgjjv\") pod \"downloads-68c9cbb497-bd8gn\" (UID: \"a74f3da0-f8dd-48ef-9e6b-f6208b2933f5\") " pod="openshift-console/downloads-68c9cbb497-bd8gn" Jul 10 15:56:27.584040 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.583841 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgjjv\" (UniqueName: \"kubernetes.io/projected/a74f3da0-f8dd-48ef-9e6b-f6208b2933f5-kube-api-access-tgjjv\") pod \"downloads-68c9cbb497-bd8gn\" (UID: \"a74f3da0-f8dd-48ef-9e6b-f6208b2933f5\") " pod="openshift-console/downloads-68c9cbb497-bd8gn" Jul 10 15:56:27.707663 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.707620 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-bd8gn" Jul 10 15:56:27.823837 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:27.823809 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-bd8gn"] Jul 10 15:56:27.826788 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:27.826761 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74f3da0_f8dd_48ef_9e6b_f6208b2933f5.slice/crio-6b37def3c1330d6297c7da841cda22536e5b85e68ace8bd694873f3b172bb6ab WatchSource:0}: Error finding container 6b37def3c1330d6297c7da841cda22536e5b85e68ace8bd694873f3b172bb6ab: Status 404 returned error can't find the container with id 6b37def3c1330d6297c7da841cda22536e5b85e68ace8bd694873f3b172bb6ab Jul 10 15:56:28.441408 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:28.441374 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5wfj" event={"ID":"62349f0c-8a86-41ff-b791-a3b2e0279717","Type":"ContainerStarted","Data":"0b83fa0d531a04b67ba5c66011883ed445f4db0452f66ad624e75edffa6ea6ab"} Jul 10 15:56:28.441867 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:28.441435 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5wfj" event={"ID":"62349f0c-8a86-41ff-b791-a3b2e0279717","Type":"ContainerStarted","Data":"8c1c663d144b71d1d1a2e8b73350e5cb78e6c7caf95ff8e5a1e6ad3f9cd5fdb3"} Jul 10 15:56:28.441867 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:28.441491 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:28.443022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:28.442990 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gtxc4" event={"ID":"bcc40706-c6bc-4739-8b1f-bc1438b91219","Type":"ContainerStarted","Data":"0ddb717c81892ed55cd6becc7aecc825183a1c78ad9c8e4661966c5e74e3bff4"} Jul 10 15:56:28.444347 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:28.444322 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" event={"ID":"f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c","Type":"ContainerStarted","Data":"418c9087b89d0b8d9f992a38477c539390d5f5e82fa22b275e4f128ba91c7176"} Jul 10 15:56:28.446355 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:28.446334 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghdxd" event={"ID":"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c","Type":"ContainerStarted","Data":"d4f71f2eb9cb03d4cc1494893e982c844169e397ee270171eb130a2c5da73b21"} Jul 10 15:56:28.446444 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:28.446382 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghdxd" event={"ID":"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c","Type":"ContainerStarted","Data":"1abb81015b4129acccbb5e13d83cf6e78327002ce460103bb36b58d621506d9d"} Jul 10 15:56:28.447613 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:28.447593 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-bd8gn" event={"ID":"a74f3da0-f8dd-48ef-9e6b-f6208b2933f5","Type":"ContainerStarted","Data":"6b37def3c1330d6297c7da841cda22536e5b85e68ace8bd694873f3b172bb6ab"} Jul 10 15:56:28.462118 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:28.462072 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s5wfj" podStartSLOduration=2.491194231 podStartE2EDuration="7.462054057s" totalImagesPullingTime="4.970859826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:28.461463122 +0000 UTC m=+64.009152430" watchObservedRunningTime="2026-07-10 15:56:28.462054057 +0000 UTC m=+64.009743366" Jul 10 15:56:29.454714 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.454675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" event={"ID":"f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c","Type":"ContainerStarted","Data":"f15d9b7778add43d7c11df87607ba4e23b442baa1a9b53d51ab794c1048558ad"} Jul 10 15:56:29.455334 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.455049 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" Jul 10 15:56:29.461251 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.461207 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" Jul 10 15:56:29.471916 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.471866 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bjpfh" podStartSLOduration=5.360373834 podStartE2EDuration="6.471848568s" totalImagesPullingTime="1.111474734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:29.471283263 +0000 UTC m=+65.018972573" watchObservedRunningTime="2026-07-10 15:56:29.471848568 +0000 UTC m=+65.019537881" Jul 10 15:56:29.472203 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.472167 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gtxc4" podStartSLOduration=3.451809459 podStartE2EDuration="8.47215588s" totalImagesPullingTime="5.020346421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:28.478394507 +0000 UTC m=+64.026083818" watchObservedRunningTime="2026-07-10 15:56:29.47215588 +0000 UTC m=+65.019845189" Jul 10 15:56:29.921490 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.921405 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-9bl7k"] Jul 10 15:56:29.924328 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.924306 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:29.927328 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.927300 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 10 15:56:29.928377 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.928357 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 15:56:29.928907 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.928616 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 10 15:56:29.928907 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.928636 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jqxx6\"" Jul 10 15:56:29.928907 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.928645 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 15:56:29.928907 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.928755 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 15:56:29.932913 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.932569 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-9bl7k"] Jul 10 15:56:29.993604 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.993561 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr42z\" (UniqueName: \"kubernetes.io/projected/bc314e7a-a06d-49d1-aa96-01ee327b510b-kube-api-access-gr42z\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:29.993766 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.993613 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc314e7a-a06d-49d1-aa96-01ee327b510b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:29.993766 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.993719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc314e7a-a06d-49d1-aa96-01ee327b510b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:29.993766 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:29.993743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc314e7a-a06d-49d1-aa96-01ee327b510b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.094725 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.094687 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc314e7a-a06d-49d1-aa96-01ee327b510b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.094902 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.094798 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc314e7a-a06d-49d1-aa96-01ee327b510b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.094902 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.094832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc314e7a-a06d-49d1-aa96-01ee327b510b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.094902 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.094871 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr42z\" (UniqueName: \"kubernetes.io/projected/bc314e7a-a06d-49d1-aa96-01ee327b510b-kube-api-access-gr42z\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.095827 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.095798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc314e7a-a06d-49d1-aa96-01ee327b510b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.097768 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.097731 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc314e7a-a06d-49d1-aa96-01ee327b510b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.097768 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.097740 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc314e7a-a06d-49d1-aa96-01ee327b510b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.104016 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.103988 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr42z\" (UniqueName: \"kubernetes.io/projected/bc314e7a-a06d-49d1-aa96-01ee327b510b-kube-api-access-gr42z\") pod \"prometheus-operator-64785b6675-9bl7k\" (UID: \"bc314e7a-a06d-49d1-aa96-01ee327b510b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.238097 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.238064 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" Jul 10 15:56:30.902470 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.902438 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:30.902876 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.902482 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:30.905500 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.905475 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 15:56:30.905634 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.905475 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 15:56:30.915423 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.915399 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f088c170-6610-4e41-ad7c-0857e37b85c4-original-pull-secret\") pod \"global-pull-secret-syncer-t8nbw\" (UID: \"f088c170-6610-4e41-ad7c-0857e37b85c4\") " pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:30.915521 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.915506 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2814d1a1-a841-4022-b291-c7d78607bdfa-metrics-certs\") pod \"network-metrics-daemon-57mkr\" (UID: \"2814d1a1-a841-4022-b291-c7d78607bdfa\") " pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:30.953161 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.953130 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zp7tx\"" Jul 10 15:56:30.960873 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.960841 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-57mkr" Jul 10 15:56:30.967095 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:30.967067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nbw" Jul 10 15:56:31.003902 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.003863 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:31.007173 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.007153 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 15:56:31.017148 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.017127 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 15:56:31.030399 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.030348 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdcdc\" (UniqueName: \"kubernetes.io/projected/a308af1b-a5a2-48e7-99fd-08e2d1207ab3-kube-api-access-qdcdc\") pod \"network-check-target-95nwt\" (UID: \"a308af1b-a5a2-48e7-99fd-08e2d1207ab3\") " pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:31.151595 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.151559 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-9bl7k"] Jul 10 15:56:31.168628 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.168601 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8nbw"] Jul 10 15:56:31.170775 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:31.170742 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf088c170_6610_4e41_ad7c_0857e37b85c4.slice/crio-cad4a7fcbb9e39e177b7c6a48528448b870ac88fe908f9051c0e124c1fa02338 WatchSource:0}: Error finding container cad4a7fcbb9e39e177b7c6a48528448b870ac88fe908f9051c0e124c1fa02338: Status 404 returned error can't find the container with id cad4a7fcbb9e39e177b7c6a48528448b870ac88fe908f9051c0e124c1fa02338 Jul 10 15:56:31.192239 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.192213 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-57mkr"] Jul 10 15:56:31.194834 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:31.194803 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2814d1a1_a841_4022_b291_c7d78607bdfa.slice/crio-9cedc8f46336e9ad78ff82eab4158b2c108779edfd33135a27085bcbb5c2e26b WatchSource:0}: Error finding container 9cedc8f46336e9ad78ff82eab4158b2c108779edfd33135a27085bcbb5c2e26b: Status 404 returned error can't find the container with id 9cedc8f46336e9ad78ff82eab4158b2c108779edfd33135a27085bcbb5c2e26b Jul 10 15:56:31.262781 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.262752 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9526x\"" Jul 10 15:56:31.270076 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.270056 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:31.405790 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.405761 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-95nwt"] Jul 10 15:56:31.408033 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:31.408007 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda308af1b_a5a2_48e7_99fd_08e2d1207ab3.slice/crio-df1ff82dc4a9599c701559c180597dd3fd972f4535f4adf2e4082132375cdc1e WatchSource:0}: Error finding container df1ff82dc4a9599c701559c180597dd3fd972f4535f4adf2e4082132375cdc1e: Status 404 returned error can't find the container with id df1ff82dc4a9599c701559c180597dd3fd972f4535f4adf2e4082132375cdc1e Jul 10 15:56:31.463107 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.463071 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8nbw" event={"ID":"f088c170-6610-4e41-ad7c-0857e37b85c4","Type":"ContainerStarted","Data":"cad4a7fcbb9e39e177b7c6a48528448b870ac88fe908f9051c0e124c1fa02338"} Jul 10 15:56:31.465699 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.465675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghdxd" event={"ID":"38fe9a80-c896-4e1e-8f8c-b25ebdfe967c","Type":"ContainerStarted","Data":"878cd8a13c41c739125cee2bd611cdef808ba62b1d92e61a129b04c91497690a"} Jul 10 15:56:31.466979 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.466956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-57mkr" event={"ID":"2814d1a1-a841-4022-b291-c7d78607bdfa","Type":"ContainerStarted","Data":"9cedc8f46336e9ad78ff82eab4158b2c108779edfd33135a27085bcbb5c2e26b"} Jul 10 15:56:31.468239 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.468206 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" event={"ID":"bc314e7a-a06d-49d1-aa96-01ee327b510b","Type":"ContainerStarted","Data":"60dbcbdc72f2d0d91e62f07ab418ee98fd274670ad4ce9df9df0eaaf594b9b25"} Jul 10 15:56:31.469456 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.469434 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-95nwt" event={"ID":"a308af1b-a5a2-48e7-99fd-08e2d1207ab3","Type":"ContainerStarted","Data":"df1ff82dc4a9599c701559c180597dd3fd972f4535f4adf2e4082132375cdc1e"} Jul 10 15:56:31.489818 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.489770 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ghdxd" podStartSLOduration=1.974412476 podStartE2EDuration="10.489753657s" totalImagesPullingTime="8.515341181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:56:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:31.488960618 +0000 UTC m=+67.036649929" watchObservedRunningTime="2026-07-10 15:56:31.489753657 +0000 UTC m=+67.037442967" Jul 10 15:56:31.518471 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.518447 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6998ccc548-wtpp4"] Jul 10 15:56:31.521284 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.521265 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.524179 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.524147 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 15:56:31.524884 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.524677 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rd9mn\"" Jul 10 15:56:31.524884 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.524740 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 15:56:31.524884 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.524749 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 15:56:31.524884 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.524749 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 15:56:31.524884 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.524815 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 15:56:31.532419 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.532397 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6998ccc548-wtpp4"] Jul 10 15:56:31.610300 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.610176 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-serving-cert\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.610300 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.610213 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-oauth-config\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.610300 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.610254 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-console-config\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.610570 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.610308 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjhdp\" (UniqueName: \"kubernetes.io/projected/9e948144-de15-4ff3-b5f8-d175744d7b83-kube-api-access-hjhdp\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.610570 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.610373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-service-ca\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.610570 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.610402 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-oauth-serving-cert\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.711924 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.711693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-serving-cert\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.711924 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.711734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-oauth-config\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.711924 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.711906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-console-config\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.712214 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.711974 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjhdp\" (UniqueName: \"kubernetes.io/projected/9e948144-de15-4ff3-b5f8-d175744d7b83-kube-api-access-hjhdp\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.712214 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.712009 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-service-ca\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.712214 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.712037 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-oauth-serving-cert\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.712846 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.712821 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-oauth-serving-cert\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.713425 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.713402 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-service-ca\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.713505 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.713473 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-console-config\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.716367 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.716326 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-serving-cert\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.718522 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.718483 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-oauth-config\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.725494 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.725453 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjhdp\" (UniqueName: \"kubernetes.io/projected/9e948144-de15-4ff3-b5f8-d175744d7b83-kube-api-access-hjhdp\") pod \"console-6998ccc548-wtpp4\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:31.831907 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:31.831868 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:32.030864 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:32.030725 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6998ccc548-wtpp4"] Jul 10 15:56:32.034693 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:32.034663 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e948144_de15_4ff3_b5f8_d175744d7b83.slice/crio-d2a86ed7bbd25faf4b95cffbf47e1a2014737dc1598e005237e42038ef2cb824 WatchSource:0}: Error finding container d2a86ed7bbd25faf4b95cffbf47e1a2014737dc1598e005237e42038ef2cb824: Status 404 returned error can't find the container with id d2a86ed7bbd25faf4b95cffbf47e1a2014737dc1598e005237e42038ef2cb824 Jul 10 15:56:32.477714 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:32.477638 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6998ccc548-wtpp4" event={"ID":"9e948144-de15-4ff3-b5f8-d175744d7b83","Type":"ContainerStarted","Data":"d2a86ed7bbd25faf4b95cffbf47e1a2014737dc1598e005237e42038ef2cb824"} Jul 10 15:56:33.487547 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:33.486607 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-57mkr" event={"ID":"2814d1a1-a841-4022-b291-c7d78607bdfa","Type":"ContainerStarted","Data":"c098d8717abc1c6c866bcbdf1483cffe06cbbe7ee3ab54f2d588db025a5feb03"} Jul 10 15:56:33.487547 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:33.486716 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-57mkr" event={"ID":"2814d1a1-a841-4022-b291-c7d78607bdfa","Type":"ContainerStarted","Data":"90a6de4bcfd6e836f07331452ad5fe7323e781c01d027e55b653b11862a0ff57"} Jul 10 15:56:33.491891 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:33.490425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" event={"ID":"bc314e7a-a06d-49d1-aa96-01ee327b510b","Type":"ContainerStarted","Data":"168e7e8fa6fc741d55bee227b6ee574b4fe54608486b450695fc6f96c9819586"} Jul 10 15:56:33.491891 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:33.490490 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" event={"ID":"bc314e7a-a06d-49d1-aa96-01ee327b510b","Type":"ContainerStarted","Data":"39276d71f968fc4d538870140fa86c57a7be77a26c06459e2a15c6324d31cc6e"} Jul 10 15:56:33.505970 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:33.505372 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-57mkr" podStartSLOduration=65.702316268 podStartE2EDuration="1m7.505353276s" totalImagesPullingTime="1.803037008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:33.503780938 +0000 UTC m=+69.051470249" watchObservedRunningTime="2026-07-10 15:56:33.505353276 +0000 UTC m=+69.053042586" Jul 10 15:56:33.522943 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:33.522113 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-9bl7k" podStartSLOduration=2.676842979 podStartE2EDuration="4.522094555s" totalImagesPullingTime="1.845251576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:33.520789311 +0000 UTC m=+69.068478632" watchObservedRunningTime="2026-07-10 15:56:33.522094555 +0000 UTC m=+69.069783863" Jul 10 15:56:35.309092 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.308840 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws"] Jul 10 15:56:35.327015 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.326109 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.327907 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.327876 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws"] Jul 10 15:56:35.329325 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.329306 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g2t7d\"" Jul 10 15:56:35.329554 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.329537 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 15:56:35.329748 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.329732 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 15:56:35.337917 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.337891 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8pdzg"] Jul 10 15:56:35.354256 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.354220 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-7jnsl"] Jul 10 15:56:35.354552 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.354524 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.359537 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.359309 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 15:56:35.359537 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.359331 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r4hpk\"" Jul 10 15:56:35.359537 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.359340 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 15:56:35.359831 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.359754 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 15:56:35.366656 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.366628 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-7jnsl"] Jul 10 15:56:35.367741 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.367003 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.371010 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.370529 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 10 15:56:35.371010 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.370728 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pb87j\"" Jul 10 15:56:35.373343 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.373325 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 10 15:56:35.373913 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.373895 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 10 15:56:35.443311 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443273 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cf47c89-b329-4772-a08a-c6bc9313f659-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.443488 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-textfile\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.443488 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443436 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf47c89-b329-4772-a08a-c6bc9313f659-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.443617 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443483 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-sys\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.443617 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443569 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.443617 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443598 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5jnl\" (UniqueName: \"kubernetes.io/projected/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-kube-api-access-z5jnl\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.443767 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.443767 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-accelerators-collector-config\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.443767 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443680 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-wtmp\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.443767 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443747 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.444031 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443792 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-root\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.444031 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvnl7\" (UniqueName: \"kubernetes.io/projected/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-api-access-dvnl7\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.444031 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443899 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g99tm\" (UniqueName: \"kubernetes.io/projected/1cf47c89-b329-4772-a08a-c6bc9313f659-kube-api-access-g99tm\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.444031 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf47c89-b329-4772-a08a-c6bc9313f659-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.444031 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.443989 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-metrics-client-ca\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.444031 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.444016 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.444285 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.444056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.444285 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.444089 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.444285 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.444116 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-tls\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.545160 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545121 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.545331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545170 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-tls\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.545331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cf47c89-b329-4772-a08a-c6bc9313f659-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.545331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545235 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-textfile\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.545331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545262 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf47c89-b329-4772-a08a-c6bc9313f659-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.545331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545277 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-sys\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.545331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545297 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.545740 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545710 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-sys\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.545878 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5jnl\" (UniqueName: \"kubernetes.io/projected/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-kube-api-access-z5jnl\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.545971 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545884 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.545971 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545916 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-accelerators-collector-config\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.545971 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545968 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-wtmp\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.546117 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545981 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-textfile\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.546117 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.545997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.546117 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546047 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.546117 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-root\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.546117 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546099 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-root\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.546117 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546111 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvnl7\" (UniqueName: \"kubernetes.io/projected/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-api-access-dvnl7\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.546398 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546155 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g99tm\" (UniqueName: \"kubernetes.io/projected/1cf47c89-b329-4772-a08a-c6bc9313f659-kube-api-access-g99tm\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.546398 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf47c89-b329-4772-a08a-c6bc9313f659-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.546398 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546209 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-metrics-client-ca\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.546398 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546235 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.546398 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.546398 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546285 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf47c89-b329-4772-a08a-c6bc9313f659-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.546398 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:35.546370 2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 10 15:56:35.546713 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546423 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.546713 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546425 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-wtmp\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.546713 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:35.546431 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-tls podName:5d212765-ebf1-4605-a6f0-9ca9fc7520d8 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:36.046411821 +0000 UTC m=+71.594101109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-7jnsl" (UID: "5d212765-ebf1-4605-a6f0-9ca9fc7520d8") : secret "kube-state-metrics-tls" not found Jul 10 15:56:35.546713 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:35.546509 2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 10 15:56:35.546713 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:35.546592 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf47c89-b329-4772-a08a-c6bc9313f659-openshift-state-metrics-tls podName:1cf47c89-b329-4772-a08a-c6bc9313f659 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:36.046574353 +0000 UTC m=+71.594263646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1cf47c89-b329-4772-a08a-c6bc9313f659-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-fc8ws" (UID: "1cf47c89-b329-4772-a08a-c6bc9313f659") : secret "openshift-state-metrics-tls" not found Jul 10 15:56:35.546713 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546589 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.547031 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.546832 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-accelerators-collector-config\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.547087 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.547072 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-metrics-client-ca\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.548750 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.548726 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.549326 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.549281 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.549589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.549567 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-node-exporter-tls\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.549664 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.549602 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cf47c89-b329-4772-a08a-c6bc9313f659-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.557288 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.557224 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g99tm\" (UniqueName: \"kubernetes.io/projected/1cf47c89-b329-4772-a08a-c6bc9313f659-kube-api-access-g99tm\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:35.557459 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.557324 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5jnl\" (UniqueName: \"kubernetes.io/projected/67e7aaa8-c68d-41ff-bbfa-7b1349f84f82-kube-api-access-z5jnl\") pod \"node-exporter-8pdzg\" (UID: \"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82\") " pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:35.557673 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.557652 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvnl7\" (UniqueName: \"kubernetes.io/projected/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-api-access-dvnl7\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:35.668149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:35.668047 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8pdzg" Jul 10 15:56:36.050576 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.050543 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf47c89-b329-4772-a08a-c6bc9313f659-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:36.050749 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.050664 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:36.050804 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:36.050780 2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 10 15:56:36.050870 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:36.050839 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-tls podName:5d212765-ebf1-4605-a6f0-9ca9fc7520d8 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:37.050821575 +0000 UTC m=+72.598510861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-7jnsl" (UID: "5d212765-ebf1-4605-a6f0-9ca9fc7520d8") : secret "kube-state-metrics-tls" not found Jul 10 15:56:36.053870 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.053846 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf47c89-b329-4772-a08a-c6bc9313f659-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fc8ws\" (UID: \"1cf47c89-b329-4772-a08a-c6bc9313f659\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:36.240093 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.240056 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" Jul 10 15:56:36.373341 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.373264 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:56:36.376849 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.376276 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.379064 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.379039 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 15:56:36.379167 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.379102 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 15:56:36.379584 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.379559 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 15:56:36.379787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.379772 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 15:56:36.380169 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.379903 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 15:56:36.381158 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.380545 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 15:56:36.381158 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.380689 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jkqss\"" Jul 10 15:56:36.381158 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.380722 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 15:56:36.381158 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.380877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 15:56:36.381158 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.380972 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 15:56:36.394252 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.394176 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454322 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454380 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454440 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454468 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-config-out\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454722 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454741 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-web-config\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf2tk\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-kube-api-access-qf2tk\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454816 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.454910 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.454839 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.555867 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.555833 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556073 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.555898 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-config-out\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556073 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.555960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556073 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.555988 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556073 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.556012 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-web-config\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556073 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.556038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf2tk\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-kube-api-access-qf2tk\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556073 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.556073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556378 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.556106 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556378 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.556134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556378 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.556178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556378 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.556207 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556378 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.556231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.556378 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.556255 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.557242 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.557213 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.557242 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.557231 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.558303 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.558258 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.560674 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.560650 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.560899 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.560880 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.561008 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.560956 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.561279 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.561256 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-config-out\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.561343 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.561302 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.561831 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.561790 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.562986 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.562812 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.562986 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.562950 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-web-config\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.563514 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.563492 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.565922 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.565883 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf2tk\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-kube-api-access-qf2tk\") pod \"alertmanager-main-0\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:36.688914 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:36.688877 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:37.060950 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:37.060846 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:37.063719 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:37.063689 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d212765-ebf1-4605-a6f0-9ca9fc7520d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7jnsl\" (UID: \"5d212765-ebf1-4605-a6f0-9ca9fc7520d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:37.179022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:37.178990 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" Jul 10 15:56:38.288811 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.288553 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6db7bd667-8t4p7"] Jul 10 15:56:38.295641 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.295614 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.299196 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.298806 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n74h2\"" Jul 10 15:56:38.299196 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.298825 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 10 15:56:38.299196 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.298844 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 10 15:56:38.299196 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.299052 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 10 15:56:38.299196 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.299110 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 10 15:56:38.299537 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.299206 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 10 15:56:38.299537 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.299292 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-86j8d34kfr4r8\"" Jul 10 15:56:38.304620 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.304543 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6db7bd667-8t4p7"] Jul 10 15:56:38.373873 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.373835 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.374069 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.373883 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.374069 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.373988 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd1188a-4ea6-458f-bd4e-8d721792e486-metrics-client-ca\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.374177 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.374084 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjvq9\" (UniqueName: \"kubernetes.io/projected/3cd1188a-4ea6-458f-bd4e-8d721792e486-kube-api-access-wjvq9\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.374177 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.374116 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-tls\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.374284 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.374203 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-grpc-tls\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.374284 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.374257 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.374397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.374318 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.457299 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.457271 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s5wfj" Jul 10 15:56:38.475467 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.475435 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-grpc-tls\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.475640 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.475488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.475640 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.475520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.475803 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.475637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.475803 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.475685 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.475803 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.475736 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd1188a-4ea6-458f-bd4e-8d721792e486-metrics-client-ca\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.475803 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.475782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjvq9\" (UniqueName: \"kubernetes.io/projected/3cd1188a-4ea6-458f-bd4e-8d721792e486-kube-api-access-wjvq9\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.475803 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.475819 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-tls\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.478837 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.478798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.479487 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.479462 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd1188a-4ea6-458f-bd4e-8d721792e486-metrics-client-ca\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.479970 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.479894 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.481417 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.481381 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-grpc-tls\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.481649 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.481626 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.481883 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.481826 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.482869 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.482829 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3cd1188a-4ea6-458f-bd4e-8d721792e486-secret-thanos-querier-tls\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.492814 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.492588 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjvq9\" (UniqueName: \"kubernetes.io/projected/3cd1188a-4ea6-458f-bd4e-8d721792e486-kube-api-access-wjvq9\") pod \"thanos-querier-6db7bd667-8t4p7\" (UID: \"3cd1188a-4ea6-458f-bd4e-8d721792e486\") " pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.608979 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:38.608872 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:38.802312 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:38.802283 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e7aaa8_c68d_41ff_bbfa_7b1349f84f82.slice/crio-5ca4f08bf5cfc86c9361513dac5d56a543a41fc72040b6c0460d1ca099316594 WatchSource:0}: Error finding container 5ca4f08bf5cfc86c9361513dac5d56a543a41fc72040b6c0460d1ca099316594: Status 404 returned error can't find the container with id 5ca4f08bf5cfc86c9361513dac5d56a543a41fc72040b6c0460d1ca099316594 Jul 10 15:56:39.023081 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.022887 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws"] Jul 10 15:56:39.063155 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.063024 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:56:39.065608 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:39.065564 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69078a3e_76f7_4ae3_b371_db60681751c2.slice/crio-091adda0d5f22b25deb81e0e165b945f27dae212fa6a87e17ebbede0aa4a8f4a WatchSource:0}: Error finding container 091adda0d5f22b25deb81e0e165b945f27dae212fa6a87e17ebbede0aa4a8f4a: Status 404 returned error can't find the container with id 091adda0d5f22b25deb81e0e165b945f27dae212fa6a87e17ebbede0aa4a8f4a Jul 10 15:56:39.078384 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.078326 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6db7bd667-8t4p7"] Jul 10 15:56:39.082604 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.082455 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-7jnsl"] Jul 10 15:56:39.085201 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:39.085168 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d212765_ebf1_4605_a6f0_9ca9fc7520d8.slice/crio-5af888958ead175ed52196f4a771a4d29811d016e50cdcad875a940e5f01d411 WatchSource:0}: Error finding container 5af888958ead175ed52196f4a771a4d29811d016e50cdcad875a940e5f01d411: Status 404 returned error can't find the container with id 5af888958ead175ed52196f4a771a4d29811d016e50cdcad875a940e5f01d411 Jul 10 15:56:39.089092 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:39.088086 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd1188a_4ea6_458f_bd4e_8d721792e486.slice/crio-a63cfb8d6121a3972994bbb32a567d5009d939998c72aa9645c2c1d29f4aea81 WatchSource:0}: Error finding container a63cfb8d6121a3972994bbb32a567d5009d939998c72aa9645c2c1d29f4aea81: Status 404 returned error can't find the container with id a63cfb8d6121a3972994bbb32a567d5009d939998c72aa9645c2c1d29f4aea81 Jul 10 15:56:39.521076 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.521033 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-95nwt" event={"ID":"a308af1b-a5a2-48e7-99fd-08e2d1207ab3","Type":"ContainerStarted","Data":"beb34065f71baefb76feff9296b1c36d60961e335c53e62361b4a4c7f1602147"} Jul 10 15:56:39.521526 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.521162 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:56:39.522781 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.522743 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6998ccc548-wtpp4" event={"ID":"9e948144-de15-4ff3-b5f8-d175744d7b83","Type":"ContainerStarted","Data":"662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39"} Jul 10 15:56:39.524059 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.524036 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" event={"ID":"5d212765-ebf1-4605-a6f0-9ca9fc7520d8","Type":"ContainerStarted","Data":"5af888958ead175ed52196f4a771a4d29811d016e50cdcad875a940e5f01d411"} Jul 10 15:56:39.526080 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.526056 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" event={"ID":"1cf47c89-b329-4772-a08a-c6bc9313f659","Type":"ContainerStarted","Data":"ff0ab3a589ba6150b66ecdc5e66f7db04a62898ebf1f4259d4754b9d2d191e9e"} Jul 10 15:56:39.526179 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.526106 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" event={"ID":"1cf47c89-b329-4772-a08a-c6bc9313f659","Type":"ContainerStarted","Data":"26723bc27bef952db3ca4ac5d21758c908c884c2a459d517e3d2dda04e496cf2"} Jul 10 15:56:39.526179 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.526127 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" event={"ID":"1cf47c89-b329-4772-a08a-c6bc9313f659","Type":"ContainerStarted","Data":"acbb200b1b608b31f39b5f92fdfeb61e2d29461d144fa12149f9d34173f4cb5d"} Jul 10 15:56:39.527404 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.527384 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pdzg" event={"ID":"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82","Type":"ContainerStarted","Data":"5ca4f08bf5cfc86c9361513dac5d56a543a41fc72040b6c0460d1ca099316594"} Jul 10 15:56:39.529080 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.528846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8nbw" event={"ID":"f088c170-6610-4e41-ad7c-0857e37b85c4","Type":"ContainerStarted","Data":"869783b774024ce0970a9d351e68efbfa947b91fd4349a91dc6c03703f3dda1d"} Jul 10 15:56:39.530113 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.530089 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" event={"ID":"3cd1188a-4ea6-458f-bd4e-8d721792e486","Type":"ContainerStarted","Data":"a63cfb8d6121a3972994bbb32a567d5009d939998c72aa9645c2c1d29f4aea81"} Jul 10 15:56:39.531346 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.531315 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerStarted","Data":"091adda0d5f22b25deb81e0e165b945f27dae212fa6a87e17ebbede0aa4a8f4a"} Jul 10 15:56:39.539223 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.539179 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-95nwt" podStartSLOduration=66.152700426 podStartE2EDuration="1m13.539164183s" totalImagesPullingTime="7.386463757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:39.537975627 +0000 UTC m=+75.085664937" watchObservedRunningTime="2026-07-10 15:56:39.539164183 +0000 UTC m=+75.086853492" Jul 10 15:56:39.554406 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.554342 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t8nbw" podStartSLOduration=65.922591588 podStartE2EDuration="1m13.554323741s" totalImagesPullingTime="7.631732153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:39.554287289 +0000 UTC m=+75.101976600" watchObservedRunningTime="2026-07-10 15:56:39.554323741 +0000 UTC m=+75.102013051" Jul 10 15:56:39.573754 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.573695 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6998ccc548-wtpp4" podStartSLOduration=1.807767146 podStartE2EDuration="8.573678475s" totalImagesPullingTime="6.765911329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:39.572286128 +0000 UTC m=+75.119975450" watchObservedRunningTime="2026-07-10 15:56:39.573678475 +0000 UTC m=+75.121367784" Jul 10 15:56:39.704540 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.704505 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-dcc847c66-pqmpp"] Jul 10 15:56:39.709397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.709361 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.712331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.712304 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 10 15:56:39.712531 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.712513 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 10 15:56:39.712623 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.712574 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ac5cikc9rreln\"" Jul 10 15:56:39.712713 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.712697 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 10 15:56:39.712774 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.712712 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6wrrf\"" Jul 10 15:56:39.712835 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.712816 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 15:56:39.721701 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.721677 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dcc847c66-pqmpp"] Jul 10 15:56:39.791947 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.791829 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dd8ee42-c218-4230-862c-1b52c53f28b0-client-ca-bundle\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.791947 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.791895 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9dd8ee42-c218-4230-862c-1b52c53f28b0-secret-metrics-server-client-certs\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.792182 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.791956 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x979v\" (UniqueName: \"kubernetes.io/projected/9dd8ee42-c218-4230-862c-1b52c53f28b0-kube-api-access-x979v\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.792182 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.791999 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9dd8ee42-c218-4230-862c-1b52c53f28b0-audit-log\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.792182 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.792017 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9dd8ee42-c218-4230-862c-1b52c53f28b0-secret-metrics-server-tls\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.792182 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.792058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dd8ee42-c218-4230-862c-1b52c53f28b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.792182 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.792106 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9dd8ee42-c218-4230-862c-1b52c53f28b0-metrics-server-audit-profiles\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.893122 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.893088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9dd8ee42-c218-4230-862c-1b52c53f28b0-secret-metrics-server-tls\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.893312 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.893148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dd8ee42-c218-4230-862c-1b52c53f28b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.893377 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.893331 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9dd8ee42-c218-4230-862c-1b52c53f28b0-metrics-server-audit-profiles\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.893432 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.893412 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dd8ee42-c218-4230-862c-1b52c53f28b0-client-ca-bundle\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.893489 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.893457 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9dd8ee42-c218-4230-862c-1b52c53f28b0-secret-metrics-server-client-certs\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.893541 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.893493 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x979v\" (UniqueName: \"kubernetes.io/projected/9dd8ee42-c218-4230-862c-1b52c53f28b0-kube-api-access-x979v\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.893590 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.893541 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9dd8ee42-c218-4230-862c-1b52c53f28b0-audit-log\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.893875 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.893851 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9dd8ee42-c218-4230-862c-1b52c53f28b0-audit-log\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.894010 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.893958 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dd8ee42-c218-4230-862c-1b52c53f28b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.894376 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.894351 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9dd8ee42-c218-4230-862c-1b52c53f28b0-metrics-server-audit-profiles\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.896307 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.896283 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9dd8ee42-c218-4230-862c-1b52c53f28b0-secret-metrics-server-client-certs\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.896396 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.896319 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9dd8ee42-c218-4230-862c-1b52c53f28b0-secret-metrics-server-tls\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.896468 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.896445 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dd8ee42-c218-4230-862c-1b52c53f28b0-client-ca-bundle\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:39.903308 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:39.903267 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x979v\" (UniqueName: \"kubernetes.io/projected/9dd8ee42-c218-4230-862c-1b52c53f28b0-kube-api-access-x979v\") pod \"metrics-server-dcc847c66-pqmpp\" (UID: \"9dd8ee42-c218-4230-862c-1b52c53f28b0\") " pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:40.020467 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.020214 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:56:40.061279 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.061187 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh"] Jul 10 15:56:40.064484 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.064462 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:40.067429 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.067405 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 15:56:40.067429 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.067426 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wjg95\"" Jul 10 15:56:40.073823 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.073797 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh"] Jul 10 15:56:40.195860 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.195828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a54a2baa-3029-492e-a879-a47aa1de5658-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-h52gh\" (UID: \"a54a2baa-3029-492e-a879-a47aa1de5658\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:40.196062 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.195877 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd9hc\" (UniqueName: \"kubernetes.io/projected/a54a2baa-3029-492e-a879-a47aa1de5658-kube-api-access-vd9hc\") pod \"monitoring-plugin-5f68df7f58-h52gh\" (UID: \"a54a2baa-3029-492e-a879-a47aa1de5658\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:40.296494 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.296461 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a54a2baa-3029-492e-a879-a47aa1de5658-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-h52gh\" (UID: \"a54a2baa-3029-492e-a879-a47aa1de5658\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:40.296642 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.296512 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd9hc\" (UniqueName: \"kubernetes.io/projected/a54a2baa-3029-492e-a879-a47aa1de5658-kube-api-access-vd9hc\") pod \"monitoring-plugin-5f68df7f58-h52gh\" (UID: \"a54a2baa-3029-492e-a879-a47aa1de5658\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:40.296642 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:40.296610 2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 10 15:56:40.296742 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:56:40.296709 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a54a2baa-3029-492e-a879-a47aa1de5658-monitoring-plugin-cert podName:a54a2baa-3029-492e-a879-a47aa1de5658 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:40.796683803 +0000 UTC m=+76.344373092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a54a2baa-3029-492e-a879-a47aa1de5658-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-h52gh" (UID: "a54a2baa-3029-492e-a879-a47aa1de5658") : secret "monitoring-plugin-cert" not found Jul 10 15:56:40.309838 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.309809 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd9hc\" (UniqueName: \"kubernetes.io/projected/a54a2baa-3029-492e-a879-a47aa1de5658-kube-api-access-vd9hc\") pod \"monitoring-plugin-5f68df7f58-h52gh\" (UID: \"a54a2baa-3029-492e-a879-a47aa1de5658\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:40.801526 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.801492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a54a2baa-3029-492e-a879-a47aa1de5658-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-h52gh\" (UID: \"a54a2baa-3029-492e-a879-a47aa1de5658\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:40.804207 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.804174 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a54a2baa-3029-492e-a879-a47aa1de5658-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-h52gh\" (UID: \"a54a2baa-3029-492e-a879-a47aa1de5658\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:40.976314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:40.976282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:41.301387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.301355 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b4d76df4c-f768m"] Jul 10 15:56:41.306030 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.306004 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.320407 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.320378 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b4d76df4c-f768m"] Jul 10 15:56:41.322161 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.322123 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 15:56:41.407045 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.407002 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-console-config\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.407227 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.407130 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-service-ca\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.407227 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.407195 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-serving-cert\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.407348 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.407225 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-oauth-config\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.407348 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.407273 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-oauth-serving-cert\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.407426 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.407346 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf7sh\" (UniqueName: \"kubernetes.io/projected/a5666519-6eb2-4827-a632-717d61de8e25-kube-api-access-tf7sh\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.407426 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.407407 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-trusted-ca-bundle\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.491761 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.491249 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 15:56:41.497635 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.497605 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.500592 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.500561 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 15:56:41.500958 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.500783 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 15:56:41.500958 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.500823 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 15:56:41.500958 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.500823 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hdzlm\"" Jul 10 15:56:41.500958 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.500855 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 15:56:41.501424 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.501337 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 15:56:41.501424 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.501370 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 15:56:41.501424 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.501405 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 15:56:41.501684 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.501446 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 15:56:41.501684 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.501576 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 15:56:41.501684 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.501668 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 15:56:41.501847 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.501704 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6a0t57dkbgisv\"" Jul 10 15:56:41.501847 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.501780 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 15:56:41.501847 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.501837 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 15:56:41.506280 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.505887 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 15:56:41.508019 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.507997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-serving-cert\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.508140 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.508037 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-oauth-config\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.508140 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.508072 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-oauth-serving-cert\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.508140 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.508108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf7sh\" (UniqueName: \"kubernetes.io/projected/a5666519-6eb2-4827-a632-717d61de8e25-kube-api-access-tf7sh\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.508290 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.508157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-trusted-ca-bundle\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.508290 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.508193 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-console-config\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.508290 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.508251 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-service-ca\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.509777 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.509535 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-service-ca\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.510560 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.510374 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 15:56:41.510958 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.510714 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-oauth-serving-cert\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.511644 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.511617 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-serving-cert\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.512138 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.512102 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-oauth-config\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.513005 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.512983 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-console-config\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.513468 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.513384 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 15:56:41.514121 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.514077 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-trusted-ca-bundle\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.519112 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.519072 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf7sh\" (UniqueName: \"kubernetes.io/projected/a5666519-6eb2-4827-a632-717d61de8e25-kube-api-access-tf7sh\") pod \"console-7b4d76df4c-f768m\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.609589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609341 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.609589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609406 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.609589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609434 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.609589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609459 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.609589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609487 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.609589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609543 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-config\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609645 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609678 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609709 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609733 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609756 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-config-out\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609871 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wqkd\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-kube-api-access-6wqkd\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.609981 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.610020 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.610006 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-web-config\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.625186 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.625160 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:41.710833 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.710794 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.710846 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.710911 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqkd\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-kube-api-access-6wqkd\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711038 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.710971 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711213 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-web-config\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711213 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711289 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711229 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711289 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711346 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711289 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711346 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711418 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.711418 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711409 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-config\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.712948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711516 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.712948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711786 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.712948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.711993 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.712948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.712282 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.712948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.712302 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.712948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.712352 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.712948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.712396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.712948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.712424 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.712948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.712560 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.715230 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.714920 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.715230 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.714985 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.715230 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.715016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.715230 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.715042 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.715230 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.715085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.715230 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.715111 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-config-out\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.715814 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.715653 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.716060 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.716037 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.717848 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.717419 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-web-config\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.717848 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.717431 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.717848 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.717815 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-config\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.719886 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.719478 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-config-out\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.719886 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.719639 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.720050 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.719919 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.720411 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.720368 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.720492 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.720439 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.720963 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.720897 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.721834 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.721802 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wqkd\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-kube-api-access-6wqkd\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.722482 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.722454 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.812237 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.812013 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:56:41.832816 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.832780 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:41.833012 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.832847 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:41.838080 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:41.838058 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:42.547949 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:42.547906 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:56:46.524417 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:46.524392 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b4d76df4c-f768m"] Jul 10 15:56:46.540179 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:46.539882 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dcc847c66-pqmpp"] Jul 10 15:56:46.656981 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:46.656879 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5666519_6eb2_4827_a632_717d61de8e25.slice/crio-fa39c77d3c11b9a8c1e8343711fe522d5c9e9d671d536d570bf2e62e62cb6168 WatchSource:0}: Error finding container fa39c77d3c11b9a8c1e8343711fe522d5c9e9d671d536d570bf2e62e62cb6168: Status 404 returned error can't find the container with id fa39c77d3c11b9a8c1e8343711fe522d5c9e9d671d536d570bf2e62e62cb6168 Jul 10 15:56:46.657655 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:46.657612 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd8ee42_c218_4230_862c_1b52c53f28b0.slice/crio-0d9172c6a0353e2c213db2a68ada4f33278441c6a46eb23f9d03b64e5bb8e6d4 WatchSource:0}: Error finding container 0d9172c6a0353e2c213db2a68ada4f33278441c6a46eb23f9d03b64e5bb8e6d4: Status 404 returned error can't find the container with id 0d9172c6a0353e2c213db2a68ada4f33278441c6a46eb23f9d03b64e5bb8e6d4 Jul 10 15:56:46.773066 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:46.772990 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh"] Jul 10 15:56:46.776239 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:46.776208 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54a2baa_3029_492e_a879_a47aa1de5658.slice/crio-03479e176ea1db641b08084beeea9432489f16da486e3792fec205ad96ce552f WatchSource:0}: Error finding container 03479e176ea1db641b08084beeea9432489f16da486e3792fec205ad96ce552f: Status 404 returned error can't find the container with id 03479e176ea1db641b08084beeea9432489f16da486e3792fec205ad96ce552f Jul 10 15:56:46.784575 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:46.784488 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 15:56:46.791856 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:56:46.791828 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99273aea_df95_4d2a_a724_75fc11d1db72.slice/crio-063c59d05c26a85e8573ca4509e5a2dae219426573eefa1bfefdd170c66b502f WatchSource:0}: Error finding container 063c59d05c26a85e8573ca4509e5a2dae219426573eefa1bfefdd170c66b502f: Status 404 returned error can't find the container with id 063c59d05c26a85e8573ca4509e5a2dae219426573eefa1bfefdd170c66b502f Jul 10 15:56:47.568595 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.568551 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-bd8gn" event={"ID":"a74f3da0-f8dd-48ef-9e6b-f6208b2933f5","Type":"ContainerStarted","Data":"f704c3816fdf65491b421901dd916bf3bd0ed8d16ee20d3e515c02b021316bdd"} Jul 10 15:56:47.571531 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.571488 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-bd8gn" Jul 10 15:56:47.574309 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.574107 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerStarted","Data":"063c59d05c26a85e8573ca4509e5a2dae219426573eefa1bfefdd170c66b502f"} Jul 10 15:56:47.575962 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.575901 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" event={"ID":"a54a2baa-3029-492e-a879-a47aa1de5658","Type":"ContainerStarted","Data":"03479e176ea1db641b08084beeea9432489f16da486e3792fec205ad96ce552f"} Jul 10 15:56:47.578505 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.578479 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4d76df4c-f768m" event={"ID":"a5666519-6eb2-4827-a632-717d61de8e25","Type":"ContainerStarted","Data":"06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4"} Jul 10 15:56:47.578627 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.578527 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4d76df4c-f768m" event={"ID":"a5666519-6eb2-4827-a632-717d61de8e25","Type":"ContainerStarted","Data":"fa39c77d3c11b9a8c1e8343711fe522d5c9e9d671d536d570bf2e62e62cb6168"} Jul 10 15:56:47.582275 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.582255 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-bd8gn" Jul 10 15:56:47.585821 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.585769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" event={"ID":"9dd8ee42-c218-4230-862c-1b52c53f28b0","Type":"ContainerStarted","Data":"0d9172c6a0353e2c213db2a68ada4f33278441c6a46eb23f9d03b64e5bb8e6d4"} Jul 10 15:56:47.617849 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.616162 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-bd8gn" podStartSLOduration=1.698134623 podStartE2EDuration="20.616140568s" totalImagesPullingTime="18.918005945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:47.594274088 +0000 UTC m=+83.141963398" watchObservedRunningTime="2026-07-10 15:56:47.616140568 +0000 UTC m=+83.163829892" Jul 10 15:56:47.640669 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:47.639071 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b4d76df4c-f768m" podStartSLOduration=6.639049206 podStartE2EDuration="6.639049206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:47.637209724 +0000 UTC m=+83.184899033" watchObservedRunningTime="2026-07-10 15:56:47.639049206 +0000 UTC m=+83.186738516" Jul 10 15:56:51.625589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:51.625555 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:51.626068 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:51.625703 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:51.631679 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:51.631640 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:52.613829 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.613723 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" event={"ID":"3cd1188a-4ea6-458f-bd4e-8d721792e486","Type":"ContainerStarted","Data":"46aa414a45cbee88e3363ca43c825a8799452c2ce4de61d3f65d66511dc1db4c"} Jul 10 15:56:52.619989 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.617428 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" event={"ID":"5d212765-ebf1-4605-a6f0-9ca9fc7520d8","Type":"ContainerStarted","Data":"6c1c42a5b20aedc0fcf3e06c3c1c901046106cbb0a3cc89ce74e7df5e05a36bd"} Jul 10 15:56:52.629410 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.629380 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pdzg" event={"ID":"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82","Type":"ContainerStarted","Data":"f60bebae78ebb8ca42e79a6c04ed69afb8ad02c33ee86b2089009c4bed5ed2fc"} Jul 10 15:56:52.634197 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.633323 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerStarted","Data":"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21"} Jul 10 15:56:52.642555 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.641715 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" event={"ID":"a54a2baa-3029-492e-a879-a47aa1de5658","Type":"ContainerStarted","Data":"3b106039b7f2b648a44d451d57d4cc104599f8b55f600ab2b911b11047a6e741"} Jul 10 15:56:52.642555 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.642303 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:52.645648 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.643471 2582 patch_prober.go:28] interesting pod/monitoring-plugin-5f68df7f58-h52gh container/monitoring-plugin namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.18:9443/health\": dial tcp 10.134.0.18:9443: connect: connection refused" start-of-body= Jul 10 15:56:52.645648 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.643516 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" podUID="a54a2baa-3029-492e-a879-a47aa1de5658" containerName="monitoring-plugin" probeResult="failure" output="Get \"https://10.134.0.18:9443/health\": dial tcp 10.134.0.18:9443: connect: connection refused" Jul 10 15:56:52.648881 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.647212 2582 generic.go:356] "Generic (PLEG): container finished" podID="69078a3e-76f7-4ae3-b371-db60681751c2" containerID="d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d" exitCode=0 Jul 10 15:56:52.648881 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.647312 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerDied","Data":"d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d"} Jul 10 15:56:52.662249 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.661547 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" event={"ID":"9dd8ee42-c218-4230-862c-1b52c53f28b0","Type":"ContainerStarted","Data":"8b8ced2a99d1f3e0dca913a6417ba3e6ec4783be7a26787877dd32482290aaac"} Jul 10 15:56:52.670211 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.670189 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:56:52.750817 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.748479 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" podStartSLOduration=7.189544954 podStartE2EDuration="12.748458668s" totalImagesPullingTime="5.558913714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:52.746822691 +0000 UTC m=+88.294512001" watchObservedRunningTime="2026-07-10 15:56:52.748458668 +0000 UTC m=+88.296147977" Jul 10 15:56:52.768286 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.768217 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" podStartSLOduration=8.106746531 podStartE2EDuration="13.768195539s" totalImagesPullingTime="5.661449008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:52.76559475 +0000 UTC m=+88.313284062" watchObservedRunningTime="2026-07-10 15:56:52.768195539 +0000 UTC m=+88.315885052" Jul 10 15:56:52.826199 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:52.826168 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6998ccc548-wtpp4"] Jul 10 15:56:53.671178 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.671011 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" event={"ID":"3cd1188a-4ea6-458f-bd4e-8d721792e486","Type":"ContainerStarted","Data":"525c0ac6da224c10e6cb2a765cf5a47ee2c6562d6163a873d2a181c5f3b4a859"} Jul 10 15:56:53.671178 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.671103 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" event={"ID":"3cd1188a-4ea6-458f-bd4e-8d721792e486","Type":"ContainerStarted","Data":"bbe13be7ad0052ddd667df3914b12d694a4c232afcc49f7f17dec7ec948fb730"} Jul 10 15:56:53.677404 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.677368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" event={"ID":"5d212765-ebf1-4605-a6f0-9ca9fc7520d8","Type":"ContainerStarted","Data":"77ccb191ad27237173019aa811e99bcbf8e044cb622d88effeca7556df4ff366"} Jul 10 15:56:53.677553 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.677437 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" event={"ID":"5d212765-ebf1-4605-a6f0-9ca9fc7520d8","Type":"ContainerStarted","Data":"f9484bca6c6b7be5a2302c1c65dd15627f585439d0fb4e9703ee2db9e4e89057"} Jul 10 15:56:53.695839 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.695196 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" event={"ID":"1cf47c89-b329-4772-a08a-c6bc9313f659","Type":"ContainerStarted","Data":"af10cecf62a6c9a2793b3f5fb8e4694b279f6f33ad35741e6623ef6a44a75f71"} Jul 10 15:56:53.699023 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.698810 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-7jnsl" podStartSLOduration=5.46092965 podStartE2EDuration="18.69879059s" totalImagesPullingTime="13.23786094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:53.696516612 +0000 UTC m=+89.244205946" watchObservedRunningTime="2026-07-10 15:56:53.69879059 +0000 UTC m=+89.246479892" Jul 10 15:56:53.704426 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.703600 2582 generic.go:356] "Generic (PLEG): container finished" podID="67e7aaa8-c68d-41ff-bbfa-7b1349f84f82" containerID="f60bebae78ebb8ca42e79a6c04ed69afb8ad02c33ee86b2089009c4bed5ed2fc" exitCode=0 Jul 10 15:56:53.704426 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.703671 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pdzg" event={"ID":"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82","Type":"ContainerDied","Data":"f60bebae78ebb8ca42e79a6c04ed69afb8ad02c33ee86b2089009c4bed5ed2fc"} Jul 10 15:56:53.716414 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.712357 2582 generic.go:356] "Generic (PLEG): container finished" podID="99273aea-df95-4d2a-a724-75fc11d1db72" containerID="94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21" exitCode=0 Jul 10 15:56:53.716414 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.714343 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerDied","Data":"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21"} Jul 10 15:56:53.724601 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.724546 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h52gh" Jul 10 15:56:53.762713 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:53.762658 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fc8ws" podStartSLOduration=5.6295278159999995 podStartE2EDuration="18.762638276s" totalImagesPullingTime="13.13311046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:53.72280112 +0000 UTC m=+89.270490430" watchObservedRunningTime="2026-07-10 15:56:53.762638276 +0000 UTC m=+89.310327586" Jul 10 15:56:54.728321 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:54.728207 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pdzg" event={"ID":"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82","Type":"ContainerStarted","Data":"ddcd979e302c5c666d49e1d876fff317242975072a929a133b233cfa10a9783b"} Jul 10 15:56:54.728321 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:54.728279 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pdzg" event={"ID":"67e7aaa8-c68d-41ff-bbfa-7b1349f84f82","Type":"ContainerStarted","Data":"47ce0a17f68526ec8631131e6613a3d45f65f8b40b0e934bc59dbf8623ee8ea6"} Jul 10 15:56:54.748226 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:54.748167 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8pdzg" podStartSLOduration=6.060646332 podStartE2EDuration="19.748149399s" totalImagesPullingTime="13.473820193s" totalInitContainerRuntime="213.682874ms" isStatefulPod=true podCreationTimestamp="2026-07-10 15:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:54.746952373 +0000 UTC m=+90.294641681" watchObservedRunningTime="2026-07-10 15:56:54.748149399 +0000 UTC m=+90.295838711" Jul 10 15:56:55.738271 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:55.738215 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" event={"ID":"3cd1188a-4ea6-458f-bd4e-8d721792e486","Type":"ContainerStarted","Data":"94af6813e0830c1837cdbae666d4e45a9bb8891663db54f945a11b3a9ea086db"} Jul 10 15:56:55.739610 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:55.738981 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" event={"ID":"3cd1188a-4ea6-458f-bd4e-8d721792e486","Type":"ContainerStarted","Data":"5bd28139b2cdca4888c623a528ab55820aa1dd85cd637a28c1b35f6f422db589"} Jul 10 15:56:55.739610 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:55.739036 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" event={"ID":"3cd1188a-4ea6-458f-bd4e-8d721792e486","Type":"ContainerStarted","Data":"f38cfb26d32b6941b0ee06eb785aabfb2a1139046ef605bd58a4bdc1a1b40f14"} Jul 10 15:56:55.739610 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:55.739084 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:56:55.744604 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:55.744478 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerStarted","Data":"fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0"} Jul 10 15:56:55.744604 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:55.744551 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerStarted","Data":"10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642"} Jul 10 15:56:55.764129 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:55.764073 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" podStartSLOduration=2.191774735 podStartE2EDuration="17.764055187s" totalImagesPullingTime="15.572280452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:55.761588839 +0000 UTC m=+91.309278171" watchObservedRunningTime="2026-07-10 15:56:55.764055187 +0000 UTC m=+91.311744505" Jul 10 15:56:56.752185 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:56.752131 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerStarted","Data":"4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505"} Jul 10 15:56:56.752744 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:56.752213 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerStarted","Data":"56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84"} Jul 10 15:56:56.752744 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:56.752253 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerStarted","Data":"6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a"} Jul 10 15:56:56.752744 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:56.752292 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerStarted","Data":"9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731"} Jul 10 15:56:56.783969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:56.783900 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.934119264 podStartE2EDuration="20.783884523s" totalImagesPullingTime="15.805038952s" totalInitContainerRuntime="44.726307ms" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:56.781796173 +0000 UTC m=+92.329485476" watchObservedRunningTime="2026-07-10 15:56:56.783884523 +0000 UTC m=+92.331573832" Jul 10 15:56:58.764003 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:58.763964 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerStarted","Data":"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c"} Jul 10 15:56:58.764457 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:58.764054 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerStarted","Data":"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9"} Jul 10 15:56:58.764457 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:58.764096 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerStarted","Data":"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9"} Jul 10 15:56:59.772465 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:59.772426 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerStarted","Data":"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85"} Jul 10 15:56:59.773052 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:59.772501 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerStarted","Data":"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485"} Jul 10 15:56:59.773052 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:59.772541 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerStarted","Data":"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01"} Jul 10 15:56:59.805793 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:56:59.805723 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.590474192 podStartE2EDuration="18.805701748s" totalImagesPullingTime="10.167228139s" totalInitContainerRuntime="47.999417ms" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:59.80379976 +0000 UTC m=+95.351489061" watchObservedRunningTime="2026-07-10 15:56:59.805701748 +0000 UTC m=+95.353391055" Jul 10 15:57:00.021422 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:00.021385 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:57:00.021616 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:00.021467 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:57:01.758366 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:01.758335 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6db7bd667-8t4p7" Jul 10 15:57:01.812619 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:01.812590 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:57:10.538716 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:10.538678 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-95nwt" Jul 10 15:57:17.867969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:17.867898 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6998ccc548-wtpp4" podUID="9e948144-de15-4ff3-b5f8-d175744d7b83" containerName="console" containerID="cri-o://662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39" gracePeriod=15 Jul 10 15:57:18.136819 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.136765 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:57:18.171052 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171025 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-oauth-serving-cert\") pod \"9e948144-de15-4ff3-b5f8-d175744d7b83\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " Jul 10 15:57:18.171184 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171114 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-serving-cert\") pod \"9e948144-de15-4ff3-b5f8-d175744d7b83\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " Jul 10 15:57:18.171184 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171152 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-oauth-config\") pod \"9e948144-de15-4ff3-b5f8-d175744d7b83\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " Jul 10 15:57:18.171184 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171183 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-service-ca\") pod \"9e948144-de15-4ff3-b5f8-d175744d7b83\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " Jul 10 15:57:18.171362 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171211 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-console-config\") pod \"9e948144-de15-4ff3-b5f8-d175744d7b83\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " Jul 10 15:57:18.171362 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171242 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjhdp\" (UniqueName: \"kubernetes.io/projected/9e948144-de15-4ff3-b5f8-d175744d7b83-kube-api-access-hjhdp\") pod \"9e948144-de15-4ff3-b5f8-d175744d7b83\" (UID: \"9e948144-de15-4ff3-b5f8-d175744d7b83\") " Jul 10 15:57:18.171506 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171477 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e948144-de15-4ff3-b5f8-d175744d7b83" (UID: "9e948144-de15-4ff3-b5f8-d175744d7b83"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:18.171578 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171554 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-oauth-serving-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.171717 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171689 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-console-config" (OuterVolumeSpecName: "console-config") pod "9e948144-de15-4ff3-b5f8-d175744d7b83" (UID: "9e948144-de15-4ff3-b5f8-d175744d7b83"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:18.171865 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.171837 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e948144-de15-4ff3-b5f8-d175744d7b83" (UID: "9e948144-de15-4ff3-b5f8-d175744d7b83"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:18.173464 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.173438 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e948144-de15-4ff3-b5f8-d175744d7b83" (UID: "9e948144-de15-4ff3-b5f8-d175744d7b83"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:18.173563 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.173540 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e948144-de15-4ff3-b5f8-d175744d7b83" (UID: "9e948144-de15-4ff3-b5f8-d175744d7b83"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:18.173619 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.173595 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e948144-de15-4ff3-b5f8-d175744d7b83-kube-api-access-hjhdp" (OuterVolumeSpecName: "kube-api-access-hjhdp") pod "9e948144-de15-4ff3-b5f8-d175744d7b83" (UID: "9e948144-de15-4ff3-b5f8-d175744d7b83"). InnerVolumeSpecName "kube-api-access-hjhdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:57:18.272303 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.272271 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-serving-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.272303 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.272300 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e948144-de15-4ff3-b5f8-d175744d7b83-console-oauth-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.272303 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.272309 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.272559 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.272318 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e948144-de15-4ff3-b5f8-d175744d7b83-console-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.272559 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.272327 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjhdp\" (UniqueName: \"kubernetes.io/projected/9e948144-de15-4ff3-b5f8-d175744d7b83-kube-api-access-hjhdp\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.856540 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.856510 2582 generic.go:356] "Generic (PLEG): container finished" podID="9e948144-de15-4ff3-b5f8-d175744d7b83" containerID="662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39" exitCode=0 Jul 10 15:57:18.856707 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.856546 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6998ccc548-wtpp4" event={"ID":"9e948144-de15-4ff3-b5f8-d175744d7b83","Type":"ContainerDied","Data":"662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39"} Jul 10 15:57:18.856707 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.856556 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6998ccc548-wtpp4" Jul 10 15:57:18.856707 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.856582 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6998ccc548-wtpp4" event={"ID":"9e948144-de15-4ff3-b5f8-d175744d7b83","Type":"ContainerDied","Data":"d2a86ed7bbd25faf4b95cffbf47e1a2014737dc1598e005237e42038ef2cb824"} Jul 10 15:57:18.856707 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.856601 2582 scope.go:117] "RemoveContainer" containerID="662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39" Jul 10 15:57:18.865316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.865300 2582 scope.go:117] "RemoveContainer" containerID="662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39" Jul 10 15:57:18.865553 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:57:18.865533 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39\": container with ID starting with 662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39 not found: ID does not exist" containerID="662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39" Jul 10 15:57:18.865617 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.865565 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39"} err="failed to get container status \"662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39\": rpc error: code = NotFound desc = could not find container \"662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39\": container with ID starting with 662339ecb4d7abb70a9f3601208a4c7a910fe22a410b0d908a60356dbbd79b39 not found: ID does not exist" Jul 10 15:57:18.877527 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.877504 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6998ccc548-wtpp4"] Jul 10 15:57:18.881318 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:18.881300 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6998ccc548-wtpp4"] Jul 10 15:57:20.026231 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:20.026202 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:57:20.030026 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:20.030002 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-dcc847c66-pqmpp" Jul 10 15:57:20.141885 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:20.139756 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e948144-de15-4ff3-b5f8-d175744d7b83" path="/var/lib/kubelet/pods/9e948144-de15-4ff3-b5f8-d175744d7b83/volumes" Jul 10 15:57:22.310813 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:22.310786 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gtxc4_bcc40706-c6bc-4739-8b1f-bc1438b91219/serve-healthcheck-canary/0.log" Jul 10 15:57:41.812416 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:41.812380 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:57:41.831694 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:41.831668 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:57:41.971167 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:41.971140 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:57:55.545747 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:55.545713 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:57:55.546148 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:55.546021 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="alertmanager" containerID="cri-o://10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642" gracePeriod=120 Jul 10 15:57:55.546148 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:55.546109 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="config-reloader" containerID="cri-o://fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0" gracePeriod=120 Jul 10 15:57:55.546269 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:55.546100 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy-metric" containerID="cri-o://6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a" gracePeriod=120 Jul 10 15:57:55.546269 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:55.546153 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="prom-label-proxy" containerID="cri-o://56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84" gracePeriod=120 Jul 10 15:57:55.546269 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:55.546101 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy-web" containerID="cri-o://4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505" gracePeriod=120 Jul 10 15:57:55.546407 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:55.546152 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy" containerID="cri-o://9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731" gracePeriod=120 Jul 10 15:57:56.012566 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.012531 2582 generic.go:356] "Generic (PLEG): container finished" podID="69078a3e-76f7-4ae3-b371-db60681751c2" containerID="56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84" exitCode=0 Jul 10 15:57:56.012566 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.012560 2582 generic.go:356] "Generic (PLEG): container finished" podID="69078a3e-76f7-4ae3-b371-db60681751c2" containerID="9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731" exitCode=0 Jul 10 15:57:56.012566 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.012569 2582 generic.go:356] "Generic (PLEG): container finished" podID="69078a3e-76f7-4ae3-b371-db60681751c2" containerID="fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0" exitCode=0 Jul 10 15:57:56.012566 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.012576 2582 generic.go:356] "Generic (PLEG): container finished" podID="69078a3e-76f7-4ae3-b371-db60681751c2" containerID="10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642" exitCode=0 Jul 10 15:57:56.012904 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.012599 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerDied","Data":"56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84"} Jul 10 15:57:56.012904 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.012672 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerDied","Data":"9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731"} Jul 10 15:57:56.012904 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.012698 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerDied","Data":"fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0"} Jul 10 15:57:56.012904 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.012723 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerDied","Data":"10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642"} Jul 10 15:57:56.794767 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.794745 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:56.808723 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808701 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.808822 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808736 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-main-db\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.808822 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808754 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.808822 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808793 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.808822 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808812 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-main-tls\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.809010 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808827 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-web-config\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.809010 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808843 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-cluster-tls-config\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.809010 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808891 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf2tk\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-kube-api-access-qf2tk\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.809010 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808918 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-trusted-ca-bundle\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.809010 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808956 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-config-out\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.809010 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.808996 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-config-volume\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.809301 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.809025 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-metrics-client-ca\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.809301 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.809050 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-tls-assets\") pod \"69078a3e-76f7-4ae3-b371-db60681751c2\" (UID: \"69078a3e-76f7-4ae3-b371-db60681751c2\") " Jul 10 15:57:56.809301 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.809056 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:57:56.809437 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.809306 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-main-db\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.809437 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.809421 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:56.810536 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.810508 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:56.811734 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.811698 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:57:56.811823 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.811728 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:56.812557 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.812513 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-kube-api-access-qf2tk" (OuterVolumeSpecName: "kube-api-access-qf2tk") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "kube-api-access-qf2tk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:57:56.812889 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.812791 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:56.813339 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.813142 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:56.813339 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.813296 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:56.813555 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.813485 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-config-volume" (OuterVolumeSpecName: "config-volume") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:56.813638 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.813598 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-config-out" (OuterVolumeSpecName: "config-out") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:57:56.818796 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.818758 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:56.828048 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.828018 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-web-config" (OuterVolumeSpecName: "web-config") pod "69078a3e-76f7-4ae3-b371-db60681751c2" (UID: "69078a3e-76f7-4ae3-b371-db60681751c2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:56.909857 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909783 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.909857 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909810 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.909857 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909819 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.909857 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909828 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-secret-alertmanager-main-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.909857 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909837 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-web-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.909857 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909846 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-cluster-tls-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.909857 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909853 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf2tk\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-kube-api-access-qf2tk\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.909857 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909861 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.910226 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909870 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69078a3e-76f7-4ae3-b371-db60681751c2-config-out\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.910226 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909878 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69078a3e-76f7-4ae3-b371-db60681751c2-config-volume\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.910226 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909885 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69078a3e-76f7-4ae3-b371-db60681751c2-metrics-client-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:56.910226 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:56.909892 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69078a3e-76f7-4ae3-b371-db60681751c2-tls-assets\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:57:57.019175 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.019137 2582 generic.go:356] "Generic (PLEG): container finished" podID="69078a3e-76f7-4ae3-b371-db60681751c2" containerID="6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a" exitCode=0 Jul 10 15:57:57.019175 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.019166 2582 generic.go:356] "Generic (PLEG): container finished" podID="69078a3e-76f7-4ae3-b371-db60681751c2" containerID="4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505" exitCode=0 Jul 10 15:57:57.019361 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.019214 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerDied","Data":"6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a"} Jul 10 15:57:57.019361 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.019228 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.019361 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.019297 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerDied","Data":"4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505"} Jul 10 15:57:57.019361 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.019341 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69078a3e-76f7-4ae3-b371-db60681751c2","Type":"ContainerDied","Data":"091adda0d5f22b25deb81e0e165b945f27dae212fa6a87e17ebbede0aa4a8f4a"} Jul 10 15:57:57.019361 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.019353 2582 scope.go:117] "RemoveContainer" containerID="56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84" Jul 10 15:57:57.026915 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.026897 2582 scope.go:117] "RemoveContainer" containerID="6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a" Jul 10 15:57:57.033626 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.033611 2582 scope.go:117] "RemoveContainer" containerID="9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731" Jul 10 15:57:57.039939 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.039911 2582 scope.go:117] "RemoveContainer" containerID="4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505" Jul 10 15:57:57.044022 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.044000 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:57:57.046896 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.046848 2582 scope.go:117] "RemoveContainer" containerID="fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0" Jul 10 15:57:57.049458 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.049440 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:57:57.054102 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.054088 2582 scope.go:117] "RemoveContainer" containerID="10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642" Jul 10 15:57:57.060886 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.060871 2582 scope.go:117] "RemoveContainer" containerID="d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d" Jul 10 15:57:57.067707 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.067681 2582 scope.go:117] "RemoveContainer" containerID="56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84" Jul 10 15:57:57.067920 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:57:57.067901 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84\": container with ID starting with 56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84 not found: ID does not exist" containerID="56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84" Jul 10 15:57:57.067981 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.067948 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84"} err="failed to get container status \"56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84\": rpc error: code = NotFound desc = could not find container \"56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84\": container with ID starting with 56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84 not found: ID does not exist" Jul 10 15:57:57.067981 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.067968 2582 scope.go:117] "RemoveContainer" containerID="6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a" Jul 10 15:57:57.068197 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:57:57.068178 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a\": container with ID starting with 6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a not found: ID does not exist" containerID="6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a" Jul 10 15:57:57.068289 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.068199 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a"} err="failed to get container status \"6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a\": rpc error: code = NotFound desc = could not find container \"6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a\": container with ID starting with 6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a not found: ID does not exist" Jul 10 15:57:57.068289 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.068214 2582 scope.go:117] "RemoveContainer" containerID="9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731" Jul 10 15:57:57.068420 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:57:57.068405 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731\": container with ID starting with 9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731 not found: ID does not exist" containerID="9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731" Jul 10 15:57:57.068461 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.068424 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731"} err="failed to get container status \"9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731\": rpc error: code = NotFound desc = could not find container \"9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731\": container with ID starting with 9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731 not found: ID does not exist" Jul 10 15:57:57.068461 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.068436 2582 scope.go:117] "RemoveContainer" containerID="4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505" Jul 10 15:57:57.068655 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:57:57.068638 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505\": container with ID starting with 4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505 not found: ID does not exist" containerID="4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505" Jul 10 15:57:57.068692 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.068660 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505"} err="failed to get container status \"4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505\": rpc error: code = NotFound desc = could not find container \"4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505\": container with ID starting with 4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505 not found: ID does not exist" Jul 10 15:57:57.068692 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.068676 2582 scope.go:117] "RemoveContainer" containerID="fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0" Jul 10 15:57:57.068894 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:57:57.068876 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0\": container with ID starting with fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0 not found: ID does not exist" containerID="fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0" Jul 10 15:57:57.068979 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.068902 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0"} err="failed to get container status \"fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0\": rpc error: code = NotFound desc = could not find container \"fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0\": container with ID starting with fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0 not found: ID does not exist" Jul 10 15:57:57.068979 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.068922 2582 scope.go:117] "RemoveContainer" containerID="10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642" Jul 10 15:57:57.069153 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:57:57.069138 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642\": container with ID starting with 10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642 not found: ID does not exist" containerID="10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642" Jul 10 15:57:57.069211 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.069161 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642"} err="failed to get container status \"10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642\": rpc error: code = NotFound desc = could not find container \"10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642\": container with ID starting with 10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642 not found: ID does not exist" Jul 10 15:57:57.069211 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.069183 2582 scope.go:117] "RemoveContainer" containerID="d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d" Jul 10 15:57:57.069420 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:57:57.069406 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d\": container with ID starting with d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d not found: ID does not exist" containerID="d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d" Jul 10 15:57:57.069473 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.069426 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d"} err="failed to get container status \"d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d\": rpc error: code = NotFound desc = could not find container \"d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d\": container with ID starting with d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d not found: ID does not exist" Jul 10 15:57:57.069473 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.069444 2582 scope.go:117] "RemoveContainer" containerID="56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84" Jul 10 15:57:57.069666 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.069650 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84"} err="failed to get container status \"56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84\": rpc error: code = NotFound desc = could not find container \"56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84\": container with ID starting with 56dc6c7c7d89ad95a47462dbf856ed9ebd6f4c0da5a2dc47ad3cb515ec784d84 not found: ID does not exist" Jul 10 15:57:57.069708 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.069667 2582 scope.go:117] "RemoveContainer" containerID="6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a" Jul 10 15:57:57.069876 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.069855 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a"} err="failed to get container status \"6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a\": rpc error: code = NotFound desc = could not find container \"6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a\": container with ID starting with 6109121f6b3a3e80748a025fd96b978986ae7859d6a0f8a3a26e6c7e7b43ef5a not found: ID does not exist" Jul 10 15:57:57.069914 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.069878 2582 scope.go:117] "RemoveContainer" containerID="9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731" Jul 10 15:57:57.070127 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.070110 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731"} err="failed to get container status \"9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731\": rpc error: code = NotFound desc = could not find container \"9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731\": container with ID starting with 9a0f43fc98e838d038fed306a04aedf2055666d435eb55f505d6b25e15b60731 not found: ID does not exist" Jul 10 15:57:57.070195 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.070129 2582 scope.go:117] "RemoveContainer" containerID="4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505" Jul 10 15:57:57.070352 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.070335 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505"} err="failed to get container status \"4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505\": rpc error: code = NotFound desc = could not find container \"4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505\": container with ID starting with 4975f3dc880b891e11b8eced26aeeac1d2d109b490550df67b2a9b2e0fb56505 not found: ID does not exist" Jul 10 15:57:57.070396 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.070353 2582 scope.go:117] "RemoveContainer" containerID="fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0" Jul 10 15:57:57.070541 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.070527 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0"} err="failed to get container status \"fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0\": rpc error: code = NotFound desc = could not find container \"fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0\": container with ID starting with fd52a639a7d1192097423163c7d73df814d002905b2f00c322856681d7c3aff0 not found: ID does not exist" Jul 10 15:57:57.070585 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.070542 2582 scope.go:117] "RemoveContainer" containerID="10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642" Jul 10 15:57:57.070746 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.070728 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642"} err="failed to get container status \"10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642\": rpc error: code = NotFound desc = could not find container \"10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642\": container with ID starting with 10b31e07b4d8d883d1d0fdd68e42dcf3167a390a8a2d002d1cedc7c84bf30642 not found: ID does not exist" Jul 10 15:57:57.070816 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.070747 2582 scope.go:117] "RemoveContainer" containerID="d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d" Jul 10 15:57:57.070962 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.070925 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d"} err="failed to get container status \"d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d\": rpc error: code = NotFound desc = could not find container \"d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d\": container with ID starting with d517aa89be1324ab591f115cd1aaf04710bb1a661da810d3845b72c13dd77f4d not found: ID does not exist" Jul 10 15:57:57.075737 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.075716 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:57:57.076044 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076031 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy-web" Jul 10 15:57:57.076090 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076046 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy-web" Jul 10 15:57:57.076090 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076053 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="prom-label-proxy" Jul 10 15:57:57.076090 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076058 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="prom-label-proxy" Jul 10 15:57:57.076090 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076070 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e948144-de15-4ff3-b5f8-d175744d7b83" containerName="console" Jul 10 15:57:57.076090 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076075 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e948144-de15-4ff3-b5f8-d175744d7b83" containerName="console" Jul 10 15:57:57.076090 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076083 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="config-reloader" Jul 10 15:57:57.076090 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076088 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="config-reloader" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076096 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="init-config-reloader" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076101 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="init-config-reloader" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076107 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076112 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076120 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy-metric" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076125 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy-metric" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076132 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="alertmanager" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076137 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="alertmanager" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076182 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e948144-de15-4ff3-b5f8-d175744d7b83" containerName="console" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076190 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy-web" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076197 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="alertmanager" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076203 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy-metric" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076208 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="config-reloader" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076212 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="prom-label-proxy" Jul 10 15:57:57.076314 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.076218 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" containerName="kube-rbac-proxy" Jul 10 15:57:57.082120 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.082100 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.084805 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.084785 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 15:57:57.084906 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.084890 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 15:57:57.085040 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.085024 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 15:57:57.085108 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.085045 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 15:57:57.085108 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.085030 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 15:57:57.085242 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.085229 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 15:57:57.085349 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.085325 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 15:57:57.085441 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.085430 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jkqss\"" Jul 10 15:57:57.085540 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.085524 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 15:57:57.090954 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.090918 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 15:57:57.094249 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.094230 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:57:57.111740 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.111720 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c62ede-c192-4010-b54f-051f36b7216c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.111824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.111751 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.111824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.111781 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-config-volume\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.111824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.111802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.111824 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.111821 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.112009 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.111851 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59c62ede-c192-4010-b54f-051f36b7216c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.112009 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.111874 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-web-config\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.112009 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.111891 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ttqz\" (UniqueName: \"kubernetes.io/projected/59c62ede-c192-4010-b54f-051f36b7216c-kube-api-access-6ttqz\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.112009 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.111913 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59c62ede-c192-4010-b54f-051f36b7216c-config-out\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.112009 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.112006 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.112174 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.112028 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59c62ede-c192-4010-b54f-051f36b7216c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.112174 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.112048 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.112174 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.112140 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/59c62ede-c192-4010-b54f-051f36b7216c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.213507 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213477 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/59c62ede-c192-4010-b54f-051f36b7216c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.213692 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c62ede-c192-4010-b54f-051f36b7216c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.213692 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213539 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.213692 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213561 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-config-volume\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.213692 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213576 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.213862 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.213862 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213775 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59c62ede-c192-4010-b54f-051f36b7216c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.213862 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213804 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-web-config\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.213862 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213829 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ttqz\" (UniqueName: \"kubernetes.io/projected/59c62ede-c192-4010-b54f-051f36b7216c-kube-api-access-6ttqz\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.214083 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213863 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59c62ede-c192-4010-b54f-051f36b7216c-config-out\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.214083 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213902 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.214083 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213961 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59c62ede-c192-4010-b54f-051f36b7216c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.214083 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213994 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.214790 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.214543 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c62ede-c192-4010-b54f-051f36b7216c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.216318 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.216086 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59c62ede-c192-4010-b54f-051f36b7216c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.216503 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.213958 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/59c62ede-c192-4010-b54f-051f36b7216c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.216582 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.216562 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59c62ede-c192-4010-b54f-051f36b7216c-config-out\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.216674 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.216647 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59c62ede-c192-4010-b54f-051f36b7216c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.216752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.216728 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.216796 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.216780 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-config-volume\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.217040 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.217001 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-web-config\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.217131 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.217074 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.217486 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.217466 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.217795 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.217779 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.218525 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.218508 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/59c62ede-c192-4010-b54f-051f36b7216c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.223865 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.223848 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ttqz\" (UniqueName: \"kubernetes.io/projected/59c62ede-c192-4010-b54f-051f36b7216c-kube-api-access-6ttqz\") pod \"alertmanager-main-0\" (UID: \"59c62ede-c192-4010-b54f-051f36b7216c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.393190 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.393156 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:57:57.528594 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:57.528562 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:57:57.531724 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:57:57.531701 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c62ede_c192_4010_b54f_051f36b7216c.slice/crio-8513152348f1bbeec5c9bcc0daeafdd6d62604f303aef650b8ce7eaadd944ab6 WatchSource:0}: Error finding container 8513152348f1bbeec5c9bcc0daeafdd6d62604f303aef650b8ce7eaadd944ab6: Status 404 returned error can't find the container with id 8513152348f1bbeec5c9bcc0daeafdd6d62604f303aef650b8ce7eaadd944ab6 Jul 10 15:57:58.025163 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:58.025129 2582 generic.go:356] "Generic (PLEG): container finished" podID="59c62ede-c192-4010-b54f-051f36b7216c" containerID="ce72a260c9e51b4cd43722203e557be079cec27a9f945b4b246be9b28221256d" exitCode=0 Jul 10 15:57:58.025591 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:58.025181 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59c62ede-c192-4010-b54f-051f36b7216c","Type":"ContainerDied","Data":"ce72a260c9e51b4cd43722203e557be079cec27a9f945b4b246be9b28221256d"} Jul 10 15:57:58.025591 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:58.025251 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59c62ede-c192-4010-b54f-051f36b7216c","Type":"ContainerStarted","Data":"8513152348f1bbeec5c9bcc0daeafdd6d62604f303aef650b8ce7eaadd944ab6"} Jul 10 15:57:58.138790 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:58.138762 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69078a3e-76f7-4ae3-b371-db60681751c2" path="/var/lib/kubelet/pods/69078a3e-76f7-4ae3-b371-db60681751c2/volumes" Jul 10 15:57:59.033030 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.032992 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59c62ede-c192-4010-b54f-051f36b7216c","Type":"ContainerStarted","Data":"74563a9760a741842cb0be59a21ae5286a21f6da057dab062535f50a3dcd91c6"} Jul 10 15:57:59.033397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.033078 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59c62ede-c192-4010-b54f-051f36b7216c","Type":"ContainerStarted","Data":"6d5f2b6db9ebbc0b6a49cf29524dfa0c1ca32e0b3465365e289ac38e515a0f43"} Jul 10 15:57:59.033397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.033124 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59c62ede-c192-4010-b54f-051f36b7216c","Type":"ContainerStarted","Data":"3bbaa21e2937dc1645e6f9ec68c99e43ae35f65a80d6918af9fb761f2ab359c2"} Jul 10 15:57:59.033397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.033160 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59c62ede-c192-4010-b54f-051f36b7216c","Type":"ContainerStarted","Data":"1e7d13096d20ab0bc913b97436f7ff4333c39418a5205994de198d9f5c75a745"} Jul 10 15:57:59.033397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.033196 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59c62ede-c192-4010-b54f-051f36b7216c","Type":"ContainerStarted","Data":"3f6ac5ed2aecd1922dc8922f77e3c68ea40a01ff1c1325baa470f4017743a2f8"} Jul 10 15:57:59.033397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.033232 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59c62ede-c192-4010-b54f-051f36b7216c","Type":"ContainerStarted","Data":"43b3c8c5eab9cdbe7cc982e5d5e4d2b8867d3ae678c1b8181dffa6ba6cf7ce92"} Jul 10 15:57:59.064196 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.064141 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.049222791 podStartE2EDuration="2.064120276s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.897485ms" isStatefulPod=false podCreationTimestamp="2026-07-10 15:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:57:59.062047856 +0000 UTC m=+154.609737165" watchObservedRunningTime="2026-07-10 15:57:59.064120276 +0000 UTC m=+154.611809586" Jul 10 15:57:59.583377 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.583329 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n"] Jul 10 15:57:59.586658 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.586635 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.589610 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.589572 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 15:57:59.589610 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.589579 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 15:57:59.589853 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.589833 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-59dqm\"" Jul 10 15:57:59.589999 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.589899 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 15:57:59.590099 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.590082 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 15:57:59.590632 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.590610 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 15:57:59.595439 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.595419 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 15:57:59.607463 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.607444 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n"] Jul 10 15:57:59.633497 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.633474 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbhz4\" (UniqueName: \"kubernetes.io/projected/08313b1b-d0a8-4a81-af88-a655054fc26f-kube-api-access-wbhz4\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.633605 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.633512 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08313b1b-d0a8-4a81-af88-a655054fc26f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.633605 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.633546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-secret-telemeter-client\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.633605 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.633603 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08313b1b-d0a8-4a81-af88-a655054fc26f-serving-certs-ca-bundle\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.633708 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.633646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.633708 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.633666 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-federate-client-tls\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.633708 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.633686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08313b1b-d0a8-4a81-af88-a655054fc26f-metrics-client-ca\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.633815 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.633754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-telemeter-client-tls\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.734709 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.734674 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-secret-telemeter-client\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.734865 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.734715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08313b1b-d0a8-4a81-af88-a655054fc26f-serving-certs-ca-bundle\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.734865 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.734769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.734865 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.734808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-federate-client-tls\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.735086 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.734924 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08313b1b-d0a8-4a81-af88-a655054fc26f-metrics-client-ca\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.735086 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.735003 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-telemeter-client-tls\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.735086 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.735039 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbhz4\" (UniqueName: \"kubernetes.io/projected/08313b1b-d0a8-4a81-af88-a655054fc26f-kube-api-access-wbhz4\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.735086 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.735071 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08313b1b-d0a8-4a81-af88-a655054fc26f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.735990 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.735962 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08313b1b-d0a8-4a81-af88-a655054fc26f-metrics-client-ca\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.736190 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.736166 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08313b1b-d0a8-4a81-af88-a655054fc26f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.736277 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.736236 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08313b1b-d0a8-4a81-af88-a655054fc26f-serving-certs-ca-bundle\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.737591 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.737569 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.737686 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.737638 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-secret-telemeter-client\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.737686 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.737641 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-federate-client-tls\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.737751 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.737736 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/08313b1b-d0a8-4a81-af88-a655054fc26f-telemeter-client-tls\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.751293 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.751273 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbhz4\" (UniqueName: \"kubernetes.io/projected/08313b1b-d0a8-4a81-af88-a655054fc26f-kube-api-access-wbhz4\") pod \"telemeter-client-5d656fdcdf-ggf4n\" (UID: \"08313b1b-d0a8-4a81-af88-a655054fc26f\") " pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:57:59.897298 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:57:59.897213 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" Jul 10 15:58:00.003319 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.003289 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 15:58:00.004589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.003667 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="prometheus" containerID="cri-o://6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" gracePeriod=600 Jul 10 15:58:00.004589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.003725 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" gracePeriod=600 Jul 10 15:58:00.004589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.003750 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy-web" containerID="cri-o://ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" gracePeriod=600 Jul 10 15:58:00.004589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.003942 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="thanos-sidecar" containerID="cri-o://db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" gracePeriod=600 Jul 10 15:58:00.004589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.003955 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="config-reloader" containerID="cri-o://9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" gracePeriod=600 Jul 10 15:58:00.004589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.003920 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy" containerID="cri-o://54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" gracePeriod=600 Jul 10 15:58:00.070320 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.070298 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n"] Jul 10 15:58:00.255819 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.255790 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:00.341239 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341209 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-config\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341239 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341243 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-0\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341263 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wqkd\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-kube-api-access-6wqkd\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341284 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-db\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341309 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-grpc-tls\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341330 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-metrics-client-certs\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341366 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-2\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341387 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-tls-assets\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341438 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341408 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-config-out\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341444 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-kubelet-serving-ca-bundle\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341480 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-trusted-ca-bundle\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341517 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-1\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341549 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-web-config\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341576 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341605 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-thanos-prometheus-http-client-file\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341639 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-tls\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341682 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-serving-certs-ca-bundle\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341713 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-kube-rbac-proxy\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.341787 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341748 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-metrics-client-ca\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.342331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341793 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"99273aea-df95-4d2a-a724-75fc11d1db72\" (UID: \"99273aea-df95-4d2a-a724-75fc11d1db72\") " Jul 10 15:58:00.342331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.341843 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:00.342331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.342119 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.342331 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.342220 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:58:00.342540 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.342404 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:00.342540 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.342480 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:00.344368 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.344112 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:00.344368 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.344194 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:00.344368 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.344244 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:00.344368 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.344328 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:58:00.344653 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.344429 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:00.344653 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.344476 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:00.344990 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.344955 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-config-out" (OuterVolumeSpecName: "config-out") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:58:00.345391 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.345368 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-kube-api-access-6wqkd" (OuterVolumeSpecName: "kube-api-access-6wqkd") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "kube-api-access-6wqkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:58:00.345704 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.345683 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:00.346156 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.346108 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-config" (OuterVolumeSpecName: "config") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:00.346246 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.346174 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:00.346518 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.346491 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:00.346744 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.346728 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:00.346872 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.346851 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:00.347537 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.347511 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:00.357431 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.357410 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-web-config" (OuterVolumeSpecName: "web-config") pod "99273aea-df95-4d2a-a724-75fc11d1db72" (UID: "99273aea-df95-4d2a-a724-75fc11d1db72"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:00.443043 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.442976 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wqkd\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-kube-api-access-6wqkd\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443043 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443000 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-db\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443043 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443010 2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-grpc-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443043 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443022 2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-metrics-client-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443043 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443031 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443043 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443039 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99273aea-df95-4d2a-a724-75fc11d1db72-tls-assets\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443043 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443048 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99273aea-df95-4d2a-a724-75fc11d1db72-config-out\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443056 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443064 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443073 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-web-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443082 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443092 2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443100 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443110 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443118 2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-kube-rbac-proxy\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443127 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-configmap-metrics-client-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443135 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443144 2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/99273aea-df95-4d2a-a724-75fc11d1db72-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:00.443316 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:00.443152 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/99273aea-df95-4d2a-a724-75fc11d1db72-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:01.042147 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.042057 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" event={"ID":"08313b1b-d0a8-4a81-af88-a655054fc26f","Type":"ContainerStarted","Data":"5e509c9320af40f3f8d34c8ca7b59eca3bd5ed572e3860a18bd4aee22fd5507a"} Jul 10 15:58:01.045185 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045157 2582 generic.go:356] "Generic (PLEG): container finished" podID="99273aea-df95-4d2a-a724-75fc11d1db72" containerID="5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" exitCode=0 Jul 10 15:58:01.045185 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045182 2582 generic.go:356] "Generic (PLEG): container finished" podID="99273aea-df95-4d2a-a724-75fc11d1db72" containerID="54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" exitCode=0 Jul 10 15:58:01.045185 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045190 2582 generic.go:356] "Generic (PLEG): container finished" podID="99273aea-df95-4d2a-a724-75fc11d1db72" containerID="ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" exitCode=0 Jul 10 15:58:01.045387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045199 2582 generic.go:356] "Generic (PLEG): container finished" podID="99273aea-df95-4d2a-a724-75fc11d1db72" containerID="db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" exitCode=0 Jul 10 15:58:01.045387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045206 2582 generic.go:356] "Generic (PLEG): container finished" podID="99273aea-df95-4d2a-a724-75fc11d1db72" containerID="9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" exitCode=0 Jul 10 15:58:01.045387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045213 2582 generic.go:356] "Generic (PLEG): container finished" podID="99273aea-df95-4d2a-a724-75fc11d1db72" containerID="6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" exitCode=0 Jul 10 15:58:01.045387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045237 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.045387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045245 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerDied","Data":"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85"} Jul 10 15:58:01.045387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045308 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerDied","Data":"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485"} Jul 10 15:58:01.045387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045335 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerDied","Data":"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01"} Jul 10 15:58:01.045387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045359 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerDied","Data":"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c"} Jul 10 15:58:01.045387 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045381 2582 scope.go:117] "RemoveContainer" containerID="5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" Jul 10 15:58:01.045743 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045391 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerDied","Data":"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9"} Jul 10 15:58:01.045743 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045420 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerDied","Data":"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9"} Jul 10 15:58:01.045743 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.045444 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99273aea-df95-4d2a-a724-75fc11d1db72","Type":"ContainerDied","Data":"063c59d05c26a85e8573ca4509e5a2dae219426573eefa1bfefdd170c66b502f"} Jul 10 15:58:01.053322 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.053249 2582 scope.go:117] "RemoveContainer" containerID="54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" Jul 10 15:58:01.060492 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.060474 2582 scope.go:117] "RemoveContainer" containerID="ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" Jul 10 15:58:01.066981 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.066960 2582 scope.go:117] "RemoveContainer" containerID="db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" Jul 10 15:58:01.073483 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.073466 2582 scope.go:117] "RemoveContainer" containerID="9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" Jul 10 15:58:01.076883 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.076863 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 15:58:01.081088 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.081073 2582 scope.go:117] "RemoveContainer" containerID="6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" Jul 10 15:58:01.085355 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.085337 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 15:58:01.089459 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.089443 2582 scope.go:117] "RemoveContainer" containerID="94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21" Jul 10 15:58:01.096150 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.096134 2582 scope.go:117] "RemoveContainer" containerID="5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" Jul 10 15:58:01.096402 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:58:01.096384 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": container with ID starting with 5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85 not found: ID does not exist" containerID="5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" Jul 10 15:58:01.096451 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.096410 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85"} err="failed to get container status \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": rpc error: code = NotFound desc = could not find container \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": container with ID starting with 5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85 not found: ID does not exist" Jul 10 15:58:01.096451 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.096430 2582 scope.go:117] "RemoveContainer" containerID="54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" Jul 10 15:58:01.096670 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:58:01.096651 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": container with ID starting with 54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485 not found: ID does not exist" containerID="54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" Jul 10 15:58:01.096762 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.096676 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485"} err="failed to get container status \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": rpc error: code = NotFound desc = could not find container \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": container with ID starting with 54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485 not found: ID does not exist" Jul 10 15:58:01.096762 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.096691 2582 scope.go:117] "RemoveContainer" containerID="ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" Jul 10 15:58:01.096914 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:58:01.096899 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": container with ID starting with ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01 not found: ID does not exist" containerID="ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" Jul 10 15:58:01.096969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.096918 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01"} err="failed to get container status \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": rpc error: code = NotFound desc = could not find container \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": container with ID starting with ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01 not found: ID does not exist" Jul 10 15:58:01.096969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.096945 2582 scope.go:117] "RemoveContainer" containerID="db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" Jul 10 15:58:01.097147 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:58:01.097132 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": container with ID starting with db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c not found: ID does not exist" containerID="db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" Jul 10 15:58:01.097187 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.097149 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c"} err="failed to get container status \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": rpc error: code = NotFound desc = could not find container \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": container with ID starting with db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c not found: ID does not exist" Jul 10 15:58:01.097187 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.097161 2582 scope.go:117] "RemoveContainer" containerID="9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" Jul 10 15:58:01.097363 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:58:01.097348 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": container with ID starting with 9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9 not found: ID does not exist" containerID="9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" Jul 10 15:58:01.097397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.097368 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9"} err="failed to get container status \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": rpc error: code = NotFound desc = could not find container \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": container with ID starting with 9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9 not found: ID does not exist" Jul 10 15:58:01.097397 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.097381 2582 scope.go:117] "RemoveContainer" containerID="6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" Jul 10 15:58:01.097571 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:58:01.097557 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": container with ID starting with 6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9 not found: ID does not exist" containerID="6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" Jul 10 15:58:01.097615 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.097574 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9"} err="failed to get container status \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": rpc error: code = NotFound desc = could not find container \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": container with ID starting with 6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9 not found: ID does not exist" Jul 10 15:58:01.097615 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.097585 2582 scope.go:117] "RemoveContainer" containerID="94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21" Jul 10 15:58:01.097788 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:58:01.097772 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": container with ID starting with 94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21 not found: ID does not exist" containerID="94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21" Jul 10 15:58:01.097836 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.097793 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21"} err="failed to get container status \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": rpc error: code = NotFound desc = could not find container \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": container with ID starting with 94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21 not found: ID does not exist" Jul 10 15:58:01.097836 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.097804 2582 scope.go:117] "RemoveContainer" containerID="5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" Jul 10 15:58:01.098065 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098048 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85"} err="failed to get container status \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": rpc error: code = NotFound desc = could not find container \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": container with ID starting with 5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85 not found: ID does not exist" Jul 10 15:58:01.098065 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098064 2582 scope.go:117] "RemoveContainer" containerID="54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" Jul 10 15:58:01.098298 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098280 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485"} err="failed to get container status \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": rpc error: code = NotFound desc = could not find container \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": container with ID starting with 54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485 not found: ID does not exist" Jul 10 15:58:01.098349 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098299 2582 scope.go:117] "RemoveContainer" containerID="ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" Jul 10 15:58:01.098530 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098513 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01"} err="failed to get container status \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": rpc error: code = NotFound desc = could not find container \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": container with ID starting with ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01 not found: ID does not exist" Jul 10 15:58:01.098589 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098531 2582 scope.go:117] "RemoveContainer" containerID="db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" Jul 10 15:58:01.098738 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098722 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c"} err="failed to get container status \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": rpc error: code = NotFound desc = could not find container \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": container with ID starting with db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c not found: ID does not exist" Jul 10 15:58:01.098777 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098739 2582 scope.go:117] "RemoveContainer" containerID="9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" Jul 10 15:58:01.098977 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098960 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9"} err="failed to get container status \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": rpc error: code = NotFound desc = could not find container \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": container with ID starting with 9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9 not found: ID does not exist" Jul 10 15:58:01.099028 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.098980 2582 scope.go:117] "RemoveContainer" containerID="6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" Jul 10 15:58:01.099201 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.099184 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9"} err="failed to get container status \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": rpc error: code = NotFound desc = could not find container \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": container with ID starting with 6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9 not found: ID does not exist" Jul 10 15:58:01.099245 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.099201 2582 scope.go:117] "RemoveContainer" containerID="94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21" Jul 10 15:58:01.099427 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.099410 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21"} err="failed to get container status \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": rpc error: code = NotFound desc = could not find container \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": container with ID starting with 94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21 not found: ID does not exist" Jul 10 15:58:01.099470 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.099428 2582 scope.go:117] "RemoveContainer" containerID="5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" Jul 10 15:58:01.099625 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.099609 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85"} err="failed to get container status \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": rpc error: code = NotFound desc = could not find container \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": container with ID starting with 5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85 not found: ID does not exist" Jul 10 15:58:01.099667 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.099626 2582 scope.go:117] "RemoveContainer" containerID="54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" Jul 10 15:58:01.099809 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.099794 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485"} err="failed to get container status \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": rpc error: code = NotFound desc = could not find container \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": container with ID starting with 54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485 not found: ID does not exist" Jul 10 15:58:01.099846 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.099810 2582 scope.go:117] "RemoveContainer" containerID="ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" Jul 10 15:58:01.100024 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100007 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01"} err="failed to get container status \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": rpc error: code = NotFound desc = could not find container \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": container with ID starting with ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01 not found: ID does not exist" Jul 10 15:58:01.100024 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100022 2582 scope.go:117] "RemoveContainer" containerID="db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" Jul 10 15:58:01.100248 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100230 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c"} err="failed to get container status \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": rpc error: code = NotFound desc = could not find container \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": container with ID starting with db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c not found: ID does not exist" Jul 10 15:58:01.100297 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100249 2582 scope.go:117] "RemoveContainer" containerID="9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" Jul 10 15:58:01.100464 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100447 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9"} err="failed to get container status \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": rpc error: code = NotFound desc = could not find container \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": container with ID starting with 9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9 not found: ID does not exist" Jul 10 15:58:01.100506 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100465 2582 scope.go:117] "RemoveContainer" containerID="6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" Jul 10 15:58:01.100662 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100647 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9"} err="failed to get container status \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": rpc error: code = NotFound desc = could not find container \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": container with ID starting with 6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9 not found: ID does not exist" Jul 10 15:58:01.100712 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100662 2582 scope.go:117] "RemoveContainer" containerID="94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21" Jul 10 15:58:01.100871 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100858 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21"} err="failed to get container status \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": rpc error: code = NotFound desc = could not find container \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": container with ID starting with 94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21 not found: ID does not exist" Jul 10 15:58:01.100913 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.100871 2582 scope.go:117] "RemoveContainer" containerID="5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" Jul 10 15:58:01.101112 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101095 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85"} err="failed to get container status \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": rpc error: code = NotFound desc = could not find container \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": container with ID starting with 5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85 not found: ID does not exist" Jul 10 15:58:01.101159 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101112 2582 scope.go:117] "RemoveContainer" containerID="54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" Jul 10 15:58:01.101345 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101325 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485"} err="failed to get container status \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": rpc error: code = NotFound desc = could not find container \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": container with ID starting with 54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485 not found: ID does not exist" Jul 10 15:58:01.101391 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101347 2582 scope.go:117] "RemoveContainer" containerID="ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" Jul 10 15:58:01.101562 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101545 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01"} err="failed to get container status \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": rpc error: code = NotFound desc = could not find container \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": container with ID starting with ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01 not found: ID does not exist" Jul 10 15:58:01.101606 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101562 2582 scope.go:117] "RemoveContainer" containerID="db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" Jul 10 15:58:01.101778 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101762 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c"} err="failed to get container status \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": rpc error: code = NotFound desc = could not find container \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": container with ID starting with db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c not found: ID does not exist" Jul 10 15:58:01.101831 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101778 2582 scope.go:117] "RemoveContainer" containerID="9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" Jul 10 15:58:01.101986 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101971 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9"} err="failed to get container status \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": rpc error: code = NotFound desc = could not find container \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": container with ID starting with 9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9 not found: ID does not exist" Jul 10 15:58:01.102033 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.101986 2582 scope.go:117] "RemoveContainer" containerID="6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" Jul 10 15:58:01.102234 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.102216 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9"} err="failed to get container status \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": rpc error: code = NotFound desc = could not find container \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": container with ID starting with 6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9 not found: ID does not exist" Jul 10 15:58:01.102275 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.102235 2582 scope.go:117] "RemoveContainer" containerID="94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21" Jul 10 15:58:01.102450 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.102429 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21"} err="failed to get container status \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": rpc error: code = NotFound desc = could not find container \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": container with ID starting with 94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21 not found: ID does not exist" Jul 10 15:58:01.102496 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.102450 2582 scope.go:117] "RemoveContainer" containerID="5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" Jul 10 15:58:01.102666 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.102646 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85"} err="failed to get container status \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": rpc error: code = NotFound desc = could not find container \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": container with ID starting with 5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85 not found: ID does not exist" Jul 10 15:58:01.102708 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.102667 2582 scope.go:117] "RemoveContainer" containerID="54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" Jul 10 15:58:01.102876 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.102857 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485"} err="failed to get container status \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": rpc error: code = NotFound desc = could not find container \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": container with ID starting with 54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485 not found: ID does not exist" Jul 10 15:58:01.102941 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.102876 2582 scope.go:117] "RemoveContainer" containerID="ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" Jul 10 15:58:01.103111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103090 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01"} err="failed to get container status \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": rpc error: code = NotFound desc = could not find container \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": container with ID starting with ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01 not found: ID does not exist" Jul 10 15:58:01.103111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103110 2582 scope.go:117] "RemoveContainer" containerID="db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" Jul 10 15:58:01.103310 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103294 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c"} err="failed to get container status \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": rpc error: code = NotFound desc = could not find container \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": container with ID starting with db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c not found: ID does not exist" Jul 10 15:58:01.103357 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103310 2582 scope.go:117] "RemoveContainer" containerID="9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" Jul 10 15:58:01.103529 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103511 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9"} err="failed to get container status \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": rpc error: code = NotFound desc = could not find container \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": container with ID starting with 9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9 not found: ID does not exist" Jul 10 15:58:01.103566 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103529 2582 scope.go:117] "RemoveContainer" containerID="6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" Jul 10 15:58:01.103725 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103704 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9"} err="failed to get container status \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": rpc error: code = NotFound desc = could not find container \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": container with ID starting with 6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9 not found: ID does not exist" Jul 10 15:58:01.103763 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103726 2582 scope.go:117] "RemoveContainer" containerID="94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21" Jul 10 15:58:01.103919 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103904 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21"} err="failed to get container status \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": rpc error: code = NotFound desc = could not find container \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": container with ID starting with 94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21 not found: ID does not exist" Jul 10 15:58:01.103969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.103919 2582 scope.go:117] "RemoveContainer" containerID="5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85" Jul 10 15:58:01.104139 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.104122 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85"} err="failed to get container status \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": rpc error: code = NotFound desc = could not find container \"5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85\": container with ID starting with 5e64325307f56bd7552994c1ea7262b5a867439aec8434f03b948844ff73ca85 not found: ID does not exist" Jul 10 15:58:01.104181 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.104141 2582 scope.go:117] "RemoveContainer" containerID="54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485" Jul 10 15:58:01.104364 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.104347 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485"} err="failed to get container status \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": rpc error: code = NotFound desc = could not find container \"54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485\": container with ID starting with 54c2229ee11420333395b559a8870adde8079511d4d0c679eff7013eedecd485 not found: ID does not exist" Jul 10 15:58:01.104413 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.104365 2582 scope.go:117] "RemoveContainer" containerID="ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01" Jul 10 15:58:01.104562 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.104547 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01"} err="failed to get container status \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": rpc error: code = NotFound desc = could not find container \"ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01\": container with ID starting with ee773428fc99e1844cd0f9c8288712ce6872471c5687d0cb48fdd6cbe05e9b01 not found: ID does not exist" Jul 10 15:58:01.104598 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.104562 2582 scope.go:117] "RemoveContainer" containerID="db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c" Jul 10 15:58:01.104783 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.104766 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c"} err="failed to get container status \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": rpc error: code = NotFound desc = could not find container \"db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c\": container with ID starting with db53c68cea3d928b2fe04258238e1ce09a00769b770115ef5ce62a325cff462c not found: ID does not exist" Jul 10 15:58:01.104834 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.104784 2582 scope.go:117] "RemoveContainer" containerID="9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9" Jul 10 15:58:01.105005 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.104988 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9"} err="failed to get container status \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": rpc error: code = NotFound desc = could not find container \"9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9\": container with ID starting with 9c0e60be0a0ffa72230ac266d633c3574b8d30617a926dcc96eb284dee2608e9 not found: ID does not exist" Jul 10 15:58:01.105054 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.105006 2582 scope.go:117] "RemoveContainer" containerID="6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9" Jul 10 15:58:01.105215 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.105199 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9"} err="failed to get container status \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": rpc error: code = NotFound desc = could not find container \"6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9\": container with ID starting with 6967ad0123a2e463ad4e902494ae8ded68d8327e5839aee687335ead3508f1d9 not found: ID does not exist" Jul 10 15:58:01.105260 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.105215 2582 scope.go:117] "RemoveContainer" containerID="94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21" Jul 10 15:58:01.105407 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.105387 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21"} err="failed to get container status \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": rpc error: code = NotFound desc = could not find container \"94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21\": container with ID starting with 94015cb3cfb8b465ff5bdc9107e01a40cee42ea11ec26fb58ea5f2fa1e875d21 not found: ID does not exist" Jul 10 15:58:01.129183 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129150 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 15:58:01.129611 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129589 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy-web" Jul 10 15:58:01.129611 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129607 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy-web" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129619 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="config-reloader" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129625 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="config-reloader" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129636 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="thanos-sidecar" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129645 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="thanos-sidecar" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129655 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129662 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129671 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="init-config-reloader" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129677 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="init-config-reloader" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129695 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="prometheus" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129701 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="prometheus" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129707 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy-thanos" Jul 10 15:58:01.129752 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129712 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy-thanos" Jul 10 15:58:01.130136 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129769 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="config-reloader" Jul 10 15:58:01.130136 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129783 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="prometheus" Jul 10 15:58:01.130136 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129795 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy-web" Jul 10 15:58:01.130136 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129804 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy-thanos" Jul 10 15:58:01.130136 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129813 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="kube-rbac-proxy" Jul 10 15:58:01.130136 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.129822 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" containerName="thanos-sidecar" Jul 10 15:58:01.133815 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.133796 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.140629 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.140605 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 15:58:01.140779 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.140605 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 15:58:01.141227 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.141009 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6a0t57dkbgisv\"" Jul 10 15:58:01.141227 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.141031 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 15:58:01.141227 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.141112 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 15:58:01.141227 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.141120 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 15:58:01.141483 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.141362 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 15:58:01.141483 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.141365 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 15:58:01.141483 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.141412 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hdzlm\"" Jul 10 15:58:01.141729 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.141711 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 15:58:01.142246 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.142224 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 15:58:01.142362 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.142342 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 15:58:01.143005 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.142816 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 15:58:01.143324 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.143306 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 15:58:01.143728 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.143707 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 15:58:01.148754 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.148732 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-config\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.148754 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.148761 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/551c40eb-bcf8-4f63-8732-07b68b0d5032-config-out\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.148922 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.148783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.148922 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.148803 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.148922 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.148827 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnwsh\" (UniqueName: \"kubernetes.io/projected/551c40eb-bcf8-4f63-8732-07b68b0d5032-kube-api-access-fnwsh\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.148922 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.148911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.148988 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149026 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149055 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149124 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149086 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149318 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/551c40eb-bcf8-4f63-8732-07b68b0d5032-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149318 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149153 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149318 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149318 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149318 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149295 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149503 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149317 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149729 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149349 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-web-config\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.149948 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.150042 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.149987 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.150042 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.150031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.153988 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.150948 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 15:58:01.170216 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.170186 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 15:58:01.250962 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.250906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-web-config\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251136 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251065 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251136 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251260 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251153 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251260 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251200 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-config\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251260 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251224 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/551c40eb-bcf8-4f63-8732-07b68b0d5032-config-out\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251408 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251452 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251452 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251441 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnwsh\" (UniqueName: \"kubernetes.io/projected/551c40eb-bcf8-4f63-8732-07b68b0d5032-kube-api-access-fnwsh\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251522 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251494 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251564 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251521 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251564 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251544 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251656 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251656 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251595 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251656 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251644 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/551c40eb-bcf8-4f63-8732-07b68b0d5032-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251799 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251669 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251799 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251799 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251744 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.251799 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251777 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.252016 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251801 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.252016 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.251800 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.252111 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.252061 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.252481 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.252383 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.253311 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.253280 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.253794 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.253769 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.254784 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.254638 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.254784 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.254700 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.254784 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.254638 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.254784 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.254748 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.255217 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.255194 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-config\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.256429 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.256386 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-web-config\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.256517 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.256462 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/551c40eb-bcf8-4f63-8732-07b68b0d5032-config-out\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.257084 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.257058 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.257641 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.257606 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.257641 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.257623 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/551c40eb-bcf8-4f63-8732-07b68b0d5032-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.257799 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.257741 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/551c40eb-bcf8-4f63-8732-07b68b0d5032-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.257799 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.257739 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.258851 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.258825 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.259117 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.259100 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/551c40eb-bcf8-4f63-8732-07b68b0d5032-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.263380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.263352 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnwsh\" (UniqueName: \"kubernetes.io/projected/551c40eb-bcf8-4f63-8732-07b68b0d5032-kube-api-access-fnwsh\") pod \"prometheus-k8s-0\" (UID: \"551c40eb-bcf8-4f63-8732-07b68b0d5032\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.446411 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.446365 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:01.617286 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:01.617262 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 15:58:01.619597 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:58:01.619564 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551c40eb_bcf8_4f63_8732_07b68b0d5032.slice/crio-060e23f516fb372258d8623f4c8507e92bbd9b5fe2e0c54010fcb44185348858 WatchSource:0}: Error finding container 060e23f516fb372258d8623f4c8507e92bbd9b5fe2e0c54010fcb44185348858: Status 404 returned error can't find the container with id 060e23f516fb372258d8623f4c8507e92bbd9b5fe2e0c54010fcb44185348858 Jul 10 15:58:02.051043 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:02.050938 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"551c40eb-bcf8-4f63-8732-07b68b0d5032","Type":"ContainerStarted","Data":"21eee36541c2239456ed2f65f661546e16582d62a2444c3ba1a2c2a8d78646bd"} Jul 10 15:58:02.051227 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:02.051042 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"551c40eb-bcf8-4f63-8732-07b68b0d5032","Type":"ContainerStarted","Data":"060e23f516fb372258d8623f4c8507e92bbd9b5fe2e0c54010fcb44185348858"} Jul 10 15:58:02.140883 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:02.140843 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99273aea-df95-4d2a-a724-75fc11d1db72" path="/var/lib/kubelet/pods/99273aea-df95-4d2a-a724-75fc11d1db72/volumes" Jul 10 15:58:03.057850 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.057816 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" event={"ID":"08313b1b-d0a8-4a81-af88-a655054fc26f","Type":"ContainerStarted","Data":"8045c4b061fb72b9f5b0c47933a2a3d396378d6672f7987a0606e5f7f15d5d21"} Jul 10 15:58:03.058042 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.057879 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" event={"ID":"08313b1b-d0a8-4a81-af88-a655054fc26f","Type":"ContainerStarted","Data":"78b30d048328c76a18058c2ea534312503065a52f6caddf9e6a6d6b93047739c"} Jul 10 15:58:03.058042 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.057905 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" event={"ID":"08313b1b-d0a8-4a81-af88-a655054fc26f","Type":"ContainerStarted","Data":"acf5a1a8ae6bc4efc250e2e5f2708bf3da5c01403fb8cd52b17a42c63ee840b9"} Jul 10 15:58:03.059219 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.059192 2582 generic.go:356] "Generic (PLEG): container finished" podID="551c40eb-bcf8-4f63-8732-07b68b0d5032" containerID="21eee36541c2239456ed2f65f661546e16582d62a2444c3ba1a2c2a8d78646bd" exitCode=0 Jul 10 15:58:03.059306 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.059272 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"551c40eb-bcf8-4f63-8732-07b68b0d5032","Type":"ContainerDied","Data":"21eee36541c2239456ed2f65f661546e16582d62a2444c3ba1a2c2a8d78646bd"} Jul 10 15:58:03.081819 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.081769 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d656fdcdf-ggf4n" podStartSLOduration=2.015594558 podStartE2EDuration="4.081752982s" totalImagesPullingTime="2.066158424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:58:03.078923619 +0000 UTC m=+158.626612929" watchObservedRunningTime="2026-07-10 15:58:03.081752982 +0000 UTC m=+158.629442306" Jul 10 15:58:03.749396 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.749365 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8664dbc8f7-fl48q"] Jul 10 15:58:03.751817 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.751797 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.769328 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.769302 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8664dbc8f7-fl48q"] Jul 10 15:58:03.775833 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.774651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-console-config\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.775833 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.774733 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbjpf\" (UniqueName: \"kubernetes.io/projected/50afc115-2182-4e55-a122-d3596b7ec9f3-kube-api-access-fbjpf\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.775833 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.774818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-trusted-ca-bundle\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.775833 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.774871 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-oauth-serving-cert\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.775833 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.774956 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-serving-cert\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.775833 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.775004 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-oauth-config\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.775833 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.775049 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-service-ca\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.876636 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.876578 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-oauth-config\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.876828 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.876681 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-service-ca\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.876828 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.876786 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-console-config\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.876828 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.876809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbjpf\" (UniqueName: \"kubernetes.io/projected/50afc115-2182-4e55-a122-d3596b7ec9f3-kube-api-access-fbjpf\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.877045 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.876841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-trusted-ca-bundle\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.877045 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.876886 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-oauth-serving-cert\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.877174 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.877148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-serving-cert\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.877553 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.877528 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-service-ca\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.877701 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.877528 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-console-config\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.877843 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.877816 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-trusted-ca-bundle\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.877890 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.877859 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-oauth-serving-cert\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.879202 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.879184 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-oauth-config\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.879606 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.879585 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-serving-cert\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:03.886799 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:03.886774 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbjpf\" (UniqueName: \"kubernetes.io/projected/50afc115-2182-4e55-a122-d3596b7ec9f3-kube-api-access-fbjpf\") pod \"console-8664dbc8f7-fl48q\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:04.061170 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:04.061065 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:04.068790 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:04.068754 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"551c40eb-bcf8-4f63-8732-07b68b0d5032","Type":"ContainerStarted","Data":"5a41186fc56e741c864dbdae1a7524e401c6389845aca58979263d6cf3185404"} Jul 10 15:58:04.069483 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:04.069447 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"551c40eb-bcf8-4f63-8732-07b68b0d5032","Type":"ContainerStarted","Data":"5dcfd9df135d848b8bb91a1d2787b04d189f6f994cbf5befa88871b12cff0041"} Jul 10 15:58:04.069689 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:04.069662 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"551c40eb-bcf8-4f63-8732-07b68b0d5032","Type":"ContainerStarted","Data":"877dd5d1a525147f04d4011688fc911e39efc8d25930f5cc61b115ab764e77c0"} Jul 10 15:58:04.069759 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:04.069746 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"551c40eb-bcf8-4f63-8732-07b68b0d5032","Type":"ContainerStarted","Data":"88a0775c9b081014aa60b78fe44edb300f897667ad5fac6d90f8c49a94d796a2"} Jul 10 15:58:04.069820 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:04.069792 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"551c40eb-bcf8-4f63-8732-07b68b0d5032","Type":"ContainerStarted","Data":"4454ef1bb52497171127da470516e1488793a785e174fb376a0e7b0d36539223"} Jul 10 15:58:04.069871 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:04.069832 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"551c40eb-bcf8-4f63-8732-07b68b0d5032","Type":"ContainerStarted","Data":"a83c0e9b6238290bd5abb7b4a6a6aaa7c9ab5eeadd8544d2c7ae37c347b1abfa"} Jul 10 15:58:04.238047 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:04.237654 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.215859218 podStartE2EDuration="3.237617391s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.758173ms" isStatefulPod=false podCreationTimestamp="2026-07-10 15:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:58:04.236556957 +0000 UTC m=+159.784246265" watchObservedRunningTime="2026-07-10 15:58:04.237617391 +0000 UTC m=+159.785306694" Jul 10 15:58:04.369196 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:04.369167 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8664dbc8f7-fl48q"] Jul 10 15:58:04.369599 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:58:04.369569 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50afc115_2182_4e55_a122_d3596b7ec9f3.slice/crio-810dddbeac89e69550a727705f0e4b99c618a9c4a0a732bad0e0b6312578d32e WatchSource:0}: Error finding container 810dddbeac89e69550a727705f0e4b99c618a9c4a0a732bad0e0b6312578d32e: Status 404 returned error can't find the container with id 810dddbeac89e69550a727705f0e4b99c618a9c4a0a732bad0e0b6312578d32e Jul 10 15:58:05.075732 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:05.075691 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8664dbc8f7-fl48q" event={"ID":"50afc115-2182-4e55-a122-d3596b7ec9f3","Type":"ContainerStarted","Data":"757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46"} Jul 10 15:58:05.076126 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:05.075751 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8664dbc8f7-fl48q" event={"ID":"50afc115-2182-4e55-a122-d3596b7ec9f3","Type":"ContainerStarted","Data":"810dddbeac89e69550a727705f0e4b99c618a9c4a0a732bad0e0b6312578d32e"} Jul 10 15:58:05.094861 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:05.094815 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8664dbc8f7-fl48q" podStartSLOduration=2.094799962 podStartE2EDuration="2.094799962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:58:05.093305754 +0000 UTC m=+160.640995060" watchObservedRunningTime="2026-07-10 15:58:05.094799962 +0000 UTC m=+160.642489270" Jul 10 15:58:06.446713 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:06.446676 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:58:14.061529 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:14.061478 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:14.061912 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:14.061574 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:14.066287 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:14.066265 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:14.115858 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:14.115831 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:58:14.154772 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:14.154745 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b4d76df4c-f768m"] Jul 10 15:58:39.181412 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.181340 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b4d76df4c-f768m" podUID="a5666519-6eb2-4827-a632-717d61de8e25" containerName="console" containerID="cri-o://06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4" gracePeriod=15 Jul 10 15:58:39.433066 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.433007 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:58:39.496602 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.496570 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-oauth-config\") pod \"a5666519-6eb2-4827-a632-717d61de8e25\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " Jul 10 15:58:39.496781 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.496636 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-service-ca\") pod \"a5666519-6eb2-4827-a632-717d61de8e25\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " Jul 10 15:58:39.496781 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.496659 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf7sh\" (UniqueName: \"kubernetes.io/projected/a5666519-6eb2-4827-a632-717d61de8e25-kube-api-access-tf7sh\") pod \"a5666519-6eb2-4827-a632-717d61de8e25\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " Jul 10 15:58:39.496781 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.496766 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-trusted-ca-bundle\") pod \"a5666519-6eb2-4827-a632-717d61de8e25\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " Jul 10 15:58:39.496981 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.496803 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-console-config\") pod \"a5666519-6eb2-4827-a632-717d61de8e25\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " Jul 10 15:58:39.496981 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.496830 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-oauth-serving-cert\") pod \"a5666519-6eb2-4827-a632-717d61de8e25\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " Jul 10 15:58:39.496981 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.496877 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-serving-cert\") pod \"a5666519-6eb2-4827-a632-717d61de8e25\" (UID: \"a5666519-6eb2-4827-a632-717d61de8e25\") " Jul 10 15:58:39.497189 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.497161 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5666519-6eb2-4827-a632-717d61de8e25" (UID: "a5666519-6eb2-4827-a632-717d61de8e25"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:39.497300 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.497190 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a5666519-6eb2-4827-a632-717d61de8e25" (UID: "a5666519-6eb2-4827-a632-717d61de8e25"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:39.497300 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.497209 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-console-config" (OuterVolumeSpecName: "console-config") pod "a5666519-6eb2-4827-a632-717d61de8e25" (UID: "a5666519-6eb2-4827-a632-717d61de8e25"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:39.497535 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.497506 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5666519-6eb2-4827-a632-717d61de8e25" (UID: "a5666519-6eb2-4827-a632-717d61de8e25"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:39.498803 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.498773 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5666519-6eb2-4827-a632-717d61de8e25-kube-api-access-tf7sh" (OuterVolumeSpecName: "kube-api-access-tf7sh") pod "a5666519-6eb2-4827-a632-717d61de8e25" (UID: "a5666519-6eb2-4827-a632-717d61de8e25"). InnerVolumeSpecName "kube-api-access-tf7sh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:58:39.498886 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.498837 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5666519-6eb2-4827-a632-717d61de8e25" (UID: "a5666519-6eb2-4827-a632-717d61de8e25"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:39.498983 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.498896 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5666519-6eb2-4827-a632-717d61de8e25" (UID: "a5666519-6eb2-4827-a632-717d61de8e25"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:39.598067 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.598017 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-serving-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:39.598067 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.598060 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5666519-6eb2-4827-a632-717d61de8e25-console-oauth-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:39.598067 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.598071 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:39.598067 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.598080 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf7sh\" (UniqueName: \"kubernetes.io/projected/a5666519-6eb2-4827-a632-717d61de8e25-kube-api-access-tf7sh\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:39.598067 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.598091 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-trusted-ca-bundle\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:39.598380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.598100 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-console-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:39.598380 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:39.598110 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5666519-6eb2-4827-a632-717d61de8e25-oauth-serving-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:58:40.219310 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:40.219276 2582 generic.go:356] "Generic (PLEG): container finished" podID="a5666519-6eb2-4827-a632-717d61de8e25" containerID="06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4" exitCode=0 Jul 10 15:58:40.219700 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:40.219333 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4d76df4c-f768m" Jul 10 15:58:40.219700 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:40.219356 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4d76df4c-f768m" event={"ID":"a5666519-6eb2-4827-a632-717d61de8e25","Type":"ContainerDied","Data":"06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4"} Jul 10 15:58:40.219700 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:40.219408 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4d76df4c-f768m" event={"ID":"a5666519-6eb2-4827-a632-717d61de8e25","Type":"ContainerDied","Data":"fa39c77d3c11b9a8c1e8343711fe522d5c9e9d671d536d570bf2e62e62cb6168"} Jul 10 15:58:40.219700 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:40.219431 2582 scope.go:117] "RemoveContainer" containerID="06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4" Jul 10 15:58:40.227692 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:40.227673 2582 scope.go:117] "RemoveContainer" containerID="06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4" Jul 10 15:58:40.228074 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:58:40.228052 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4\": container with ID starting with 06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4 not found: ID does not exist" containerID="06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4" Jul 10 15:58:40.228149 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:40.228086 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4"} err="failed to get container status \"06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4\": rpc error: code = NotFound desc = could not find container \"06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4\": container with ID starting with 06fab7947151b04465375fe45e8cbdf00fb150095a26593d489b8d3e8e6de3c4 not found: ID does not exist" Jul 10 15:58:40.237890 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:40.237866 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b4d76df4c-f768m"] Jul 10 15:58:40.241761 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:40.241742 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b4d76df4c-f768m"] Jul 10 15:58:42.138418 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:58:42.138378 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5666519-6eb2-4827-a632-717d61de8e25" path="/var/lib/kubelet/pods/a5666519-6eb2-4827-a632-717d61de8e25/volumes" Jul 10 15:59:01.447110 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:01.447070 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:59:01.462852 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:01.462826 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:59:02.323591 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:02.323565 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 15:59:14.980464 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:14.980431 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d66c5d8b4-8cpk7"] Jul 10 15:59:14.980953 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:14.980813 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5666519-6eb2-4827-a632-717d61de8e25" containerName="console" Jul 10 15:59:14.980953 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:14.980827 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5666519-6eb2-4827-a632-717d61de8e25" containerName="console" Jul 10 15:59:14.980953 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:14.980884 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5666519-6eb2-4827-a632-717d61de8e25" containerName="console" Jul 10 15:59:14.985453 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:14.985433 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:14.996913 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:14.996882 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d66c5d8b4-8cpk7"] Jul 10 15:59:15.120341 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.120310 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-oauth-serving-cert\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.120555 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.120353 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-serving-cert\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.120555 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.120369 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-service-ca\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.120555 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.120396 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-oauth-config\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.120555 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.120496 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-config\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.120725 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.120561 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5bcx\" (UniqueName: \"kubernetes.io/projected/2492cb53-4226-4b13-94d6-6d5a662d4eea-kube-api-access-v5bcx\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.120725 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.120647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-trusted-ca-bundle\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.222118 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.222085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-oauth-serving-cert\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.222286 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.222127 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-serving-cert\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.222286 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.222144 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-service-ca\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.222286 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.222169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-oauth-config\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.222286 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.222198 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-config\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.222286 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.222242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5bcx\" (UniqueName: \"kubernetes.io/projected/2492cb53-4226-4b13-94d6-6d5a662d4eea-kube-api-access-v5bcx\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.222535 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.222312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-trusted-ca-bundle\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.222921 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.222870 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-service-ca\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.223056 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.223009 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-oauth-serving-cert\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.223056 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.223025 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-config\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.223349 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.223330 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-trusted-ca-bundle\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.224574 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.224556 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-oauth-config\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.224671 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.224648 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-serving-cert\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.231019 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.230968 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5bcx\" (UniqueName: \"kubernetes.io/projected/2492cb53-4226-4b13-94d6-6d5a662d4eea-kube-api-access-v5bcx\") pod \"console-5d66c5d8b4-8cpk7\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.294706 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.294669 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:15.423969 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:15.423923 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d66c5d8b4-8cpk7"] Jul 10 15:59:15.426706 ip-10-0-135-133 kubenswrapper[2582]: W0710 15:59:15.426668 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2492cb53_4226_4b13_94d6_6d5a662d4eea.slice/crio-152e550db811c8d5c8b6bd6d20a12bb9b8596caa8ae49a1b958964df0c1fb153 WatchSource:0}: Error finding container 152e550db811c8d5c8b6bd6d20a12bb9b8596caa8ae49a1b958964df0c1fb153: Status 404 returned error can't find the container with id 152e550db811c8d5c8b6bd6d20a12bb9b8596caa8ae49a1b958964df0c1fb153 Jul 10 15:59:16.368820 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:16.368782 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d66c5d8b4-8cpk7" event={"ID":"2492cb53-4226-4b13-94d6-6d5a662d4eea","Type":"ContainerStarted","Data":"bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea"} Jul 10 15:59:16.369208 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:16.368836 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d66c5d8b4-8cpk7" event={"ID":"2492cb53-4226-4b13-94d6-6d5a662d4eea","Type":"ContainerStarted","Data":"152e550db811c8d5c8b6bd6d20a12bb9b8596caa8ae49a1b958964df0c1fb153"} Jul 10 15:59:16.387667 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:16.387623 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d66c5d8b4-8cpk7" podStartSLOduration=2.387609672 podStartE2EDuration="2.387609672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:59:16.386529951 +0000 UTC m=+231.934219262" watchObservedRunningTime="2026-07-10 15:59:16.387609672 +0000 UTC m=+231.935298982" Jul 10 15:59:25.295072 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:25.295036 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:25.295498 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:25.295124 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:25.300001 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:25.299976 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:25.412143 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:25.412115 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 15:59:25.459988 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:25.459958 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8664dbc8f7-fl48q"] Jul 10 15:59:50.480637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.480535 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8664dbc8f7-fl48q" podUID="50afc115-2182-4e55-a122-d3596b7ec9f3" containerName="console" containerID="cri-o://757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46" gracePeriod=15 Jul 10 15:59:50.723118 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.723093 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:59:50.820522 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.820425 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-oauth-serving-cert\") pod \"50afc115-2182-4e55-a122-d3596b7ec9f3\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " Jul 10 15:59:50.820522 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.820502 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-service-ca\") pod \"50afc115-2182-4e55-a122-d3596b7ec9f3\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " Jul 10 15:59:50.820522 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.820522 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-trusted-ca-bundle\") pod \"50afc115-2182-4e55-a122-d3596b7ec9f3\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " Jul 10 15:59:50.820769 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.820542 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-serving-cert\") pod \"50afc115-2182-4e55-a122-d3596b7ec9f3\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " Jul 10 15:59:50.820769 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.820574 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-oauth-config\") pod \"50afc115-2182-4e55-a122-d3596b7ec9f3\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " Jul 10 15:59:50.820769 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.820639 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-console-config\") pod \"50afc115-2182-4e55-a122-d3596b7ec9f3\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " Jul 10 15:59:50.820769 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.820681 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbjpf\" (UniqueName: \"kubernetes.io/projected/50afc115-2182-4e55-a122-d3596b7ec9f3-kube-api-access-fbjpf\") pod \"50afc115-2182-4e55-a122-d3596b7ec9f3\" (UID: \"50afc115-2182-4e55-a122-d3596b7ec9f3\") " Jul 10 15:59:50.820994 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.820847 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "50afc115-2182-4e55-a122-d3596b7ec9f3" (UID: "50afc115-2182-4e55-a122-d3596b7ec9f3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:59:50.821059 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.820994 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-service-ca" (OuterVolumeSpecName: "service-ca") pod "50afc115-2182-4e55-a122-d3596b7ec9f3" (UID: "50afc115-2182-4e55-a122-d3596b7ec9f3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:59:50.821059 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.821016 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "50afc115-2182-4e55-a122-d3596b7ec9f3" (UID: "50afc115-2182-4e55-a122-d3596b7ec9f3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:59:50.821162 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.821100 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-oauth-serving-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:59:50.821162 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.821103 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-console-config" (OuterVolumeSpecName: "console-config") pod "50afc115-2182-4e55-a122-d3596b7ec9f3" (UID: "50afc115-2182-4e55-a122-d3596b7ec9f3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:59:50.821162 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.821117 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:59:50.821264 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.821161 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-trusted-ca-bundle\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:59:50.822736 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.822710 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "50afc115-2182-4e55-a122-d3596b7ec9f3" (UID: "50afc115-2182-4e55-a122-d3596b7ec9f3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:59:50.822810 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.822729 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "50afc115-2182-4e55-a122-d3596b7ec9f3" (UID: "50afc115-2182-4e55-a122-d3596b7ec9f3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:59:50.822845 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.822811 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50afc115-2182-4e55-a122-d3596b7ec9f3-kube-api-access-fbjpf" (OuterVolumeSpecName: "kube-api-access-fbjpf") pod "50afc115-2182-4e55-a122-d3596b7ec9f3" (UID: "50afc115-2182-4e55-a122-d3596b7ec9f3"). InnerVolumeSpecName "kube-api-access-fbjpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:59:50.922101 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.922055 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-serving-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:59:50.922101 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.922094 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50afc115-2182-4e55-a122-d3596b7ec9f3-console-oauth-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:59:50.922101 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.922105 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50afc115-2182-4e55-a122-d3596b7ec9f3-console-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:59:50.922101 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:50.922114 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbjpf\" (UniqueName: \"kubernetes.io/projected/50afc115-2182-4e55-a122-d3596b7ec9f3-kube-api-access-fbjpf\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 15:59:51.509785 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:51.509748 2582 generic.go:356] "Generic (PLEG): container finished" podID="50afc115-2182-4e55-a122-d3596b7ec9f3" containerID="757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46" exitCode=0 Jul 10 15:59:51.510214 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:51.509798 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8664dbc8f7-fl48q" Jul 10 15:59:51.510214 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:51.509834 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8664dbc8f7-fl48q" event={"ID":"50afc115-2182-4e55-a122-d3596b7ec9f3","Type":"ContainerDied","Data":"757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46"} Jul 10 15:59:51.510214 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:51.509885 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8664dbc8f7-fl48q" event={"ID":"50afc115-2182-4e55-a122-d3596b7ec9f3","Type":"ContainerDied","Data":"810dddbeac89e69550a727705f0e4b99c618a9c4a0a732bad0e0b6312578d32e"} Jul 10 15:59:51.510214 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:51.509906 2582 scope.go:117] "RemoveContainer" containerID="757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46" Jul 10 15:59:51.518637 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:51.518623 2582 scope.go:117] "RemoveContainer" containerID="757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46" Jul 10 15:59:51.518925 ip-10-0-135-133 kubenswrapper[2582]: E0710 15:59:51.518906 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46\": container with ID starting with 757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46 not found: ID does not exist" containerID="757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46" Jul 10 15:59:51.518990 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:51.518954 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46"} err="failed to get container status \"757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46\": rpc error: code = NotFound desc = could not find container \"757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46\": container with ID starting with 757be7d11f0975cc7f75d45b514536548fc05075d54861246bd0d933d00feb46 not found: ID does not exist" Jul 10 15:59:51.531262 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:51.531239 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8664dbc8f7-fl48q"] Jul 10 15:59:51.535307 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:51.535282 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8664dbc8f7-fl48q"] Jul 10 15:59:52.138386 ip-10-0-135-133 kubenswrapper[2582]: I0710 15:59:52.138355 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50afc115-2182-4e55-a122-d3596b7ec9f3" path="/var/lib/kubelet/pods/50afc115-2182-4e55-a122-d3596b7ec9f3/volumes" Jul 10 16:00:24.824754 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:00:24.824725 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 16:01:01.297322 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.297283 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hpghg"] Jul 10 16:01:01.299795 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.297814 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50afc115-2182-4e55-a122-d3596b7ec9f3" containerName="console" Jul 10 16:01:01.299795 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.297830 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="50afc115-2182-4e55-a122-d3596b7ec9f3" containerName="console" Jul 10 16:01:01.299795 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.297883 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="50afc115-2182-4e55-a122-d3596b7ec9f3" containerName="console" Jul 10 16:01:01.300671 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.300653 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hpghg" Jul 10 16:01:01.303546 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.303525 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9lvbp\"" Jul 10 16:01:01.303658 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.303587 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 16:01:01.304701 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.304681 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 16:01:01.308151 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.308029 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hpghg"] Jul 10 16:01:01.317911 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.317892 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87f2a00b-44e7-4fa7-b18d-bcfaaa409a48-bound-sa-token\") pod \"cert-manager-55b4d954d5-hpghg\" (UID: \"87f2a00b-44e7-4fa7-b18d-bcfaaa409a48\") " pod="cert-manager/cert-manager-55b4d954d5-hpghg" Jul 10 16:01:01.318057 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.317945 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bhjs\" (UniqueName: \"kubernetes.io/projected/87f2a00b-44e7-4fa7-b18d-bcfaaa409a48-kube-api-access-6bhjs\") pod \"cert-manager-55b4d954d5-hpghg\" (UID: \"87f2a00b-44e7-4fa7-b18d-bcfaaa409a48\") " pod="cert-manager/cert-manager-55b4d954d5-hpghg" Jul 10 16:01:01.418456 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.418423 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87f2a00b-44e7-4fa7-b18d-bcfaaa409a48-bound-sa-token\") pod \"cert-manager-55b4d954d5-hpghg\" (UID: \"87f2a00b-44e7-4fa7-b18d-bcfaaa409a48\") " pod="cert-manager/cert-manager-55b4d954d5-hpghg" Jul 10 16:01:01.418626 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.418486 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bhjs\" (UniqueName: \"kubernetes.io/projected/87f2a00b-44e7-4fa7-b18d-bcfaaa409a48-kube-api-access-6bhjs\") pod \"cert-manager-55b4d954d5-hpghg\" (UID: \"87f2a00b-44e7-4fa7-b18d-bcfaaa409a48\") " pod="cert-manager/cert-manager-55b4d954d5-hpghg" Jul 10 16:01:01.426803 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.426771 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87f2a00b-44e7-4fa7-b18d-bcfaaa409a48-bound-sa-token\") pod \"cert-manager-55b4d954d5-hpghg\" (UID: \"87f2a00b-44e7-4fa7-b18d-bcfaaa409a48\") " pod="cert-manager/cert-manager-55b4d954d5-hpghg" Jul 10 16:01:01.426918 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.426830 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bhjs\" (UniqueName: \"kubernetes.io/projected/87f2a00b-44e7-4fa7-b18d-bcfaaa409a48-kube-api-access-6bhjs\") pod \"cert-manager-55b4d954d5-hpghg\" (UID: \"87f2a00b-44e7-4fa7-b18d-bcfaaa409a48\") " pod="cert-manager/cert-manager-55b4d954d5-hpghg" Jul 10 16:01:01.618269 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.618184 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hpghg" Jul 10 16:01:01.745664 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.745639 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hpghg"] Jul 10 16:01:01.747706 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:01:01.747673 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87f2a00b_44e7_4fa7_b18d_bcfaaa409a48.slice/crio-b358655a6d5670f1ca050905e8c8617805af991709ad9ab0dc7a568bd8f0cc6e WatchSource:0}: Error finding container b358655a6d5670f1ca050905e8c8617805af991709ad9ab0dc7a568bd8f0cc6e: Status 404 returned error can't find the container with id b358655a6d5670f1ca050905e8c8617805af991709ad9ab0dc7a568bd8f0cc6e Jul 10 16:01:01.749759 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.749739 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 16:01:01.793153 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:01.793116 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hpghg" event={"ID":"87f2a00b-44e7-4fa7-b18d-bcfaaa409a48","Type":"ContainerStarted","Data":"b358655a6d5670f1ca050905e8c8617805af991709ad9ab0dc7a568bd8f0cc6e"} Jul 10 16:01:03.849889 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:03.849857 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7"] Jul 10 16:01:03.852981 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:03.852964 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" Jul 10 16:01:03.856264 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:03.856235 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 16:01:03.856384 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:03.856311 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 16:01:03.857500 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:03.857483 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-25m7r\"" Jul 10 16:01:03.863401 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:03.863380 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7"] Jul 10 16:01:03.939729 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:03.939698 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06c112c2-128e-4cac-9822-84c0f898a2ad-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q44f7\" (UID: \"06c112c2-128e-4cac-9822-84c0f898a2ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" Jul 10 16:01:03.939889 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:03.939752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp6cc\" (UniqueName: \"kubernetes.io/projected/06c112c2-128e-4cac-9822-84c0f898a2ad-kube-api-access-fp6cc\") pod \"openshift-lws-operator-fd8ccff4c-q44f7\" (UID: \"06c112c2-128e-4cac-9822-84c0f898a2ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" Jul 10 16:01:04.041066 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:04.041032 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp6cc\" (UniqueName: \"kubernetes.io/projected/06c112c2-128e-4cac-9822-84c0f898a2ad-kube-api-access-fp6cc\") pod \"openshift-lws-operator-fd8ccff4c-q44f7\" (UID: \"06c112c2-128e-4cac-9822-84c0f898a2ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" Jul 10 16:01:04.041221 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:04.041102 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06c112c2-128e-4cac-9822-84c0f898a2ad-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q44f7\" (UID: \"06c112c2-128e-4cac-9822-84c0f898a2ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" Jul 10 16:01:04.041426 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:04.041412 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06c112c2-128e-4cac-9822-84c0f898a2ad-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q44f7\" (UID: \"06c112c2-128e-4cac-9822-84c0f898a2ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" Jul 10 16:01:04.049758 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:04.049727 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp6cc\" (UniqueName: \"kubernetes.io/projected/06c112c2-128e-4cac-9822-84c0f898a2ad-kube-api-access-fp6cc\") pod \"openshift-lws-operator-fd8ccff4c-q44f7\" (UID: \"06c112c2-128e-4cac-9822-84c0f898a2ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" Jul 10 16:01:04.163090 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:04.163009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" Jul 10 16:01:04.309245 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:04.309218 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7"] Jul 10 16:01:04.312497 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:01:04.312465 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06c112c2_128e_4cac_9822_84c0f898a2ad.slice/crio-b4d34d0741a5bee93f5ab9d3e8571b121551f2fbf1f4ba13cf8f65b97c88b62f WatchSource:0}: Error finding container b4d34d0741a5bee93f5ab9d3e8571b121551f2fbf1f4ba13cf8f65b97c88b62f: Status 404 returned error can't find the container with id b4d34d0741a5bee93f5ab9d3e8571b121551f2fbf1f4ba13cf8f65b97c88b62f Jul 10 16:01:04.811201 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:04.811163 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" event={"ID":"06c112c2-128e-4cac-9822-84c0f898a2ad","Type":"ContainerStarted","Data":"b4d34d0741a5bee93f5ab9d3e8571b121551f2fbf1f4ba13cf8f65b97c88b62f"} Jul 10 16:01:07.827489 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:07.827442 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" event={"ID":"06c112c2-128e-4cac-9822-84c0f898a2ad","Type":"ContainerStarted","Data":"82b55c623055ef14f8af9d943a8c9a47644114c3d2731c4a0751a9a5d8806ba6"} Jul 10 16:01:07.828865 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:07.828837 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hpghg" event={"ID":"87f2a00b-44e7-4fa7-b18d-bcfaaa409a48","Type":"ContainerStarted","Data":"923bf6f71ff8a503b8a946bbad471942df6af090e9279c0c9ce16bc4e1d9089b"} Jul 10 16:01:07.846667 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:07.846614 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q44f7" podStartSLOduration=1.4375765 podStartE2EDuration="4.846597971s" totalImagesPullingTime="3.409021471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:01:07.845418957 +0000 UTC m=+343.393108261" watchObservedRunningTime="2026-07-10 16:01:07.846597971 +0000 UTC m=+343.394287279" Jul 10 16:01:07.861077 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:07.861016 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hpghg" podStartSLOduration=0.933570466 podStartE2EDuration="6.860996688s" totalImagesPullingTime="5.927426222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:01:07.860169166 +0000 UTC m=+343.407858477" watchObservedRunningTime="2026-07-10 16:01:07.860996688 +0000 UTC m=+343.408685999" Jul 10 16:01:27.635395 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.635323 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f"] Jul 10 16:01:27.660661 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.660633 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.661137 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.661108 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f"] Jul 10 16:01:27.666078 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.666055 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 16:01:27.666197 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.666165 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 16:01:27.666253 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.666200 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 16:01:27.666315 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.666248 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 16:01:27.666512 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.666495 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sl2l5\"" Jul 10 16:01:27.760128 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.760090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35070e4f-e5f0-4477-a6e3-db86de17dc30-manifests\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.760291 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.760141 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35070e4f-e5f0-4477-a6e3-db86de17dc30-tmp\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.760291 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.760193 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkj74\" (UniqueName: \"kubernetes.io/projected/35070e4f-e5f0-4477-a6e3-db86de17dc30-kube-api-access-bkj74\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.760291 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.760228 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35070e4f-e5f0-4477-a6e3-db86de17dc30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.760291 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.760260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35070e4f-e5f0-4477-a6e3-db86de17dc30-webhook-cert\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.861169 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.861134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35070e4f-e5f0-4477-a6e3-db86de17dc30-manifests\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.861352 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.861184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35070e4f-e5f0-4477-a6e3-db86de17dc30-tmp\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.861352 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.861218 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkj74\" (UniqueName: \"kubernetes.io/projected/35070e4f-e5f0-4477-a6e3-db86de17dc30-kube-api-access-bkj74\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.861352 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.861253 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35070e4f-e5f0-4477-a6e3-db86de17dc30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.861352 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.861291 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35070e4f-e5f0-4477-a6e3-db86de17dc30-webhook-cert\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.861598 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.861576 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35070e4f-e5f0-4477-a6e3-db86de17dc30-manifests\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.863585 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.863552 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35070e4f-e5f0-4477-a6e3-db86de17dc30-tmp\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.863585 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.863582 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35070e4f-e5f0-4477-a6e3-db86de17dc30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.863780 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.863656 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35070e4f-e5f0-4477-a6e3-db86de17dc30-webhook-cert\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.875263 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.875238 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkj74\" (UniqueName: \"kubernetes.io/projected/35070e4f-e5f0-4477-a6e3-db86de17dc30-kube-api-access-bkj74\") pod \"opendatahub-operator-controller-manager-765dfd8876-r448f\" (UID: \"35070e4f-e5f0-4477-a6e3-db86de17dc30\") " pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:27.971994 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:27.971958 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:28.152853 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:28.152823 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f"] Jul 10 16:01:28.154970 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:01:28.154943 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35070e4f_e5f0_4477_a6e3_db86de17dc30.slice/crio-3ca5dae43b902938f5a1362210b849881af9fa798a55d3fcad85b02cbfead2b8 WatchSource:0}: Error finding container 3ca5dae43b902938f5a1362210b849881af9fa798a55d3fcad85b02cbfead2b8: Status 404 returned error can't find the container with id 3ca5dae43b902938f5a1362210b849881af9fa798a55d3fcad85b02cbfead2b8 Jul 10 16:01:28.919631 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:28.919553 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" event={"ID":"35070e4f-e5f0-4477-a6e3-db86de17dc30","Type":"ContainerStarted","Data":"3ca5dae43b902938f5a1362210b849881af9fa798a55d3fcad85b02cbfead2b8"} Jul 10 16:01:31.935621 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:31.935581 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" event={"ID":"35070e4f-e5f0-4477-a6e3-db86de17dc30","Type":"ContainerStarted","Data":"1a0f89d7869844b3bd42bac76fb399269662ac64cdf75079e980ea9e464c1c03"} Jul 10 16:01:32.941576 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:32.941540 2582 generic.go:356] "Generic (PLEG): container finished" podID="35070e4f-e5f0-4477-a6e3-db86de17dc30" containerID="1a0f89d7869844b3bd42bac76fb399269662ac64cdf75079e980ea9e464c1c03" exitCode=0 Jul 10 16:01:32.942015 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:32.941622 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" event={"ID":"35070e4f-e5f0-4477-a6e3-db86de17dc30","Type":"ContainerDied","Data":"1a0f89d7869844b3bd42bac76fb399269662ac64cdf75079e980ea9e464c1c03"} Jul 10 16:01:33.948116 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:33.948085 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" event={"ID":"35070e4f-e5f0-4477-a6e3-db86de17dc30","Type":"ContainerStarted","Data":"cdbff67b742e654c1232a445a5f1d70e6951769923ae19814e1afa7ba50f411a"} Jul 10 16:01:33.948529 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:33.948165 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:33.979094 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:33.979044 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" podStartSLOduration=2.648606366 podStartE2EDuration="6.979028677s" totalImagesPullingTime="3.285119776s" totalInitContainerRuntime="1.045302535s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:01:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:01:33.978602029 +0000 UTC m=+369.526291338" watchObservedRunningTime="2026-07-10 16:01:33.979028677 +0000 UTC m=+369.526717986" Jul 10 16:01:44.956735 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:44.956700 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-765dfd8876-r448f" Jul 10 16:01:45.852439 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.852403 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf"] Jul 10 16:01:45.857601 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.857584 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:45.863437 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.863407 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 16:01:45.863437 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.863426 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6gb5l\"" Jul 10 16:01:45.863591 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.863411 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 16:01:45.873643 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.873623 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 16:01:45.875332 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.875309 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf"] Jul 10 16:01:45.923007 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.922970 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjww7\" (UniqueName: \"kubernetes.io/projected/82583ea8-ad39-4b6d-8702-16722af26dd1-kube-api-access-bjww7\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:45.923182 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.923031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/82583ea8-ad39-4b6d-8702-16722af26dd1-manager-config\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:45.923182 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.923118 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82583ea8-ad39-4b6d-8702-16722af26dd1-cert\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:45.923182 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:45.923150 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/82583ea8-ad39-4b6d-8702-16722af26dd1-metrics-cert\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.023562 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.023533 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82583ea8-ad39-4b6d-8702-16722af26dd1-cert\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.024055 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.023588 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/82583ea8-ad39-4b6d-8702-16722af26dd1-metrics-cert\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.024055 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.023628 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjww7\" (UniqueName: \"kubernetes.io/projected/82583ea8-ad39-4b6d-8702-16722af26dd1-kube-api-access-bjww7\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.024055 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.023699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/82583ea8-ad39-4b6d-8702-16722af26dd1-manager-config\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.024477 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.024453 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/82583ea8-ad39-4b6d-8702-16722af26dd1-manager-config\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.026457 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.026433 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/82583ea8-ad39-4b6d-8702-16722af26dd1-metrics-cert\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.026549 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.026472 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82583ea8-ad39-4b6d-8702-16722af26dd1-cert\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.045342 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.045316 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjww7\" (UniqueName: \"kubernetes.io/projected/82583ea8-ad39-4b6d-8702-16722af26dd1-kube-api-access-bjww7\") pod \"lws-controller-manager-67b6bf9495-w7vbf\" (UID: \"82583ea8-ad39-4b6d-8702-16722af26dd1\") " pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.166393 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.166286 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:46.301754 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:46.301730 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf"] Jul 10 16:01:46.303279 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:01:46.303257 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82583ea8_ad39_4b6d_8702_16722af26dd1.slice/crio-ecb36802bd463ef7ec85820a3c3a5a6c6571fc68f40788775f26a2058cac8ac7 WatchSource:0}: Error finding container ecb36802bd463ef7ec85820a3c3a5a6c6571fc68f40788775f26a2058cac8ac7: Status 404 returned error can't find the container with id ecb36802bd463ef7ec85820a3c3a5a6c6571fc68f40788775f26a2058cac8ac7 Jul 10 16:01:47.006851 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.006800 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" event={"ID":"82583ea8-ad39-4b6d-8702-16722af26dd1","Type":"ContainerStarted","Data":"ecb36802bd463ef7ec85820a3c3a5a6c6571fc68f40788775f26a2058cac8ac7"} Jul 10 16:01:47.471043 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.471011 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b74489749-phr4r"] Jul 10 16:01:47.473364 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.473347 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.481510 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.481484 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 10 16:01:47.482003 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.481978 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 10 16:01:47.482407 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.482364 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 16:01:47.483192 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.483170 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c64xr\"" Jul 10 16:01:47.483301 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.483227 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 16:01:47.521825 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.521785 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b74489749-phr4r"] Jul 10 16:01:47.537757 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.537727 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc240166-f20a-40d7-bfdf-cdc8ffda89d5-tmp\") pod \"kube-auth-proxy-6b74489749-phr4r\" (UID: \"fc240166-f20a-40d7-bfdf-cdc8ffda89d5\") " pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.537946 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.537766 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6qm8\" (UniqueName: \"kubernetes.io/projected/fc240166-f20a-40d7-bfdf-cdc8ffda89d5-kube-api-access-p6qm8\") pod \"kube-auth-proxy-6b74489749-phr4r\" (UID: \"fc240166-f20a-40d7-bfdf-cdc8ffda89d5\") " pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.537946 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.537837 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc240166-f20a-40d7-bfdf-cdc8ffda89d5-tls-certs\") pod \"kube-auth-proxy-6b74489749-phr4r\" (UID: \"fc240166-f20a-40d7-bfdf-cdc8ffda89d5\") " pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.639389 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.639364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc240166-f20a-40d7-bfdf-cdc8ffda89d5-tmp\") pod \"kube-auth-proxy-6b74489749-phr4r\" (UID: \"fc240166-f20a-40d7-bfdf-cdc8ffda89d5\") " pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.639523 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.639404 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qm8\" (UniqueName: \"kubernetes.io/projected/fc240166-f20a-40d7-bfdf-cdc8ffda89d5-kube-api-access-p6qm8\") pod \"kube-auth-proxy-6b74489749-phr4r\" (UID: \"fc240166-f20a-40d7-bfdf-cdc8ffda89d5\") " pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.639523 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.639454 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc240166-f20a-40d7-bfdf-cdc8ffda89d5-tls-certs\") pod \"kube-auth-proxy-6b74489749-phr4r\" (UID: \"fc240166-f20a-40d7-bfdf-cdc8ffda89d5\") " pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.641511 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.641489 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc240166-f20a-40d7-bfdf-cdc8ffda89d5-tmp\") pod \"kube-auth-proxy-6b74489749-phr4r\" (UID: \"fc240166-f20a-40d7-bfdf-cdc8ffda89d5\") " pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.641791 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.641775 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc240166-f20a-40d7-bfdf-cdc8ffda89d5-tls-certs\") pod \"kube-auth-proxy-6b74489749-phr4r\" (UID: \"fc240166-f20a-40d7-bfdf-cdc8ffda89d5\") " pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.662698 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.662673 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6qm8\" (UniqueName: \"kubernetes.io/projected/fc240166-f20a-40d7-bfdf-cdc8ffda89d5-kube-api-access-p6qm8\") pod \"kube-auth-proxy-6b74489749-phr4r\" (UID: \"fc240166-f20a-40d7-bfdf-cdc8ffda89d5\") " pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.786274 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.786193 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" Jul 10 16:01:47.961116 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:01:47.961065 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc240166_f20a_40d7_bfdf_cdc8ffda89d5.slice/crio-e82f18467453e5bc99eeb756f5442c5119ecbf264ba02cd529776e8caf25363d WatchSource:0}: Error finding container e82f18467453e5bc99eeb756f5442c5119ecbf264ba02cd529776e8caf25363d: Status 404 returned error can't find the container with id e82f18467453e5bc99eeb756f5442c5119ecbf264ba02cd529776e8caf25363d Jul 10 16:01:47.963404 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:47.963376 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b74489749-phr4r"] Jul 10 16:01:48.013653 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:48.013614 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" event={"ID":"82583ea8-ad39-4b6d-8702-16722af26dd1","Type":"ContainerStarted","Data":"620c9573a5edf0f73c166be56251ebe27d786a18031c8121f945703d395fccdf"} Jul 10 16:01:48.013835 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:48.013767 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:01:48.014842 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:48.014818 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" event={"ID":"fc240166-f20a-40d7-bfdf-cdc8ffda89d5","Type":"ContainerStarted","Data":"e82f18467453e5bc99eeb756f5442c5119ecbf264ba02cd529776e8caf25363d"} Jul 10 16:01:48.066284 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:48.066185 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" podStartSLOduration=1.760365757 podStartE2EDuration="3.066168282s" totalImagesPullingTime="1.305802525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:01:48.064534362 +0000 UTC m=+383.612223697" watchObservedRunningTime="2026-07-10 16:01:48.066168282 +0000 UTC m=+383.613857591" Jul 10 16:01:51.031641 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:51.031602 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" event={"ID":"fc240166-f20a-40d7-bfdf-cdc8ffda89d5","Type":"ContainerStarted","Data":"0a7f2da6ed97f3cc440714a739231a5f8aa0d3a044b94660951a1212df761ab6"} Jul 10 16:01:51.052426 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:51.052359 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b74489749-phr4r" podStartSLOduration=1.158020055 podStartE2EDuration="4.052344847s" totalImagesPullingTime="2.894324792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:01:51.051018086 +0000 UTC m=+386.598707477" watchObservedRunningTime="2026-07-10 16:01:51.052344847 +0000 UTC m=+386.600034214" Jul 10 16:01:59.022987 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:01:59.022954 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67b6bf9495-w7vbf" Jul 10 16:03:12.453870 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.453832 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7465488669-htcgx"] Jul 10 16:03:12.456432 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.456414 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.476949 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.476855 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7465488669-htcgx"] Jul 10 16:03:12.614518 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.614475 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6lqc\" (UniqueName: \"kubernetes.io/projected/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-kube-api-access-b6lqc\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.614518 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.614522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-console-serving-cert\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.614755 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.614547 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-service-ca\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.614755 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.614567 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-trusted-ca-bundle\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.614755 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.614592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-console-config\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.614755 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.614618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-console-oauth-config\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.614755 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.614693 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-oauth-serving-cert\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.716261 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.716166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6lqc\" (UniqueName: \"kubernetes.io/projected/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-kube-api-access-b6lqc\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.716261 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.716208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-console-serving-cert\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.716261 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.716223 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-service-ca\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.716261 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.716240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-trusted-ca-bundle\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.716261 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.716259 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-console-config\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.716650 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.716280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-console-oauth-config\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.716650 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.716329 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-oauth-serving-cert\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.717093 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.717066 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-service-ca\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.717214 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.717141 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-trusted-ca-bundle\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.717214 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.717159 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-oauth-serving-cert\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.717214 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.717159 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-console-config\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.718785 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.718760 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-console-serving-cert\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.718785 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.718767 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-console-oauth-config\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.725672 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.725623 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6lqc\" (UniqueName: \"kubernetes.io/projected/7c8a6a0b-080d-492b-8ae9-aa3d52eca924-kube-api-access-b6lqc\") pod \"console-7465488669-htcgx\" (UID: \"7c8a6a0b-080d-492b-8ae9-aa3d52eca924\") " pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.765516 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.765470 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:12.897799 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:12.897772 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7465488669-htcgx"] Jul 10 16:03:12.900496 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:03:12.900471 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8a6a0b_080d_492b_8ae9_aa3d52eca924.slice/crio-f392757306515d29243a39063a078301495ce89cb846c02c1c347ece48481bb4 WatchSource:0}: Error finding container f392757306515d29243a39063a078301495ce89cb846c02c1c347ece48481bb4: Status 404 returned error can't find the container with id f392757306515d29243a39063a078301495ce89cb846c02c1c347ece48481bb4 Jul 10 16:03:13.416551 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:13.416514 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7465488669-htcgx" event={"ID":"7c8a6a0b-080d-492b-8ae9-aa3d52eca924","Type":"ContainerStarted","Data":"c4f6695738969ed472d9e67d504e465e92510ee105146db9f0050f927a33c3e2"} Jul 10 16:03:13.416725 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:13.416574 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7465488669-htcgx" event={"ID":"7c8a6a0b-080d-492b-8ae9-aa3d52eca924","Type":"ContainerStarted","Data":"f392757306515d29243a39063a078301495ce89cb846c02c1c347ece48481bb4"} Jul 10 16:03:13.439945 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:13.439879 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7465488669-htcgx" podStartSLOduration=1.43986252 podStartE2EDuration="1.43986252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:03:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:03:13.438164561 +0000 UTC m=+468.985853871" watchObservedRunningTime="2026-07-10 16:03:13.43986252 +0000 UTC m=+468.987551829" Jul 10 16:03:22.765973 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:22.765917 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:22.766365 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:22.766011 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:22.770683 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:22.770658 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:23.472533 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:23.472502 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7465488669-htcgx" Jul 10 16:03:23.580788 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:23.580753 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d66c5d8b4-8cpk7"] Jul 10 16:03:48.601089 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.601049 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d66c5d8b4-8cpk7" podUID="2492cb53-4226-4b13-94d6-6d5a662d4eea" containerName="console" containerID="cri-o://bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea" gracePeriod=15 Jul 10 16:03:48.845750 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.845721 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 16:03:48.946885 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.946858 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-oauth-config\") pod \"2492cb53-4226-4b13-94d6-6d5a662d4eea\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " Jul 10 16:03:48.947076 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.946900 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-serving-cert\") pod \"2492cb53-4226-4b13-94d6-6d5a662d4eea\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " Jul 10 16:03:48.947076 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.946955 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-oauth-serving-cert\") pod \"2492cb53-4226-4b13-94d6-6d5a662d4eea\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " Jul 10 16:03:48.947076 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.946978 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-service-ca\") pod \"2492cb53-4226-4b13-94d6-6d5a662d4eea\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " Jul 10 16:03:48.947076 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.947037 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-trusted-ca-bundle\") pod \"2492cb53-4226-4b13-94d6-6d5a662d4eea\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " Jul 10 16:03:48.947284 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.947085 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-config\") pod \"2492cb53-4226-4b13-94d6-6d5a662d4eea\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " Jul 10 16:03:48.947284 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.947139 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5bcx\" (UniqueName: \"kubernetes.io/projected/2492cb53-4226-4b13-94d6-6d5a662d4eea-kube-api-access-v5bcx\") pod \"2492cb53-4226-4b13-94d6-6d5a662d4eea\" (UID: \"2492cb53-4226-4b13-94d6-6d5a662d4eea\") " Jul 10 16:03:48.947495 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.947465 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2492cb53-4226-4b13-94d6-6d5a662d4eea" (UID: "2492cb53-4226-4b13-94d6-6d5a662d4eea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:03:48.947495 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.947479 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-service-ca" (OuterVolumeSpecName: "service-ca") pod "2492cb53-4226-4b13-94d6-6d5a662d4eea" (UID: "2492cb53-4226-4b13-94d6-6d5a662d4eea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:03:48.947610 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.947508 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-config" (OuterVolumeSpecName: "console-config") pod "2492cb53-4226-4b13-94d6-6d5a662d4eea" (UID: "2492cb53-4226-4b13-94d6-6d5a662d4eea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:03:48.947610 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.947513 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2492cb53-4226-4b13-94d6-6d5a662d4eea" (UID: "2492cb53-4226-4b13-94d6-6d5a662d4eea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:03:48.949423 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.949404 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2492cb53-4226-4b13-94d6-6d5a662d4eea-kube-api-access-v5bcx" (OuterVolumeSpecName: "kube-api-access-v5bcx") pod "2492cb53-4226-4b13-94d6-6d5a662d4eea" (UID: "2492cb53-4226-4b13-94d6-6d5a662d4eea"). InnerVolumeSpecName "kube-api-access-v5bcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:03:48.949533 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.949515 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2492cb53-4226-4b13-94d6-6d5a662d4eea" (UID: "2492cb53-4226-4b13-94d6-6d5a662d4eea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:03:48.949533 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:48.949525 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2492cb53-4226-4b13-94d6-6d5a662d4eea" (UID: "2492cb53-4226-4b13-94d6-6d5a662d4eea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:03:49.048186 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.048150 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-oauth-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:03:49.048186 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.048180 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-serving-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:03:49.048186 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.048190 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-oauth-serving-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:03:49.048423 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.048200 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:03:49.048423 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.048209 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-trusted-ca-bundle\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:03:49.048423 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.048218 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2492cb53-4226-4b13-94d6-6d5a662d4eea-console-config\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:03:49.048423 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.048227 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5bcx\" (UniqueName: \"kubernetes.io/projected/2492cb53-4226-4b13-94d6-6d5a662d4eea-kube-api-access-v5bcx\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:03:49.591811 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.591777 2582 generic.go:356] "Generic (PLEG): container finished" podID="2492cb53-4226-4b13-94d6-6d5a662d4eea" containerID="bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea" exitCode=0 Jul 10 16:03:49.592003 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.591824 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d66c5d8b4-8cpk7" Jul 10 16:03:49.592003 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.591843 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d66c5d8b4-8cpk7" event={"ID":"2492cb53-4226-4b13-94d6-6d5a662d4eea","Type":"ContainerDied","Data":"bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea"} Jul 10 16:03:49.592003 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.591882 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d66c5d8b4-8cpk7" event={"ID":"2492cb53-4226-4b13-94d6-6d5a662d4eea","Type":"ContainerDied","Data":"152e550db811c8d5c8b6bd6d20a12bb9b8596caa8ae49a1b958964df0c1fb153"} Jul 10 16:03:49.592003 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.591901 2582 scope.go:117] "RemoveContainer" containerID="bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea" Jul 10 16:03:49.600870 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.600855 2582 scope.go:117] "RemoveContainer" containerID="bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea" Jul 10 16:03:49.601117 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:03:49.601101 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea\": container with ID starting with bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea not found: ID does not exist" containerID="bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea" Jul 10 16:03:49.601360 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.601125 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea"} err="failed to get container status \"bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea\": rpc error: code = NotFound desc = could not find container \"bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea\": container with ID starting with bb8198aee1abc944b6cefbb89374c86d5eb266a11d0a4a90fecbbd6382f626ea not found: ID does not exist" Jul 10 16:03:49.628381 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.628343 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d66c5d8b4-8cpk7"] Jul 10 16:03:49.632576 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:49.632547 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d66c5d8b4-8cpk7"] Jul 10 16:03:50.145986 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:03:50.145948 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2492cb53-4226-4b13-94d6-6d5a662d4eea" path="/var/lib/kubelet/pods/2492cb53-4226-4b13-94d6-6d5a662d4eea/volumes" Jul 10 16:04:15.341957 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.341909 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccsb9"] Jul 10 16:04:15.342322 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.342298 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2492cb53-4226-4b13-94d6-6d5a662d4eea" containerName="console" Jul 10 16:04:15.342322 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.342311 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2492cb53-4226-4b13-94d6-6d5a662d4eea" containerName="console" Jul 10 16:04:15.342424 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.342385 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2492cb53-4226-4b13-94d6-6d5a662d4eea" containerName="console" Jul 10 16:04:15.346458 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.346439 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:15.349683 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.349648 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 16:04:15.349969 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.349949 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 16:04:15.350924 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.350873 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jbqvq\"" Jul 10 16:04:15.351059 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.350973 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 10 16:04:15.368721 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.368693 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccsb9"] Jul 10 16:04:15.397953 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.397911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0290d961-79c6-4b91-94df-c25de1c9a71d-config-file\") pod \"limitador-limitador-64c94fd64f-ccsb9\" (UID: \"0290d961-79c6-4b91-94df-c25de1c9a71d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:15.398105 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.397968 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7tt\" (UniqueName: \"kubernetes.io/projected/0290d961-79c6-4b91-94df-c25de1c9a71d-kube-api-access-kz7tt\") pod \"limitador-limitador-64c94fd64f-ccsb9\" (UID: \"0290d961-79c6-4b91-94df-c25de1c9a71d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:15.432268 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.432238 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccsb9"] Jul 10 16:04:15.498737 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.498698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0290d961-79c6-4b91-94df-c25de1c9a71d-config-file\") pod \"limitador-limitador-64c94fd64f-ccsb9\" (UID: \"0290d961-79c6-4b91-94df-c25de1c9a71d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:15.498737 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.498740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7tt\" (UniqueName: \"kubernetes.io/projected/0290d961-79c6-4b91-94df-c25de1c9a71d-kube-api-access-kz7tt\") pod \"limitador-limitador-64c94fd64f-ccsb9\" (UID: \"0290d961-79c6-4b91-94df-c25de1c9a71d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:15.499335 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.499313 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0290d961-79c6-4b91-94df-c25de1c9a71d-config-file\") pod \"limitador-limitador-64c94fd64f-ccsb9\" (UID: \"0290d961-79c6-4b91-94df-c25de1c9a71d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:15.511591 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.511569 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7tt\" (UniqueName: \"kubernetes.io/projected/0290d961-79c6-4b91-94df-c25de1c9a71d-kube-api-access-kz7tt\") pod \"limitador-limitador-64c94fd64f-ccsb9\" (UID: \"0290d961-79c6-4b91-94df-c25de1c9a71d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:15.656753 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.656662 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:15.806485 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:15.806463 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccsb9"] Jul 10 16:04:15.808977 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:04:15.808946 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0290d961_79c6_4b91_94df_c25de1c9a71d.slice/crio-debcf0e203e6eff645d50c53a0061b84c3cbf378e88f918c442af5ef6434de4e WatchSource:0}: Error finding container debcf0e203e6eff645d50c53a0061b84c3cbf378e88f918c442af5ef6434de4e: Status 404 returned error can't find the container with id debcf0e203e6eff645d50c53a0061b84c3cbf378e88f918c442af5ef6434de4e Jul 10 16:04:16.361767 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.361735 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-c7szw"] Jul 10 16:04:16.366275 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.366254 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c7szw" Jul 10 16:04:16.370541 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.370520 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kqj2n\"" Jul 10 16:04:16.398138 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.398107 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c7szw"] Jul 10 16:04:16.408340 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.408308 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb797\" (UniqueName: \"kubernetes.io/projected/5ebbf22c-6697-4490-8a0e-8dcaaf46b53d-kube-api-access-bb797\") pod \"authorino-58cd955675-c7szw\" (UID: \"5ebbf22c-6697-4490-8a0e-8dcaaf46b53d\") " pod="kuadrant-system/authorino-58cd955675-c7szw" Jul 10 16:04:16.509225 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.509187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb797\" (UniqueName: \"kubernetes.io/projected/5ebbf22c-6697-4490-8a0e-8dcaaf46b53d-kube-api-access-bb797\") pod \"authorino-58cd955675-c7szw\" (UID: \"5ebbf22c-6697-4490-8a0e-8dcaaf46b53d\") " pod="kuadrant-system/authorino-58cd955675-c7szw" Jul 10 16:04:16.519077 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.519049 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb797\" (UniqueName: \"kubernetes.io/projected/5ebbf22c-6697-4490-8a0e-8dcaaf46b53d-kube-api-access-bb797\") pod \"authorino-58cd955675-c7szw\" (UID: \"5ebbf22c-6697-4490-8a0e-8dcaaf46b53d\") " pod="kuadrant-system/authorino-58cd955675-c7szw" Jul 10 16:04:16.675531 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.675501 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c7szw" Jul 10 16:04:16.719634 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.719596 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" event={"ID":"0290d961-79c6-4b91-94df-c25de1c9a71d","Type":"ContainerStarted","Data":"debcf0e203e6eff645d50c53a0061b84c3cbf378e88f918c442af5ef6434de4e"} Jul 10 16:04:16.827752 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:16.827697 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c7szw"] Jul 10 16:04:16.829985 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:04:16.829957 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ebbf22c_6697_4490_8a0e_8dcaaf46b53d.slice/crio-e3e562ae1560bd83fe933072fdbd2d21a1f52938b53fdb442cd91d95d7f8e2e0 WatchSource:0}: Error finding container e3e562ae1560bd83fe933072fdbd2d21a1f52938b53fdb442cd91d95d7f8e2e0: Status 404 returned error can't find the container with id e3e562ae1560bd83fe933072fdbd2d21a1f52938b53fdb442cd91d95d7f8e2e0 Jul 10 16:04:17.727225 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:17.727174 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c7szw" event={"ID":"5ebbf22c-6697-4490-8a0e-8dcaaf46b53d","Type":"ContainerStarted","Data":"e3e562ae1560bd83fe933072fdbd2d21a1f52938b53fdb442cd91d95d7f8e2e0"} Jul 10 16:04:20.747714 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:20.747678 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c7szw" event={"ID":"5ebbf22c-6697-4490-8a0e-8dcaaf46b53d","Type":"ContainerStarted","Data":"613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee"} Jul 10 16:04:20.777949 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:20.777875 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-c7szw" podStartSLOduration=1.319587847 podStartE2EDuration="4.777856541s" totalImagesPullingTime="3.458268694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:04:20.776997912 +0000 UTC m=+536.324687224" watchObservedRunningTime="2026-07-10 16:04:20.777856541 +0000 UTC m=+536.325545850" Jul 10 16:04:21.177905 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:21.177868 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c7szw"] Jul 10 16:04:22.758291 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:22.758241 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-c7szw" podUID="5ebbf22c-6697-4490-8a0e-8dcaaf46b53d" containerName="authorino" containerID="cri-o://613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee" gracePeriod=30 Jul 10 16:04:23.010298 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.010239 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c7szw" Jul 10 16:04:23.073168 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.073135 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb797\" (UniqueName: \"kubernetes.io/projected/5ebbf22c-6697-4490-8a0e-8dcaaf46b53d-kube-api-access-bb797\") pod \"5ebbf22c-6697-4490-8a0e-8dcaaf46b53d\" (UID: \"5ebbf22c-6697-4490-8a0e-8dcaaf46b53d\") " Jul 10 16:04:23.075321 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.075284 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebbf22c-6697-4490-8a0e-8dcaaf46b53d-kube-api-access-bb797" (OuterVolumeSpecName: "kube-api-access-bb797") pod "5ebbf22c-6697-4490-8a0e-8dcaaf46b53d" (UID: "5ebbf22c-6697-4490-8a0e-8dcaaf46b53d"). InnerVolumeSpecName "kube-api-access-bb797". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:04:23.173826 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.173791 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb797\" (UniqueName: \"kubernetes.io/projected/5ebbf22c-6697-4490-8a0e-8dcaaf46b53d-kube-api-access-bb797\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:04:23.764632 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.764598 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" event={"ID":"0290d961-79c6-4b91-94df-c25de1c9a71d","Type":"ContainerStarted","Data":"c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9"} Jul 10 16:04:23.765086 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.764728 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:23.765848 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.765828 2582 generic.go:356] "Generic (PLEG): container finished" podID="5ebbf22c-6697-4490-8a0e-8dcaaf46b53d" containerID="613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee" exitCode=0 Jul 10 16:04:23.765904 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.765860 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c7szw" Jul 10 16:04:23.765904 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.765882 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c7szw" event={"ID":"5ebbf22c-6697-4490-8a0e-8dcaaf46b53d","Type":"ContainerDied","Data":"613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee"} Jul 10 16:04:23.765998 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.765904 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c7szw" event={"ID":"5ebbf22c-6697-4490-8a0e-8dcaaf46b53d","Type":"ContainerDied","Data":"e3e562ae1560bd83fe933072fdbd2d21a1f52938b53fdb442cd91d95d7f8e2e0"} Jul 10 16:04:23.765998 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.765922 2582 scope.go:117] "RemoveContainer" containerID="613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee" Jul 10 16:04:23.774977 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.774962 2582 scope.go:117] "RemoveContainer" containerID="613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee" Jul 10 16:04:23.775236 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:04:23.775217 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee\": container with ID starting with 613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee not found: ID does not exist" containerID="613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee" Jul 10 16:04:23.775289 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.775244 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee"} err="failed to get container status \"613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee\": rpc error: code = NotFound desc = could not find container \"613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee\": container with ID starting with 613f0a11f6e7f1cdacbdfa07b4e71c3d90d2dd083ae119cf6cde0001ff1a93ee not found: ID does not exist" Jul 10 16:04:23.789110 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.789070 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" podStartSLOduration=1.730102591 podStartE2EDuration="8.789056732s" totalImagesPullingTime="7.058954141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:04:23.788210284 +0000 UTC m=+539.335899594" watchObservedRunningTime="2026-07-10 16:04:23.789056732 +0000 UTC m=+539.336746041" Jul 10 16:04:23.814473 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.814448 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c7szw"] Jul 10 16:04:23.820609 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:23.820583 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-c7szw"] Jul 10 16:04:24.138995 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:24.138912 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebbf22c-6697-4490-8a0e-8dcaaf46b53d" path="/var/lib/kubelet/pods/5ebbf22c-6697-4490-8a0e-8dcaaf46b53d/volumes" Jul 10 16:04:31.016628 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.016594 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccsb9"] Jul 10 16:04:31.017083 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.016795 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" podUID="0290d961-79c6-4b91-94df-c25de1c9a71d" containerName="limitador" containerID="cri-o://c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9" gracePeriod=30 Jul 10 16:04:31.019048 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.019027 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:31.570447 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.570416 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:31.653551 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.653464 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz7tt\" (UniqueName: \"kubernetes.io/projected/0290d961-79c6-4b91-94df-c25de1c9a71d-kube-api-access-kz7tt\") pod \"0290d961-79c6-4b91-94df-c25de1c9a71d\" (UID: \"0290d961-79c6-4b91-94df-c25de1c9a71d\") " Jul 10 16:04:31.653551 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.653513 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0290d961-79c6-4b91-94df-c25de1c9a71d-config-file\") pod \"0290d961-79c6-4b91-94df-c25de1c9a71d\" (UID: \"0290d961-79c6-4b91-94df-c25de1c9a71d\") " Jul 10 16:04:31.653968 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.653944 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0290d961-79c6-4b91-94df-c25de1c9a71d-config-file" (OuterVolumeSpecName: "config-file") pod "0290d961-79c6-4b91-94df-c25de1c9a71d" (UID: "0290d961-79c6-4b91-94df-c25de1c9a71d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:04:31.655560 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.655533 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0290d961-79c6-4b91-94df-c25de1c9a71d-kube-api-access-kz7tt" (OuterVolumeSpecName: "kube-api-access-kz7tt") pod "0290d961-79c6-4b91-94df-c25de1c9a71d" (UID: "0290d961-79c6-4b91-94df-c25de1c9a71d"). InnerVolumeSpecName "kube-api-access-kz7tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:04:31.754876 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.754841 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz7tt\" (UniqueName: \"kubernetes.io/projected/0290d961-79c6-4b91-94df-c25de1c9a71d-kube-api-access-kz7tt\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:04:31.754876 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.754867 2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0290d961-79c6-4b91-94df-c25de1c9a71d-config-file\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:04:31.806101 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.806065 2582 generic.go:356] "Generic (PLEG): container finished" podID="0290d961-79c6-4b91-94df-c25de1c9a71d" containerID="c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9" exitCode=0 Jul 10 16:04:31.806249 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.806112 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" Jul 10 16:04:31.806249 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.806160 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" event={"ID":"0290d961-79c6-4b91-94df-c25de1c9a71d","Type":"ContainerDied","Data":"c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9"} Jul 10 16:04:31.806249 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.806211 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccsb9" event={"ID":"0290d961-79c6-4b91-94df-c25de1c9a71d","Type":"ContainerDied","Data":"debcf0e203e6eff645d50c53a0061b84c3cbf378e88f918c442af5ef6434de4e"} Jul 10 16:04:31.806249 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.806237 2582 scope.go:117] "RemoveContainer" containerID="c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9" Jul 10 16:04:31.814657 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.814642 2582 scope.go:117] "RemoveContainer" containerID="c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9" Jul 10 16:04:31.814896 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:04:31.814878 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9\": container with ID starting with c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9 not found: ID does not exist" containerID="c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9" Jul 10 16:04:31.814961 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.814906 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9"} err="failed to get container status \"c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9\": rpc error: code = NotFound desc = could not find container \"c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9\": container with ID starting with c4edc38ae8f6d2f36081ce4272b40944456330ba4ae31c63d3ee8db3299c01b9 not found: ID does not exist" Jul 10 16:04:31.834654 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.834624 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccsb9"] Jul 10 16:04:31.849971 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:31.847856 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccsb9"] Jul 10 16:04:32.139608 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:32.139564 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0290d961-79c6-4b91-94df-c25de1c9a71d" path="/var/lib/kubelet/pods/0290d961-79c6-4b91-94df-c25de1c9a71d/volumes" Jul 10 16:04:37.075906 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.075873 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9"] Jul 10 16:04:37.076394 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.076278 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ebbf22c-6697-4490-8a0e-8dcaaf46b53d" containerName="authorino" Jul 10 16:04:37.076394 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.076290 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ebbf22c-6697-4490-8a0e-8dcaaf46b53d" containerName="authorino" Jul 10 16:04:37.076394 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.076306 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0290d961-79c6-4b91-94df-c25de1c9a71d" containerName="limitador" Jul 10 16:04:37.076394 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.076312 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0290d961-79c6-4b91-94df-c25de1c9a71d" containerName="limitador" Jul 10 16:04:37.076394 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.076384 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0290d961-79c6-4b91-94df-c25de1c9a71d" containerName="limitador" Jul 10 16:04:37.076567 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.076401 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ebbf22c-6697-4490-8a0e-8dcaaf46b53d" containerName="authorino" Jul 10 16:04:37.083247 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.083229 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:37.090739 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.090717 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 16:04:37.091900 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.091884 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xdvlq\"" Jul 10 16:04:37.091900 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.091894 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 16:04:37.092048 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.091894 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 10 16:04:37.098577 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.098557 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9"] Jul 10 16:04:37.204887 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.204860 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cde43b2b-4ad1-41ec-9acb-17c39c3f5e82-data\") pod \"postgres-69fb4594cf-fx2q9\" (UID: \"cde43b2b-4ad1-41ec-9acb-17c39c3f5e82\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:37.205086 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.205007 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vzlf\" (UniqueName: \"kubernetes.io/projected/cde43b2b-4ad1-41ec-9acb-17c39c3f5e82-kube-api-access-5vzlf\") pod \"postgres-69fb4594cf-fx2q9\" (UID: \"cde43b2b-4ad1-41ec-9acb-17c39c3f5e82\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:37.306018 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.305976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vzlf\" (UniqueName: \"kubernetes.io/projected/cde43b2b-4ad1-41ec-9acb-17c39c3f5e82-kube-api-access-5vzlf\") pod \"postgres-69fb4594cf-fx2q9\" (UID: \"cde43b2b-4ad1-41ec-9acb-17c39c3f5e82\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:37.306178 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.306050 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cde43b2b-4ad1-41ec-9acb-17c39c3f5e82-data\") pod \"postgres-69fb4594cf-fx2q9\" (UID: \"cde43b2b-4ad1-41ec-9acb-17c39c3f5e82\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:37.306415 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.306396 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cde43b2b-4ad1-41ec-9acb-17c39c3f5e82-data\") pod \"postgres-69fb4594cf-fx2q9\" (UID: \"cde43b2b-4ad1-41ec-9acb-17c39c3f5e82\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:37.317778 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.317751 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vzlf\" (UniqueName: \"kubernetes.io/projected/cde43b2b-4ad1-41ec-9acb-17c39c3f5e82-kube-api-access-5vzlf\") pod \"postgres-69fb4594cf-fx2q9\" (UID: \"cde43b2b-4ad1-41ec-9acb-17c39c3f5e82\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:37.393220 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.393133 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:37.536743 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.536717 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9"] Jul 10 16:04:37.539586 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:04:37.539565 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde43b2b_4ad1_41ec_9acb_17c39c3f5e82.slice/crio-db2fbebee6d469bc6bc3534d22de88b35abcfc47939af60d85fa6ea74f11356c WatchSource:0}: Error finding container db2fbebee6d469bc6bc3534d22de88b35abcfc47939af60d85fa6ea74f11356c: Status 404 returned error can't find the container with id db2fbebee6d469bc6bc3534d22de88b35abcfc47939af60d85fa6ea74f11356c Jul 10 16:04:37.841499 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:37.841460 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" event={"ID":"cde43b2b-4ad1-41ec-9acb-17c39c3f5e82","Type":"ContainerStarted","Data":"db2fbebee6d469bc6bc3534d22de88b35abcfc47939af60d85fa6ea74f11356c"} Jul 10 16:04:42.871276 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:42.871228 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" event={"ID":"cde43b2b-4ad1-41ec-9acb-17c39c3f5e82","Type":"ContainerStarted","Data":"b114fb0b46503080ccee813fcc0e4f55cccb180a3fe301ec2a42036e16630e7a"} Jul 10 16:04:42.871685 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:42.871323 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:42.911121 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:42.911020 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" podStartSLOduration=0.793863269 podStartE2EDuration="5.911002475s" totalImagesPullingTime="5.117139206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:04:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:04:42.909076972 +0000 UTC m=+558.456766304" watchObservedRunningTime="2026-07-10 16:04:42.911002475 +0000 UTC m=+558.458691783" Jul 10 16:04:48.913350 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:48.913321 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fx2q9" Jul 10 16:04:49.520009 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.519980 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t5fq"] Jul 10 16:04:49.524268 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.524247 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" Jul 10 16:04:49.527363 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.527334 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 16:04:49.527523 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.527504 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 16:04:49.528691 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.528672 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kqj2n\"" Jul 10 16:04:49.532737 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.532714 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t5fq"] Jul 10 16:04:49.614052 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.614018 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/5afd3822-744f-4bb7-b0a6-2e862f8341ff-kube-api-access-flp9q\") pod \"authorino-5d4b67c446-5t5fq\" (UID: \"5afd3822-744f-4bb7-b0a6-2e862f8341ff\") " pod="kuadrant-system/authorino-5d4b67c446-5t5fq" Jul 10 16:04:49.714726 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.714688 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/5afd3822-744f-4bb7-b0a6-2e862f8341ff-kube-api-access-flp9q\") pod \"authorino-5d4b67c446-5t5fq\" (UID: \"5afd3822-744f-4bb7-b0a6-2e862f8341ff\") " pod="kuadrant-system/authorino-5d4b67c446-5t5fq" Jul 10 16:04:49.723759 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.723727 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/5afd3822-744f-4bb7-b0a6-2e862f8341ff-kube-api-access-flp9q\") pod \"authorino-5d4b67c446-5t5fq\" (UID: \"5afd3822-744f-4bb7-b0a6-2e862f8341ff\") " pod="kuadrant-system/authorino-5d4b67c446-5t5fq" Jul 10 16:04:49.739257 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.739220 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t5fq"] Jul 10 16:04:49.739512 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.739500 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" Jul 10 16:04:49.766675 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.766641 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-zc6pk"] Jul 10 16:04:49.769766 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.769745 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:49.772955 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.772885 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 10 16:04:49.780224 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.780199 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-zc6pk"] Jul 10 16:04:49.815423 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.815396 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd443da9-5483-4277-9e5c-bc6726cbe865-tls-cert\") pod \"authorino-76877994-zc6pk\" (UID: \"fd443da9-5483-4277-9e5c-bc6726cbe865\") " pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:49.815585 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.815433 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghrvq\" (UniqueName: \"kubernetes.io/projected/fd443da9-5483-4277-9e5c-bc6726cbe865-kube-api-access-ghrvq\") pod \"authorino-76877994-zc6pk\" (UID: \"fd443da9-5483-4277-9e5c-bc6726cbe865\") " pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:49.849633 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.849580 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-zc6pk"] Jul 10 16:04:49.850473 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:04:49.850428 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ghrvq tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-zc6pk" podUID="fd443da9-5483-4277-9e5c-bc6726cbe865" Jul 10 16:04:49.881980 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.881922 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t5fq"] Jul 10 16:04:49.883620 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:04:49.883595 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5afd3822_744f_4bb7_b0a6_2e862f8341ff.slice/crio-a5569fe7538dba31985f5672ff7d68d74338624dbc0fe513b73d5962167b745c WatchSource:0}: Error finding container a5569fe7538dba31985f5672ff7d68d74338624dbc0fe513b73d5962167b745c: Status 404 returned error can't find the container with id a5569fe7538dba31985f5672ff7d68d74338624dbc0fe513b73d5962167b745c Jul 10 16:04:49.891985 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.891959 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-569b754667-fsqgh"] Jul 10 16:04:49.894626 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.894609 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:04:49.905731 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.905710 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-569b754667-fsqgh"] Jul 10 16:04:49.912295 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.912268 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:49.912295 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.912281 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" event={"ID":"5afd3822-744f-4bb7-b0a6-2e862f8341ff","Type":"ContainerStarted","Data":"a5569fe7538dba31985f5672ff7d68d74338624dbc0fe513b73d5962167b745c"} Jul 10 16:04:49.916304 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.916283 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1711a0ff-be86-4557-971f-38676df799b7-tls-cert\") pod \"authorino-569b754667-fsqgh\" (UID: \"1711a0ff-be86-4557-971f-38676df799b7\") " pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:04:49.916657 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.916361 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd443da9-5483-4277-9e5c-bc6726cbe865-tls-cert\") pod \"authorino-76877994-zc6pk\" (UID: \"fd443da9-5483-4277-9e5c-bc6726cbe865\") " pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:49.916657 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.916396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghrvq\" (UniqueName: \"kubernetes.io/projected/fd443da9-5483-4277-9e5c-bc6726cbe865-kube-api-access-ghrvq\") pod \"authorino-76877994-zc6pk\" (UID: \"fd443da9-5483-4277-9e5c-bc6726cbe865\") " pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:49.916657 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.916451 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mr5z\" (UniqueName: \"kubernetes.io/projected/1711a0ff-be86-4557-971f-38676df799b7-kube-api-access-2mr5z\") pod \"authorino-569b754667-fsqgh\" (UID: \"1711a0ff-be86-4557-971f-38676df799b7\") " pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:04:49.918289 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.918267 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:49.919157 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.919135 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd443da9-5483-4277-9e5c-bc6726cbe865-tls-cert\") pod \"authorino-76877994-zc6pk\" (UID: \"fd443da9-5483-4277-9e5c-bc6726cbe865\") " pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:49.925061 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:49.925040 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghrvq\" (UniqueName: \"kubernetes.io/projected/fd443da9-5483-4277-9e5c-bc6726cbe865-kube-api-access-ghrvq\") pod \"authorino-76877994-zc6pk\" (UID: \"fd443da9-5483-4277-9e5c-bc6726cbe865\") " pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:50.017006 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.016968 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd443da9-5483-4277-9e5c-bc6726cbe865-tls-cert\") pod \"fd443da9-5483-4277-9e5c-bc6726cbe865\" (UID: \"fd443da9-5483-4277-9e5c-bc6726cbe865\") " Jul 10 16:04:50.017178 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.017053 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghrvq\" (UniqueName: \"kubernetes.io/projected/fd443da9-5483-4277-9e5c-bc6726cbe865-kube-api-access-ghrvq\") pod \"fd443da9-5483-4277-9e5c-bc6726cbe865\" (UID: \"fd443da9-5483-4277-9e5c-bc6726cbe865\") " Jul 10 16:04:50.017268 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.017240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mr5z\" (UniqueName: \"kubernetes.io/projected/1711a0ff-be86-4557-971f-38676df799b7-kube-api-access-2mr5z\") pod \"authorino-569b754667-fsqgh\" (UID: \"1711a0ff-be86-4557-971f-38676df799b7\") " pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:04:50.017385 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.017371 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1711a0ff-be86-4557-971f-38676df799b7-tls-cert\") pod \"authorino-569b754667-fsqgh\" (UID: \"1711a0ff-be86-4557-971f-38676df799b7\") " pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:04:50.019131 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.019106 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd443da9-5483-4277-9e5c-bc6726cbe865-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fd443da9-5483-4277-9e5c-bc6726cbe865" (UID: "fd443da9-5483-4277-9e5c-bc6726cbe865"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:04:50.019131 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.019119 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd443da9-5483-4277-9e5c-bc6726cbe865-kube-api-access-ghrvq" (OuterVolumeSpecName: "kube-api-access-ghrvq") pod "fd443da9-5483-4277-9e5c-bc6726cbe865" (UID: "fd443da9-5483-4277-9e5c-bc6726cbe865"). InnerVolumeSpecName "kube-api-access-ghrvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:04:50.019588 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.019569 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1711a0ff-be86-4557-971f-38676df799b7-tls-cert\") pod \"authorino-569b754667-fsqgh\" (UID: \"1711a0ff-be86-4557-971f-38676df799b7\") " pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:04:50.027029 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.026973 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mr5z\" (UniqueName: \"kubernetes.io/projected/1711a0ff-be86-4557-971f-38676df799b7-kube-api-access-2mr5z\") pod \"authorino-569b754667-fsqgh\" (UID: \"1711a0ff-be86-4557-971f-38676df799b7\") " pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:04:50.118310 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.118269 2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd443da9-5483-4277-9e5c-bc6726cbe865-tls-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:04:50.118310 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.118303 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghrvq\" (UniqueName: \"kubernetes.io/projected/fd443da9-5483-4277-9e5c-bc6726cbe865-kube-api-access-ghrvq\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:04:50.203954 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.203906 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:04:50.335495 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.335465 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-569b754667-fsqgh"] Jul 10 16:04:50.338584 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:04:50.338549 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1711a0ff_be86_4557_971f_38676df799b7.slice/crio-df0f67b1d3733de73b898ec88886e6a66aad2b5d53c5f42bbf805a26e57d22d3 WatchSource:0}: Error finding container df0f67b1d3733de73b898ec88886e6a66aad2b5d53c5f42bbf805a26e57d22d3: Status 404 returned error can't find the container with id df0f67b1d3733de73b898ec88886e6a66aad2b5d53c5f42bbf805a26e57d22d3 Jul 10 16:04:50.919400 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.919294 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" event={"ID":"5afd3822-744f-4bb7-b0a6-2e862f8341ff","Type":"ContainerStarted","Data":"6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8"} Jul 10 16:04:50.919400 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.919312 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" podUID="5afd3822-744f-4bb7-b0a6-2e862f8341ff" containerName="authorino" containerID="cri-o://6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8" gracePeriod=30 Jul 10 16:04:50.920908 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.920883 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569b754667-fsqgh" event={"ID":"1711a0ff-be86-4557-971f-38676df799b7","Type":"ContainerStarted","Data":"0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51"} Jul 10 16:04:50.921037 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.920909 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-zc6pk" Jul 10 16:04:50.921037 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.920919 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569b754667-fsqgh" event={"ID":"1711a0ff-be86-4557-971f-38676df799b7","Type":"ContainerStarted","Data":"df0f67b1d3733de73b898ec88886e6a66aad2b5d53c5f42bbf805a26e57d22d3"} Jul 10 16:04:50.959232 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.959183 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" podStartSLOduration=1.337162047 podStartE2EDuration="1.959166158s" totalImagesPullingTime="622.004111ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:04:50.938369789 +0000 UTC m=+566.486059099" watchObservedRunningTime="2026-07-10 16:04:50.959166158 +0000 UTC m=+566.506855466" Jul 10 16:04:50.968588 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.968562 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-zc6pk"] Jul 10 16:04:50.973564 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.973543 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-zc6pk"] Jul 10 16:04:50.994775 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:50.994732 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-569b754667-fsqgh" podStartSLOduration=1.605567338 podStartE2EDuration="1.994717736s" totalImagesPullingTime="389.150398ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:04:50.993441337 +0000 UTC m=+566.541130649" watchObservedRunningTime="2026-07-10 16:04:50.994717736 +0000 UTC m=+566.542407045" Jul 10 16:04:51.163203 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.163175 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" Jul 10 16:04:51.228658 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.228629 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/5afd3822-744f-4bb7-b0a6-2e862f8341ff-kube-api-access-flp9q\") pod \"5afd3822-744f-4bb7-b0a6-2e862f8341ff\" (UID: \"5afd3822-744f-4bb7-b0a6-2e862f8341ff\") " Jul 10 16:04:51.230598 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.230572 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5afd3822-744f-4bb7-b0a6-2e862f8341ff-kube-api-access-flp9q" (OuterVolumeSpecName: "kube-api-access-flp9q") pod "5afd3822-744f-4bb7-b0a6-2e862f8341ff" (UID: "5afd3822-744f-4bb7-b0a6-2e862f8341ff"). InnerVolumeSpecName "kube-api-access-flp9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:04:51.329660 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.329631 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/5afd3822-744f-4bb7-b0a6-2e862f8341ff-kube-api-access-flp9q\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:04:51.927726 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.927687 2582 generic.go:356] "Generic (PLEG): container finished" podID="5afd3822-744f-4bb7-b0a6-2e862f8341ff" containerID="6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8" exitCode=0 Jul 10 16:04:51.928148 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.927732 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" Jul 10 16:04:51.928148 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.927773 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" event={"ID":"5afd3822-744f-4bb7-b0a6-2e862f8341ff","Type":"ContainerDied","Data":"6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8"} Jul 10 16:04:51.928148 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.927817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5t5fq" event={"ID":"5afd3822-744f-4bb7-b0a6-2e862f8341ff","Type":"ContainerDied","Data":"a5569fe7538dba31985f5672ff7d68d74338624dbc0fe513b73d5962167b745c"} Jul 10 16:04:51.928148 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.927834 2582 scope.go:117] "RemoveContainer" containerID="6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8" Jul 10 16:04:51.936787 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.936771 2582 scope.go:117] "RemoveContainer" containerID="6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8" Jul 10 16:04:51.937048 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:04:51.937029 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8\": container with ID starting with 6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8 not found: ID does not exist" containerID="6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8" Jul 10 16:04:51.937106 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.937056 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8"} err="failed to get container status \"6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8\": rpc error: code = NotFound desc = could not find container \"6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8\": container with ID starting with 6534a4f7af48a95bb078deb31d3c09ced23d68cd82b9b6530a7658e913d517d8 not found: ID does not exist" Jul 10 16:04:51.957995 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.957959 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t5fq"] Jul 10 16:04:51.961201 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:51.961181 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t5fq"] Jul 10 16:04:52.139008 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:52.138918 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5afd3822-744f-4bb7-b0a6-2e862f8341ff" path="/var/lib/kubelet/pods/5afd3822-744f-4bb7-b0a6-2e862f8341ff/volumes" Jul 10 16:04:52.139292 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:52.139278 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd443da9-5483-4277-9e5c-bc6726cbe865" path="/var/lib/kubelet/pods/fd443da9-5483-4277-9e5c-bc6726cbe865/volumes" Jul 10 16:04:55.671869 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.671837 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-585b678f49-c24vd"] Jul 10 16:04:55.672275 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.672247 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5afd3822-744f-4bb7-b0a6-2e862f8341ff" containerName="authorino" Jul 10 16:04:55.672275 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.672260 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afd3822-744f-4bb7-b0a6-2e862f8341ff" containerName="authorino" Jul 10 16:04:55.672356 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.672326 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5afd3822-744f-4bb7-b0a6-2e862f8341ff" containerName="authorino" Jul 10 16:04:55.675058 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.675030 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:55.677737 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.677714 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mhv9d\"" Jul 10 16:04:55.678007 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.677991 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 16:04:55.678891 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.678878 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 16:04:55.697659 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.697637 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585b678f49-c24vd"] Jul 10 16:04:55.766632 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.766603 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/77251b35-0b4a-4307-8ee8-f8a67c206212-kube-api-access-bpj5f\") pod \"maas-controller-585b678f49-c24vd\" (UID: \"77251b35-0b4a-4307-8ee8-f8a67c206212\") " pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:55.766789 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.766649 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77251b35-0b4a-4307-8ee8-f8a67c206212-webhook-cert\") pod \"maas-controller-585b678f49-c24vd\" (UID: \"77251b35-0b4a-4307-8ee8-f8a67c206212\") " pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:55.852713 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.852679 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6998bfc557-vmn5v"] Jul 10 16:04:55.855133 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.855118 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:04:55.866523 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.866493 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6998bfc557-vmn5v"] Jul 10 16:04:55.868138 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.868115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/77251b35-0b4a-4307-8ee8-f8a67c206212-kube-api-access-bpj5f\") pod \"maas-controller-585b678f49-c24vd\" (UID: \"77251b35-0b4a-4307-8ee8-f8a67c206212\") " pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:55.868233 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.868176 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77251b35-0b4a-4307-8ee8-f8a67c206212-webhook-cert\") pod \"maas-controller-585b678f49-c24vd\" (UID: \"77251b35-0b4a-4307-8ee8-f8a67c206212\") " pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:55.868313 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:04:55.868299 2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 10 16:04:55.868375 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:04:55.868364 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77251b35-0b4a-4307-8ee8-f8a67c206212-webhook-cert podName:77251b35-0b4a-4307-8ee8-f8a67c206212 nodeName:}" failed. No retries permitted until 2026-07-10 16:04:56.368344428 +0000 UTC m=+571.916033732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/77251b35-0b4a-4307-8ee8-f8a67c206212-webhook-cert") pod "maas-controller-585b678f49-c24vd" (UID: "77251b35-0b4a-4307-8ee8-f8a67c206212") : secret "maas-controller-webhook-cert" not found Jul 10 16:04:55.883037 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.883016 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/77251b35-0b4a-4307-8ee8-f8a67c206212-kube-api-access-bpj5f\") pod \"maas-controller-585b678f49-c24vd\" (UID: \"77251b35-0b4a-4307-8ee8-f8a67c206212\") " pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:55.969449 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.969427 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27634fcb-b102-45c6-ac08-bb19ecdc90a8-webhook-cert\") pod \"maas-controller-6998bfc557-vmn5v\" (UID: \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\") " pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:04:55.969594 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:55.969484 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xx9z\" (UniqueName: \"kubernetes.io/projected/27634fcb-b102-45c6-ac08-bb19ecdc90a8-kube-api-access-4xx9z\") pod \"maas-controller-6998bfc557-vmn5v\" (UID: \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\") " pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:04:56.070113 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.070077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27634fcb-b102-45c6-ac08-bb19ecdc90a8-webhook-cert\") pod \"maas-controller-6998bfc557-vmn5v\" (UID: \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\") " pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:04:56.070269 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.070174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xx9z\" (UniqueName: \"kubernetes.io/projected/27634fcb-b102-45c6-ac08-bb19ecdc90a8-kube-api-access-4xx9z\") pod \"maas-controller-6998bfc557-vmn5v\" (UID: \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\") " pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:04:56.072611 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.072587 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27634fcb-b102-45c6-ac08-bb19ecdc90a8-webhook-cert\") pod \"maas-controller-6998bfc557-vmn5v\" (UID: \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\") " pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:04:56.079641 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.079616 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xx9z\" (UniqueName: \"kubernetes.io/projected/27634fcb-b102-45c6-ac08-bb19ecdc90a8-kube-api-access-4xx9z\") pod \"maas-controller-6998bfc557-vmn5v\" (UID: \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\") " pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:04:56.164334 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.164298 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:04:56.299887 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.299832 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6998bfc557-vmn5v"] Jul 10 16:04:56.302158 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:04:56.302135 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27634fcb_b102_45c6_ac08_bb19ecdc90a8.slice/crio-07fff6b46c33342b60762aa46bd3b370d4c07101b9d317981726c9f6c84485fd WatchSource:0}: Error finding container 07fff6b46c33342b60762aa46bd3b370d4c07101b9d317981726c9f6c84485fd: Status 404 returned error can't find the container with id 07fff6b46c33342b60762aa46bd3b370d4c07101b9d317981726c9f6c84485fd Jul 10 16:04:56.372523 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.372491 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77251b35-0b4a-4307-8ee8-f8a67c206212-webhook-cert\") pod \"maas-controller-585b678f49-c24vd\" (UID: \"77251b35-0b4a-4307-8ee8-f8a67c206212\") " pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:56.374844 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.374824 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77251b35-0b4a-4307-8ee8-f8a67c206212-webhook-cert\") pod \"maas-controller-585b678f49-c24vd\" (UID: \"77251b35-0b4a-4307-8ee8-f8a67c206212\") " pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:56.585108 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.585025 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:56.713094 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.713067 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585b678f49-c24vd"] Jul 10 16:04:56.714464 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:04:56.714438 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77251b35_0b4a_4307_8ee8_f8a67c206212.slice/crio-47fc1e94754e151d6d8c9b6cb3d76c48545ef2f44f8be8a4f53e0cf22b404c2e WatchSource:0}: Error finding container 47fc1e94754e151d6d8c9b6cb3d76c48545ef2f44f8be8a4f53e0cf22b404c2e: Status 404 returned error can't find the container with id 47fc1e94754e151d6d8c9b6cb3d76c48545ef2f44f8be8a4f53e0cf22b404c2e Jul 10 16:04:56.952692 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.952654 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585b678f49-c24vd" event={"ID":"77251b35-0b4a-4307-8ee8-f8a67c206212","Type":"ContainerStarted","Data":"47fc1e94754e151d6d8c9b6cb3d76c48545ef2f44f8be8a4f53e0cf22b404c2e"} Jul 10 16:04:56.954013 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:56.953986 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6998bfc557-vmn5v" event={"ID":"27634fcb-b102-45c6-ac08-bb19ecdc90a8","Type":"ContainerStarted","Data":"07fff6b46c33342b60762aa46bd3b370d4c07101b9d317981726c9f6c84485fd"} Jul 10 16:04:58.969399 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:58.969361 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6998bfc557-vmn5v" event={"ID":"27634fcb-b102-45c6-ac08-bb19ecdc90a8","Type":"ContainerStarted","Data":"19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266"} Jul 10 16:04:58.969854 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:58.969463 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:04:58.971078 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:58.971043 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585b678f49-c24vd" event={"ID":"77251b35-0b4a-4307-8ee8-f8a67c206212","Type":"ContainerStarted","Data":"91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6"} Jul 10 16:04:58.971215 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:58.971169 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:04:59.202563 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:59.202508 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-585b678f49-c24vd" podStartSLOduration=2.493453626 podStartE2EDuration="4.20249286s" totalImagesPullingTime="1.709039234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:04:59.199871619 +0000 UTC m=+574.747560940" watchObservedRunningTime="2026-07-10 16:04:59.20249286 +0000 UTC m=+574.750182169" Jul 10 16:04:59.202739 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:04:59.202593 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6998bfc557-vmn5v" podStartSLOduration=2.090858841 podStartE2EDuration="4.20258972s" totalImagesPullingTime="2.111730879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:04:59.040403535 +0000 UTC m=+574.588092843" watchObservedRunningTime="2026-07-10 16:04:59.20258972 +0000 UTC m=+574.750279050" Jul 10 16:05:09.983403 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:09.983368 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:05:09.983883 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:09.983458 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:05:10.068789 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:10.068758 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585b678f49-c24vd"] Jul 10 16:05:10.068979 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:10.068952 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-585b678f49-c24vd" podUID="77251b35-0b4a-4307-8ee8-f8a67c206212" containerName="manager" containerID="cri-o://91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6" gracePeriod=30 Jul 10 16:05:10.308620 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:10.308594 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:05:10.402241 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:10.402211 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77251b35-0b4a-4307-8ee8-f8a67c206212-webhook-cert\") pod \"77251b35-0b4a-4307-8ee8-f8a67c206212\" (UID: \"77251b35-0b4a-4307-8ee8-f8a67c206212\") " Jul 10 16:05:10.402419 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:10.402310 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/77251b35-0b4a-4307-8ee8-f8a67c206212-kube-api-access-bpj5f\") pod \"77251b35-0b4a-4307-8ee8-f8a67c206212\" (UID: \"77251b35-0b4a-4307-8ee8-f8a67c206212\") " Jul 10 16:05:10.404462 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:10.404437 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77251b35-0b4a-4307-8ee8-f8a67c206212-kube-api-access-bpj5f" (OuterVolumeSpecName: "kube-api-access-bpj5f") pod "77251b35-0b4a-4307-8ee8-f8a67c206212" (UID: "77251b35-0b4a-4307-8ee8-f8a67c206212"). InnerVolumeSpecName "kube-api-access-bpj5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:05:10.404551 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:10.404524 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77251b35-0b4a-4307-8ee8-f8a67c206212-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "77251b35-0b4a-4307-8ee8-f8a67c206212" (UID: "77251b35-0b4a-4307-8ee8-f8a67c206212"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:05:10.503185 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:10.503095 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/77251b35-0b4a-4307-8ee8-f8a67c206212-kube-api-access-bpj5f\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:05:10.503185 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:10.503125 2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77251b35-0b4a-4307-8ee8-f8a67c206212-webhook-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:05:11.035139 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:11.035105 2582 generic.go:356] "Generic (PLEG): container finished" podID="77251b35-0b4a-4307-8ee8-f8a67c206212" containerID="91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6" exitCode=0 Jul 10 16:05:11.035139 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:11.035142 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585b678f49-c24vd" event={"ID":"77251b35-0b4a-4307-8ee8-f8a67c206212","Type":"ContainerDied","Data":"91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6"} Jul 10 16:05:11.035605 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:11.035148 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585b678f49-c24vd" Jul 10 16:05:11.035605 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:11.035186 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585b678f49-c24vd" event={"ID":"77251b35-0b4a-4307-8ee8-f8a67c206212","Type":"ContainerDied","Data":"47fc1e94754e151d6d8c9b6cb3d76c48545ef2f44f8be8a4f53e0cf22b404c2e"} Jul 10 16:05:11.035605 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:11.035207 2582 scope.go:117] "RemoveContainer" containerID="91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6" Jul 10 16:05:11.043857 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:11.043839 2582 scope.go:117] "RemoveContainer" containerID="91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6" Jul 10 16:05:11.044117 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:05:11.044099 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6\": container with ID starting with 91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6 not found: ID does not exist" containerID="91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6" Jul 10 16:05:11.044168 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:11.044127 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6"} err="failed to get container status \"91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6\": rpc error: code = NotFound desc = could not find container \"91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6\": container with ID starting with 91361169be6a51aeac7de5cd0c950f1e3b11184f19b1668288aa4e318353ffa6 not found: ID does not exist" Jul 10 16:05:11.057821 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:11.057791 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585b678f49-c24vd"] Jul 10 16:05:11.062191 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:11.062167 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-585b678f49-c24vd"] Jul 10 16:05:12.139322 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:12.139280 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77251b35-0b4a-4307-8ee8-f8a67c206212" path="/var/lib/kubelet/pods/77251b35-0b4a-4307-8ee8-f8a67c206212/volumes" Jul 10 16:05:30.798537 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.798475 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp"] Jul 10 16:05:30.799133 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.799114 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77251b35-0b4a-4307-8ee8-f8a67c206212" containerName="manager" Jul 10 16:05:30.799229 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.799135 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="77251b35-0b4a-4307-8ee8-f8a67c206212" containerName="manager" Jul 10 16:05:30.799229 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.799225 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="77251b35-0b4a-4307-8ee8-f8a67c206212" containerName="manager" Jul 10 16:05:30.803696 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.803673 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:30.807638 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.807613 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 10 16:05:30.808270 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.808249 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzzhf\"" Jul 10 16:05:30.815590 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.815568 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp"] Jul 10 16:05:30.895713 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.895678 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5a04fcc-84dc-4aeb-95d0-01e923b6da85-maas-api-tls\") pod \"maas-api-6b5665c595-4r6mp\" (UID: \"d5a04fcc-84dc-4aeb-95d0-01e923b6da85\") " pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:30.895882 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.895722 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghfn\" (UniqueName: \"kubernetes.io/projected/d5a04fcc-84dc-4aeb-95d0-01e923b6da85-kube-api-access-gghfn\") pod \"maas-api-6b5665c595-4r6mp\" (UID: \"d5a04fcc-84dc-4aeb-95d0-01e923b6da85\") " pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:30.895882 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.895745 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a04fcc-84dc-4aeb-95d0-01e923b6da85-openshift-service-ca\") pod \"maas-api-6b5665c595-4r6mp\" (UID: \"d5a04fcc-84dc-4aeb-95d0-01e923b6da85\") " pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:30.996433 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.996391 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5a04fcc-84dc-4aeb-95d0-01e923b6da85-maas-api-tls\") pod \"maas-api-6b5665c595-4r6mp\" (UID: \"d5a04fcc-84dc-4aeb-95d0-01e923b6da85\") " pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:30.996643 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.996447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gghfn\" (UniqueName: \"kubernetes.io/projected/d5a04fcc-84dc-4aeb-95d0-01e923b6da85-kube-api-access-gghfn\") pod \"maas-api-6b5665c595-4r6mp\" (UID: \"d5a04fcc-84dc-4aeb-95d0-01e923b6da85\") " pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:30.996643 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.996479 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a04fcc-84dc-4aeb-95d0-01e923b6da85-openshift-service-ca\") pod \"maas-api-6b5665c595-4r6mp\" (UID: \"d5a04fcc-84dc-4aeb-95d0-01e923b6da85\") " pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:30.997194 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.997170 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a04fcc-84dc-4aeb-95d0-01e923b6da85-openshift-service-ca\") pod \"maas-api-6b5665c595-4r6mp\" (UID: \"d5a04fcc-84dc-4aeb-95d0-01e923b6da85\") " pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:30.998922 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:30.998898 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5a04fcc-84dc-4aeb-95d0-01e923b6da85-maas-api-tls\") pod \"maas-api-6b5665c595-4r6mp\" (UID: \"d5a04fcc-84dc-4aeb-95d0-01e923b6da85\") " pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:31.011483 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.011455 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghfn\" (UniqueName: \"kubernetes.io/projected/d5a04fcc-84dc-4aeb-95d0-01e923b6da85-kube-api-access-gghfn\") pod \"maas-api-6b5665c595-4r6mp\" (UID: \"d5a04fcc-84dc-4aeb-95d0-01e923b6da85\") " pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:31.114284 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.114190 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:31.265065 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.265038 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp"] Jul 10 16:05:31.267616 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:05:31.267579 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a04fcc_84dc_4aeb_95d0_01e923b6da85.slice/crio-0304f1f472b3301e54dc90d5e1db38b1a2e51c19690e4a61064901d818793d73 WatchSource:0}: Error finding container 0304f1f472b3301e54dc90d5e1db38b1a2e51c19690e4a61064901d818793d73: Status 404 returned error can't find the container with id 0304f1f472b3301e54dc90d5e1db38b1a2e51c19690e4a61064901d818793d73 Jul 10 16:05:31.545704 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.545669 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-n55wg"] Jul 10 16:05:31.550565 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.550538 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:31.553412 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.553379 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 10 16:05:31.565806 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.565775 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-n55wg"] Jul 10 16:05:31.601401 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.601360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/334a0321-f565-4352-b99e-49b703e4c067-plugins-config-volume\") pod \"payload-pre-processing-7964457696-n55wg\" (UID: \"334a0321-f565-4352-b99e-49b703e4c067\") " pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:31.601568 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.601415 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc78b\" (UniqueName: \"kubernetes.io/projected/334a0321-f565-4352-b99e-49b703e4c067-kube-api-access-pc78b\") pod \"payload-pre-processing-7964457696-n55wg\" (UID: \"334a0321-f565-4352-b99e-49b703e4c067\") " pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:31.701824 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.701793 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc78b\" (UniqueName: \"kubernetes.io/projected/334a0321-f565-4352-b99e-49b703e4c067-kube-api-access-pc78b\") pod \"payload-pre-processing-7964457696-n55wg\" (UID: \"334a0321-f565-4352-b99e-49b703e4c067\") " pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:31.702061 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.701897 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/334a0321-f565-4352-b99e-49b703e4c067-plugins-config-volume\") pod \"payload-pre-processing-7964457696-n55wg\" (UID: \"334a0321-f565-4352-b99e-49b703e4c067\") " pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:31.702572 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.702554 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/334a0321-f565-4352-b99e-49b703e4c067-plugins-config-volume\") pod \"payload-pre-processing-7964457696-n55wg\" (UID: \"334a0321-f565-4352-b99e-49b703e4c067\") " pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:31.712764 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.712743 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc78b\" (UniqueName: \"kubernetes.io/projected/334a0321-f565-4352-b99e-49b703e4c067-kube-api-access-pc78b\") pod \"payload-pre-processing-7964457696-n55wg\" (UID: \"334a0321-f565-4352-b99e-49b703e4c067\") " pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:31.862158 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:31.862069 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:32.002211 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:32.002188 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-n55wg"] Jul 10 16:05:32.004041 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:05:32.004005 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334a0321_f565_4352_b99e_49b703e4c067.slice/crio-74d354a5468842a99099f71126fa34beee994aa666bfb4627eae8a3c5e73e075 WatchSource:0}: Error finding container 74d354a5468842a99099f71126fa34beee994aa666bfb4627eae8a3c5e73e075: Status 404 returned error can't find the container with id 74d354a5468842a99099f71126fa34beee994aa666bfb4627eae8a3c5e73e075 Jul 10 16:05:32.138978 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:32.138869 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" event={"ID":"334a0321-f565-4352-b99e-49b703e4c067","Type":"ContainerStarted","Data":"74d354a5468842a99099f71126fa34beee994aa666bfb4627eae8a3c5e73e075"} Jul 10 16:05:32.139140 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:32.139118 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" event={"ID":"d5a04fcc-84dc-4aeb-95d0-01e923b6da85","Type":"ContainerStarted","Data":"0304f1f472b3301e54dc90d5e1db38b1a2e51c19690e4a61064901d818793d73"} Jul 10 16:05:34.151320 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:34.151284 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" event={"ID":"334a0321-f565-4352-b99e-49b703e4c067","Type":"ContainerStarted","Data":"9c7bfac55d48ed307841d51f05a6c9a1f4f98cf7be35ea641a0c35ad738293f1"} Jul 10 16:05:34.151791 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:34.151383 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:34.175660 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:34.175597 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" podStartSLOduration=1.941747661 podStartE2EDuration="3.175575381s" totalImagesPullingTime="1.23382772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:05:34.171718838 +0000 UTC m=+609.719408148" watchObservedRunningTime="2026-07-10 16:05:34.175575381 +0000 UTC m=+609.723264692" Jul 10 16:05:35.158175 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:35.158091 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" event={"ID":"d5a04fcc-84dc-4aeb-95d0-01e923b6da85","Type":"ContainerStarted","Data":"f3261d6d583abed7e7d834f158e9eafc429a985eea3ca0fb2d9eaa6174964101"} Jul 10 16:05:35.158524 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:35.158396 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:35.178578 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:35.178531 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" podStartSLOduration=1.588425857 podStartE2EDuration="5.178515587s" totalImagesPullingTime="3.59008973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:05:35.177757745 +0000 UTC m=+610.725447054" watchObservedRunningTime="2026-07-10 16:05:35.178515587 +0000 UTC m=+610.726204946" Jul 10 16:05:41.168307 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:41.168279 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b5665c595-4r6mp" Jul 10 16:05:45.160000 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:45.159969 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-n55wg" Jul 10 16:05:59.781148 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.781112 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k"] Jul 10 16:05:59.789037 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.789011 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.792398 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.792377 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 16:05:59.793613 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.793570 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z2mp7\"" Jul 10 16:05:59.794013 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.793993 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 16:05:59.794091 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.794004 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 10 16:05:59.800206 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.800183 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k"] Jul 10 16:05:59.870355 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.870318 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.870518 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.870373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.870518 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.870449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.870593 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.870524 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f2ae27-0de0-43d5-8e7e-8730d5c98065-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.870593 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.870563 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.870656 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.870621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgfqt\" (UniqueName: \"kubernetes.io/projected/75f2ae27-0de0-43d5-8e7e-8730d5c98065-kube-api-access-hgfqt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.971564 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.971522 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.971726 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.971574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.971726 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.971599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.971726 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.971623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f2ae27-0de0-43d5-8e7e-8730d5c98065-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.971726 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.971662 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.971726 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.971714 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgfqt\" (UniqueName: \"kubernetes.io/projected/75f2ae27-0de0-43d5-8e7e-8730d5c98065-kube-api-access-hgfqt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.972040 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.972017 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.972091 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.972040 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.972190 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.972172 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.973860 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.973843 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75f2ae27-0de0-43d5-8e7e-8730d5c98065-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.974261 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.974246 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f2ae27-0de0-43d5-8e7e-8730d5c98065-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:05:59.981119 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:05:59.981094 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgfqt\" (UniqueName: \"kubernetes.io/projected/75f2ae27-0de0-43d5-8e7e-8730d5c98065-kube-api-access-hgfqt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k\" (UID: \"75f2ae27-0de0-43d5-8e7e-8730d5c98065\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:06:00.101565 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:00.101475 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:06:00.248281 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:00.248248 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k"] Jul 10 16:06:00.249633 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:06:00.249610 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f2ae27_0de0_43d5_8e7e_8730d5c98065.slice/crio-3c7ca2d6795bfa017a7d39778bfbfb64fc8c0ce25fd53c809dfdd7ce6c6c22f2 WatchSource:0}: Error finding container 3c7ca2d6795bfa017a7d39778bfbfb64fc8c0ce25fd53c809dfdd7ce6c6c22f2: Status 404 returned error can't find the container with id 3c7ca2d6795bfa017a7d39778bfbfb64fc8c0ce25fd53c809dfdd7ce6c6c22f2 Jul 10 16:06:00.277601 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:00.277566 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" event={"ID":"75f2ae27-0de0-43d5-8e7e-8730d5c98065","Type":"ContainerStarted","Data":"3c7ca2d6795bfa017a7d39778bfbfb64fc8c0ce25fd53c809dfdd7ce6c6c22f2"} Jul 10 16:06:02.289283 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:02.289250 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" event={"ID":"75f2ae27-0de0-43d5-8e7e-8730d5c98065","Type":"ContainerStarted","Data":"c90c7388ce609621f7adcf248e8c3d0db5ccbfb747757cdadaafb48d9611d42d"} Jul 10 16:06:02.318242 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:02.318196 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" podStartSLOduration=2.124213749 podStartE2EDuration="3.318181567s" totalImagesPullingTime="1.193967818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:06:02.315132921 +0000 UTC m=+637.862822240" watchObservedRunningTime="2026-07-10 16:06:02.318181567 +0000 UTC m=+637.865870875" Jul 10 16:06:10.102287 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:10.102246 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:06:10.102682 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:10.102349 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:06:10.115065 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:10.115041 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:06:10.338992 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:10.338965 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k" Jul 10 16:06:14.488122 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.488090 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8"] Jul 10 16:06:14.494463 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.494438 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.497243 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.497223 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 10 16:06:14.502669 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.502650 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8"] Jul 10 16:06:14.510098 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.510079 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhvck\" (UniqueName: \"kubernetes.io/projected/60777672-368b-4ff2-9d56-3caa79dc6d75-kube-api-access-fhvck\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.510205 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.510113 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.510205 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.510150 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.510315 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.510223 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.510315 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.510254 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60777672-368b-4ff2-9d56-3caa79dc6d75-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.510414 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.510319 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.611216 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.611188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhvck\" (UniqueName: \"kubernetes.io/projected/60777672-368b-4ff2-9d56-3caa79dc6d75-kube-api-access-fhvck\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.611216 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.611221 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.611440 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.611256 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.611440 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.611300 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.611440 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.611350 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60777672-368b-4ff2-9d56-3caa79dc6d75-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.611440 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.611379 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.611661 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.611639 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.611782 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.611682 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.611861 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.611805 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.613495 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.613476 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60777672-368b-4ff2-9d56-3caa79dc6d75-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.613792 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.613773 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60777672-368b-4ff2-9d56-3caa79dc6d75-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.629727 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.629702 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhvck\" (UniqueName: \"kubernetes.io/projected/60777672-368b-4ff2-9d56-3caa79dc6d75-kube-api-access-fhvck\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jbcx8\" (UID: \"60777672-368b-4ff2-9d56-3caa79dc6d75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.805859 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.805761 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:14.949899 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.949873 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8"] Jul 10 16:06:14.951023 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:06:14.950997 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60777672_368b_4ff2_9d56_3caa79dc6d75.slice/crio-9360b3d0f5f5cb5692ae50a0f3dee3be0051961155ec8273a4d3008b9405e472 WatchSource:0}: Error finding container 9360b3d0f5f5cb5692ae50a0f3dee3be0051961155ec8273a4d3008b9405e472: Status 404 returned error can't find the container with id 9360b3d0f5f5cb5692ae50a0f3dee3be0051961155ec8273a4d3008b9405e472 Jul 10 16:06:14.952497 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:14.952465 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 16:06:15.353688 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:15.353654 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" event={"ID":"60777672-368b-4ff2-9d56-3caa79dc6d75","Type":"ContainerStarted","Data":"4d13440ac68630008780d579ca110200b4190c13de469b20ad869a34689feb16"} Jul 10 16:06:15.353844 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:15.353706 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" event={"ID":"60777672-368b-4ff2-9d56-3caa79dc6d75","Type":"ContainerStarted","Data":"9360b3d0f5f5cb5692ae50a0f3dee3be0051961155ec8273a4d3008b9405e472"} Jul 10 16:06:15.399120 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:15.399056 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" podStartSLOduration=1.184295393 podStartE2EDuration="1.399031438s" totalImagesPullingTime="214.736045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:06:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:06:15.396323729 +0000 UTC m=+650.944013050" watchObservedRunningTime="2026-07-10 16:06:15.399031438 +0000 UTC m=+650.946720747" Jul 10 16:06:24.805877 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:24.805841 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:24.806328 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:24.805904 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:24.818254 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:24.818234 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:06:25.422253 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:06:25.422226 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jbcx8" Jul 10 16:08:12.698481 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:12.698445 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4df45c74-ckrps"] Jul 10 16:08:12.701509 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:12.701494 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4df45c74-ckrps" Jul 10 16:08:12.713482 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:12.713455 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4df45c74-ckrps"] Jul 10 16:08:12.826179 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:12.826149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vzk5\" (UniqueName: \"kubernetes.io/projected/033da1b0-894b-48ef-8fc2-ce1b84f713b3-kube-api-access-5vzk5\") pod \"authorino-6d4df45c74-ckrps\" (UID: \"033da1b0-894b-48ef-8fc2-ce1b84f713b3\") " pod="kuadrant-system/authorino-6d4df45c74-ckrps" Jul 10 16:08:12.826335 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:12.826193 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/033da1b0-894b-48ef-8fc2-ce1b84f713b3-tls-cert\") pod \"authorino-6d4df45c74-ckrps\" (UID: \"033da1b0-894b-48ef-8fc2-ce1b84f713b3\") " pod="kuadrant-system/authorino-6d4df45c74-ckrps" Jul 10 16:08:12.927315 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:12.927289 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vzk5\" (UniqueName: \"kubernetes.io/projected/033da1b0-894b-48ef-8fc2-ce1b84f713b3-kube-api-access-5vzk5\") pod \"authorino-6d4df45c74-ckrps\" (UID: \"033da1b0-894b-48ef-8fc2-ce1b84f713b3\") " pod="kuadrant-system/authorino-6d4df45c74-ckrps" Jul 10 16:08:12.927455 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:12.927326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/033da1b0-894b-48ef-8fc2-ce1b84f713b3-tls-cert\") pod \"authorino-6d4df45c74-ckrps\" (UID: \"033da1b0-894b-48ef-8fc2-ce1b84f713b3\") " pod="kuadrant-system/authorino-6d4df45c74-ckrps" Jul 10 16:08:12.929696 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:12.929679 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/033da1b0-894b-48ef-8fc2-ce1b84f713b3-tls-cert\") pod \"authorino-6d4df45c74-ckrps\" (UID: \"033da1b0-894b-48ef-8fc2-ce1b84f713b3\") " pod="kuadrant-system/authorino-6d4df45c74-ckrps" Jul 10 16:08:12.938710 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:12.938681 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vzk5\" (UniqueName: \"kubernetes.io/projected/033da1b0-894b-48ef-8fc2-ce1b84f713b3-kube-api-access-5vzk5\") pod \"authorino-6d4df45c74-ckrps\" (UID: \"033da1b0-894b-48ef-8fc2-ce1b84f713b3\") " pod="kuadrant-system/authorino-6d4df45c74-ckrps" Jul 10 16:08:13.011044 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:13.010988 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4df45c74-ckrps" Jul 10 16:08:13.160426 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:13.160403 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4df45c74-ckrps"] Jul 10 16:08:13.162795 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:08:13.162763 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod033da1b0_894b_48ef_8fc2_ce1b84f713b3.slice/crio-eb0db98619ae4ccfbd9cc292dc6f3e49aabaaa00417435269fc9b4f2f387a2e7 WatchSource:0}: Error finding container eb0db98619ae4ccfbd9cc292dc6f3e49aabaaa00417435269fc9b4f2f387a2e7: Status 404 returned error can't find the container with id eb0db98619ae4ccfbd9cc292dc6f3e49aabaaa00417435269fc9b4f2f387a2e7 Jul 10 16:08:13.951229 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:13.951192 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d4df45c74-ckrps" event={"ID":"033da1b0-894b-48ef-8fc2-ce1b84f713b3","Type":"ContainerStarted","Data":"cc05297e1c61f45a78d09e83ba2c2458c235ed12597d7926ea1bc94b8b301f0c"} Jul 10 16:08:13.951724 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:13.951250 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d4df45c74-ckrps" event={"ID":"033da1b0-894b-48ef-8fc2-ce1b84f713b3","Type":"ContainerStarted","Data":"eb0db98619ae4ccfbd9cc292dc6f3e49aabaaa00417435269fc9b4f2f387a2e7"} Jul 10 16:08:13.996950 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:13.996493 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d4df45c74-ckrps" podStartSLOduration=1.60903674 podStartE2EDuration="1.996469229s" totalImagesPullingTime="387.432489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:08:13.970088808 +0000 UTC m=+769.517778119" watchObservedRunningTime="2026-07-10 16:08:13.996469229 +0000 UTC m=+769.544158539" Jul 10 16:08:13.999978 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:13.997267 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-569b754667-fsqgh"] Jul 10 16:08:13.999978 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:13.997479 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-569b754667-fsqgh" podUID="1711a0ff-be86-4557-971f-38676df799b7" containerName="authorino" containerID="cri-o://0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51" gracePeriod=30 Jul 10 16:08:14.265299 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.265276 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:08:14.342777 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.342739 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mr5z\" (UniqueName: \"kubernetes.io/projected/1711a0ff-be86-4557-971f-38676df799b7-kube-api-access-2mr5z\") pod \"1711a0ff-be86-4557-971f-38676df799b7\" (UID: \"1711a0ff-be86-4557-971f-38676df799b7\") " Jul 10 16:08:14.342979 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.342833 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1711a0ff-be86-4557-971f-38676df799b7-tls-cert\") pod \"1711a0ff-be86-4557-971f-38676df799b7\" (UID: \"1711a0ff-be86-4557-971f-38676df799b7\") " Jul 10 16:08:14.345380 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.345344 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1711a0ff-be86-4557-971f-38676df799b7-kube-api-access-2mr5z" (OuterVolumeSpecName: "kube-api-access-2mr5z") pod "1711a0ff-be86-4557-971f-38676df799b7" (UID: "1711a0ff-be86-4557-971f-38676df799b7"). InnerVolumeSpecName "kube-api-access-2mr5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:08:14.354714 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.354686 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1711a0ff-be86-4557-971f-38676df799b7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1711a0ff-be86-4557-971f-38676df799b7" (UID: "1711a0ff-be86-4557-971f-38676df799b7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:08:14.443779 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.443748 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mr5z\" (UniqueName: \"kubernetes.io/projected/1711a0ff-be86-4557-971f-38676df799b7-kube-api-access-2mr5z\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:08:14.443779 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.443772 2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1711a0ff-be86-4557-971f-38676df799b7-tls-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:08:14.957467 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.957421 2582 generic.go:356] "Generic (PLEG): container finished" podID="1711a0ff-be86-4557-971f-38676df799b7" containerID="0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51" exitCode=0 Jul 10 16:08:14.957467 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.957455 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569b754667-fsqgh" Jul 10 16:08:14.957989 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.957493 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569b754667-fsqgh" event={"ID":"1711a0ff-be86-4557-971f-38676df799b7","Type":"ContainerDied","Data":"0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51"} Jul 10 16:08:14.957989 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.957528 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569b754667-fsqgh" event={"ID":"1711a0ff-be86-4557-971f-38676df799b7","Type":"ContainerDied","Data":"df0f67b1d3733de73b898ec88886e6a66aad2b5d53c5f42bbf805a26e57d22d3"} Jul 10 16:08:14.957989 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.957548 2582 scope.go:117] "RemoveContainer" containerID="0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51" Jul 10 16:08:14.966721 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.966707 2582 scope.go:117] "RemoveContainer" containerID="0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51" Jul 10 16:08:14.967084 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:08:14.967065 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51\": container with ID starting with 0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51 not found: ID does not exist" containerID="0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51" Jul 10 16:08:14.967158 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:14.967092 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51"} err="failed to get container status \"0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51\": rpc error: code = NotFound desc = could not find container \"0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51\": container with ID starting with 0bef34d2deb978a55204e4822c4a7225dcd4c68c4d82147fd4b9238630466c51 not found: ID does not exist" Jul 10 16:08:15.002904 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:15.002869 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-569b754667-fsqgh"] Jul 10 16:08:15.009586 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:15.009561 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-569b754667-fsqgh"] Jul 10 16:08:16.148913 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:08:16.148875 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1711a0ff-be86-4557-971f-38676df799b7" path="/var/lib/kubelet/pods/1711a0ff-be86-4557-971f-38676df799b7/volumes" Jul 10 16:09:27.390992 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:27.390956 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6998bfc557-vmn5v"] Jul 10 16:09:27.391490 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:27.391168 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6998bfc557-vmn5v" podUID="27634fcb-b102-45c6-ac08-bb19ecdc90a8" containerName="manager" containerID="cri-o://19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266" gracePeriod=30 Jul 10 16:09:27.639914 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:27.639886 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:09:27.737915 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:27.737881 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27634fcb-b102-45c6-ac08-bb19ecdc90a8-webhook-cert\") pod \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\" (UID: \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\") " Jul 10 16:09:27.738123 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:27.737980 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xx9z\" (UniqueName: \"kubernetes.io/projected/27634fcb-b102-45c6-ac08-bb19ecdc90a8-kube-api-access-4xx9z\") pod \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\" (UID: \"27634fcb-b102-45c6-ac08-bb19ecdc90a8\") " Jul 10 16:09:27.740035 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:27.739999 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27634fcb-b102-45c6-ac08-bb19ecdc90a8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "27634fcb-b102-45c6-ac08-bb19ecdc90a8" (UID: "27634fcb-b102-45c6-ac08-bb19ecdc90a8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:09:27.740035 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:27.740027 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27634fcb-b102-45c6-ac08-bb19ecdc90a8-kube-api-access-4xx9z" (OuterVolumeSpecName: "kube-api-access-4xx9z") pod "27634fcb-b102-45c6-ac08-bb19ecdc90a8" (UID: "27634fcb-b102-45c6-ac08-bb19ecdc90a8"). InnerVolumeSpecName "kube-api-access-4xx9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:09:27.838805 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:27.838773 2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27634fcb-b102-45c6-ac08-bb19ecdc90a8-webhook-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:09:27.838805 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:27.838798 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xx9z\" (UniqueName: \"kubernetes.io/projected/27634fcb-b102-45c6-ac08-bb19ecdc90a8-kube-api-access-4xx9z\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:09:28.338419 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:28.338383 2582 generic.go:356] "Generic (PLEG): container finished" podID="27634fcb-b102-45c6-ac08-bb19ecdc90a8" containerID="19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266" exitCode=0 Jul 10 16:09:28.338588 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:28.338427 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6998bfc557-vmn5v" Jul 10 16:09:28.338588 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:28.338470 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6998bfc557-vmn5v" event={"ID":"27634fcb-b102-45c6-ac08-bb19ecdc90a8","Type":"ContainerDied","Data":"19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266"} Jul 10 16:09:28.338588 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:28.338519 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6998bfc557-vmn5v" event={"ID":"27634fcb-b102-45c6-ac08-bb19ecdc90a8","Type":"ContainerDied","Data":"07fff6b46c33342b60762aa46bd3b370d4c07101b9d317981726c9f6c84485fd"} Jul 10 16:09:28.338588 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:28.338542 2582 scope.go:117] "RemoveContainer" containerID="19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266" Jul 10 16:09:28.352676 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:28.352654 2582 scope.go:117] "RemoveContainer" containerID="19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266" Jul 10 16:09:28.352976 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:09:28.352954 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266\": container with ID starting with 19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266 not found: ID does not exist" containerID="19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266" Jul 10 16:09:28.353029 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:28.352985 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266"} err="failed to get container status \"19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266\": rpc error: code = NotFound desc = could not find container \"19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266\": container with ID starting with 19e9027e2d3f8908448b598ff85bde5cd7fc6539825403f977046c08a4fc2266 not found: ID does not exist" Jul 10 16:09:28.372825 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:28.372793 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6998bfc557-vmn5v"] Jul 10 16:09:28.385672 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:28.385639 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6998bfc557-vmn5v"] Jul 10 16:09:29.280213 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.280175 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6998bfc557-xgpmv"] Jul 10 16:09:29.280664 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.280649 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1711a0ff-be86-4557-971f-38676df799b7" containerName="authorino" Jul 10 16:09:29.280708 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.280667 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1711a0ff-be86-4557-971f-38676df799b7" containerName="authorino" Jul 10 16:09:29.280708 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.280691 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27634fcb-b102-45c6-ac08-bb19ecdc90a8" containerName="manager" Jul 10 16:09:29.280708 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.280696 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="27634fcb-b102-45c6-ac08-bb19ecdc90a8" containerName="manager" Jul 10 16:09:29.280801 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.280777 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="27634fcb-b102-45c6-ac08-bb19ecdc90a8" containerName="manager" Jul 10 16:09:29.280801 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.280789 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1711a0ff-be86-4557-971f-38676df799b7" containerName="authorino" Jul 10 16:09:29.285083 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.285066 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:09:29.288228 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.288206 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 16:09:29.289449 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.289428 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mhv9d\"" Jul 10 16:09:29.289572 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.289468 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 16:09:29.296322 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.296300 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6998bfc557-xgpmv"] Jul 10 16:09:29.459389 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.459357 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snpm9\" (UniqueName: \"kubernetes.io/projected/49f070d0-c4ed-45af-a32b-5809739b5d48-kube-api-access-snpm9\") pod \"maas-controller-6998bfc557-xgpmv\" (UID: \"49f070d0-c4ed-45af-a32b-5809739b5d48\") " pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:09:29.459560 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.459403 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49f070d0-c4ed-45af-a32b-5809739b5d48-webhook-cert\") pod \"maas-controller-6998bfc557-xgpmv\" (UID: \"49f070d0-c4ed-45af-a32b-5809739b5d48\") " pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:09:29.561066 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.560983 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49f070d0-c4ed-45af-a32b-5809739b5d48-webhook-cert\") pod \"maas-controller-6998bfc557-xgpmv\" (UID: \"49f070d0-c4ed-45af-a32b-5809739b5d48\") " pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:09:29.561214 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.561102 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snpm9\" (UniqueName: \"kubernetes.io/projected/49f070d0-c4ed-45af-a32b-5809739b5d48-kube-api-access-snpm9\") pod \"maas-controller-6998bfc557-xgpmv\" (UID: \"49f070d0-c4ed-45af-a32b-5809739b5d48\") " pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:09:29.563360 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.563335 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49f070d0-c4ed-45af-a32b-5809739b5d48-webhook-cert\") pod \"maas-controller-6998bfc557-xgpmv\" (UID: \"49f070d0-c4ed-45af-a32b-5809739b5d48\") " pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:09:29.571161 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.571140 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snpm9\" (UniqueName: \"kubernetes.io/projected/49f070d0-c4ed-45af-a32b-5809739b5d48-kube-api-access-snpm9\") pod \"maas-controller-6998bfc557-xgpmv\" (UID: \"49f070d0-c4ed-45af-a32b-5809739b5d48\") " pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:09:29.596040 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.596006 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:09:29.733791 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:29.733768 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6998bfc557-xgpmv"] Jul 10 16:09:29.735974 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:09:29.735923 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f070d0_c4ed_45af_a32b_5809739b5d48.slice/crio-78705054d982f45e9624d0948484773088a4de09afe4170e1642caa89e037a96 WatchSource:0}: Error finding container 78705054d982f45e9624d0948484773088a4de09afe4170e1642caa89e037a96: Status 404 returned error can't find the container with id 78705054d982f45e9624d0948484773088a4de09afe4170e1642caa89e037a96 Jul 10 16:09:30.140526 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:30.140480 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27634fcb-b102-45c6-ac08-bb19ecdc90a8" path="/var/lib/kubelet/pods/27634fcb-b102-45c6-ac08-bb19ecdc90a8/volumes" Jul 10 16:09:30.351313 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:30.351269 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6998bfc557-xgpmv" event={"ID":"49f070d0-c4ed-45af-a32b-5809739b5d48","Type":"ContainerStarted","Data":"78705054d982f45e9624d0948484773088a4de09afe4170e1642caa89e037a96"} Jul 10 16:09:31.358576 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:31.358539 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6998bfc557-xgpmv" event={"ID":"49f070d0-c4ed-45af-a32b-5809739b5d48","Type":"ContainerStarted","Data":"dddccc4be7eed873a9325fb9a042dc7dd032fdfae6516cb3202f9636c5c8edd4"} Jul 10 16:09:31.358957 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:31.358595 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:09:31.382618 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:31.382570 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6998bfc557-xgpmv" podStartSLOduration=1.819371064 podStartE2EDuration="2.38255357s" totalImagesPullingTime="563.182506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:09:31.380737566 +0000 UTC m=+846.928426874" watchObservedRunningTime="2026-07-10 16:09:31.38255357 +0000 UTC m=+846.930242880" Jul 10 16:09:42.369346 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:09:42.369318 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6998bfc557-xgpmv" Jul 10 16:27:50.726980 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.726917 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk"] Jul 10 16:27:50.731520 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.731497 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:50.734089 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.734069 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-68af1888-serving-cert\"" Jul 10 16:27:50.739588 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.739566 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk"] Jul 10 16:27:50.857844 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.857799 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-maas-api-tls\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:50.858083 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.857876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-openshift-service-ca\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:50.858083 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.857915 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hdl\" (UniqueName: \"kubernetes.io/projected/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-kube-api-access-49hdl\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:50.958861 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.958809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-openshift-service-ca\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:50.959060 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.958877 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49hdl\" (UniqueName: \"kubernetes.io/projected/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-kube-api-access-49hdl\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:50.959060 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.958955 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-maas-api-tls\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:50.959135 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:27:50.959063 2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-serving-cert: secret "maas-api-e2e-ait-68af1888-serving-cert" not found Jul 10 16:27:50.959135 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:27:50.959125 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-maas-api-tls podName:d49a3e92-429b-47f5-9b2d-eaf9a9c34a43 nodeName:}" failed. No retries permitted until 2026-07-10 16:27:51.459108685 +0000 UTC m=+1947.006797972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-maas-api-tls") pod "maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" (UID: "d49a3e92-429b-47f5-9b2d-eaf9a9c34a43") : secret "maas-api-e2e-ait-68af1888-serving-cert" not found Jul 10 16:27:50.959482 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.959464 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-openshift-service-ca\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:50.967471 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:50.967440 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hdl\" (UniqueName: \"kubernetes.io/projected/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-kube-api-access-49hdl\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:51.464582 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:51.464553 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-maas-api-tls\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:51.466840 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:51.466823 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-maas-api-tls\") pod \"maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:51.644496 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:51.644457 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:51.779471 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:51.779450 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk"] Jul 10 16:27:51.781213 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:27:51.781186 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49a3e92_429b_47f5_9b2d_eaf9a9c34a43.slice/crio-757728345ac68e7ddc3da907a584c5da476fb025c6cd62a503c2bfd85a4a03fe WatchSource:0}: Error finding container 757728345ac68e7ddc3da907a584c5da476fb025c6cd62a503c2bfd85a4a03fe: Status 404 returned error can't find the container with id 757728345ac68e7ddc3da907a584c5da476fb025c6cd62a503c2bfd85a4a03fe Jul 10 16:27:51.782458 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:51.782441 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 16:27:51.910577 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:51.910543 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" event={"ID":"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43","Type":"ContainerStarted","Data":"757728345ac68e7ddc3da907a584c5da476fb025c6cd62a503c2bfd85a4a03fe"} Jul 10 16:27:52.916787 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:52.916749 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" event={"ID":"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43","Type":"ContainerStarted","Data":"018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e"} Jul 10 16:27:52.917310 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:52.916841 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:52.935175 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:52.935110 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" podStartSLOduration=2.402898416 podStartE2EDuration="2.935090164s" totalImagesPullingTime="532.191748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:27:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:27:52.93325414 +0000 UTC m=+1948.480943462" watchObservedRunningTime="2026-07-10 16:27:52.935090164 +0000 UTC m=+1948.482779475" Jul 10 16:27:55.362680 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.362640 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk"] Jul 10 16:27:55.363298 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.362896 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" podUID="d49a3e92-429b-47f5-9b2d-eaf9a9c34a43" containerName="maas-api" containerID="cri-o://018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e" gracePeriod=30 Jul 10 16:27:55.611504 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.611481 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:55.701279 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.701244 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-maas-api-tls\") pod \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " Jul 10 16:27:55.701449 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.701329 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49hdl\" (UniqueName: \"kubernetes.io/projected/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-kube-api-access-49hdl\") pod \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " Jul 10 16:27:55.701449 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.701368 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-openshift-service-ca\") pod \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\" (UID: \"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43\") " Jul 10 16:27:55.701783 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.701752 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d49a3e92-429b-47f5-9b2d-eaf9a9c34a43" (UID: "d49a3e92-429b-47f5-9b2d-eaf9a9c34a43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:27:55.703483 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.703456 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d49a3e92-429b-47f5-9b2d-eaf9a9c34a43" (UID: "d49a3e92-429b-47f5-9b2d-eaf9a9c34a43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:27:55.703576 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.703520 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-kube-api-access-49hdl" (OuterVolumeSpecName: "kube-api-access-49hdl") pod "d49a3e92-429b-47f5-9b2d-eaf9a9c34a43" (UID: "d49a3e92-429b-47f5-9b2d-eaf9a9c34a43"). InnerVolumeSpecName "kube-api-access-49hdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:27:55.802540 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.802505 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49hdl\" (UniqueName: \"kubernetes.io/projected/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-kube-api-access-49hdl\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:27:55.802540 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.802534 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-openshift-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:27:55.802540 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.802544 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43-maas-api-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:27:55.933243 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.933209 2582 generic.go:356] "Generic (PLEG): container finished" podID="d49a3e92-429b-47f5-9b2d-eaf9a9c34a43" containerID="018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e" exitCode=0 Jul 10 16:27:55.933412 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.933263 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" Jul 10 16:27:55.933412 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.933302 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" event={"ID":"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43","Type":"ContainerDied","Data":"018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e"} Jul 10 16:27:55.933412 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.933357 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk" event={"ID":"d49a3e92-429b-47f5-9b2d-eaf9a9c34a43","Type":"ContainerDied","Data":"757728345ac68e7ddc3da907a584c5da476fb025c6cd62a503c2bfd85a4a03fe"} Jul 10 16:27:55.933412 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.933381 2582 scope.go:117] "RemoveContainer" containerID="018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e" Jul 10 16:27:55.942724 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.942705 2582 scope.go:117] "RemoveContainer" containerID="018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e" Jul 10 16:27:55.943004 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:27:55.942977 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e\": container with ID starting with 018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e not found: ID does not exist" containerID="018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e" Jul 10 16:27:55.943104 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.943017 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e"} err="failed to get container status \"018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e\": rpc error: code = NotFound desc = could not find container \"018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e\": container with ID starting with 018003e85af829c91cfaad27e0f603c39eb73f7db8becf63826631d878c1b02e not found: ID does not exist" Jul 10 16:27:55.955994 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.955906 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk"] Jul 10 16:27:55.961924 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:55.961900 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68af1888-6bb45b76bb-nfrlk"] Jul 10 16:27:56.140154 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:27:56.140121 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d49a3e92-429b-47f5-9b2d-eaf9a9c34a43" path="/var/lib/kubelet/pods/d49a3e92-429b-47f5-9b2d-eaf9a9c34a43/volumes" Jul 10 16:28:02.836617 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.836579 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd"] Jul 10 16:28:02.837244 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.837097 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49a3e92-429b-47f5-9b2d-eaf9a9c34a43" containerName="maas-api" Jul 10 16:28:02.837244 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.837116 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49a3e92-429b-47f5-9b2d-eaf9a9c34a43" containerName="maas-api" Jul 10 16:28:02.837388 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.837254 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d49a3e92-429b-47f5-9b2d-eaf9a9c34a43" containerName="maas-api" Jul 10 16:28:02.840491 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.840466 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:02.843167 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.843143 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-bcbb4aca-serving-cert\"" Jul 10 16:28:02.850516 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.850489 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd"] Jul 10 16:28:02.865037 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.864998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc9b5200-1ef3-4fd1-b9e1-c90122114983-openshift-service-ca\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:02.865212 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.865139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxmf7\" (UniqueName: \"kubernetes.io/projected/cc9b5200-1ef3-4fd1-b9e1-c90122114983-kube-api-access-hxmf7\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:02.865212 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.865171 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc9b5200-1ef3-4fd1-b9e1-c90122114983-maas-api-tls\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:02.965623 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.965592 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxmf7\" (UniqueName: \"kubernetes.io/projected/cc9b5200-1ef3-4fd1-b9e1-c90122114983-kube-api-access-hxmf7\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:02.965623 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.965628 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc9b5200-1ef3-4fd1-b9e1-c90122114983-maas-api-tls\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:02.965849 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.965703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc9b5200-1ef3-4fd1-b9e1-c90122114983-openshift-service-ca\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:02.965849 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:28:02.965836 2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-serving-cert: secret "maas-api-e2e-ait-bcbb4aca-serving-cert" not found Jul 10 16:28:02.965941 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:28:02.965913 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9b5200-1ef3-4fd1-b9e1-c90122114983-maas-api-tls podName:cc9b5200-1ef3-4fd1-b9e1-c90122114983 nodeName:}" failed. No retries permitted until 2026-07-10 16:28:03.465893573 +0000 UTC m=+1959.013582863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cc9b5200-1ef3-4fd1-b9e1-c90122114983-maas-api-tls") pod "maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" (UID: "cc9b5200-1ef3-4fd1-b9e1-c90122114983") : secret "maas-api-e2e-ait-bcbb4aca-serving-cert" not found Jul 10 16:28:02.966421 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.966402 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc9b5200-1ef3-4fd1-b9e1-c90122114983-openshift-service-ca\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:02.974564 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:02.974536 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxmf7\" (UniqueName: \"kubernetes.io/projected/cc9b5200-1ef3-4fd1-b9e1-c90122114983-kube-api-access-hxmf7\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:03.470781 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:03.470740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc9b5200-1ef3-4fd1-b9e1-c90122114983-maas-api-tls\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:03.473174 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:03.473149 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc9b5200-1ef3-4fd1-b9e1-c90122114983-maas-api-tls\") pod \"maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:03.753481 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:03.753385 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:03.893620 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:03.893551 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd"] Jul 10 16:28:03.896369 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:28:03.896338 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9b5200_1ef3_4fd1_b9e1_c90122114983.slice/crio-3c9dd4b393312c5cdcde9ca580f32b1fc10c3e7df57788500dd49ec45c33ec8b WatchSource:0}: Error finding container 3c9dd4b393312c5cdcde9ca580f32b1fc10c3e7df57788500dd49ec45c33ec8b: Status 404 returned error can't find the container with id 3c9dd4b393312c5cdcde9ca580f32b1fc10c3e7df57788500dd49ec45c33ec8b Jul 10 16:28:03.975092 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:03.975054 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" event={"ID":"cc9b5200-1ef3-4fd1-b9e1-c90122114983","Type":"ContainerStarted","Data":"3c9dd4b393312c5cdcde9ca580f32b1fc10c3e7df57788500dd49ec45c33ec8b"} Jul 10 16:28:04.981244 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:04.981148 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" event={"ID":"cc9b5200-1ef3-4fd1-b9e1-c90122114983","Type":"ContainerStarted","Data":"e7cc4caa52a8589152bb60d03c00e28e0760b7079a87ecfe2df602d29d2fbe19"} Jul 10 16:28:04.981694 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:04.981257 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:05.001627 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:05.001572 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" podStartSLOduration=2.208692835 podStartE2EDuration="3.001554983s" totalImagesPullingTime="792.862148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:28:04.999199416 +0000 UTC m=+1960.546888727" watchObservedRunningTime="2026-07-10 16:28:05.001554983 +0000 UTC m=+1960.549244364" Jul 10 16:28:07.826375 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:07.826342 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd"] Jul 10 16:28:07.826878 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:07.826530 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" podUID="cc9b5200-1ef3-4fd1-b9e1-c90122114983" containerName="maas-api" containerID="cri-o://e7cc4caa52a8589152bb60d03c00e28e0760b7079a87ecfe2df602d29d2fbe19" gracePeriod=30 Jul 10 16:28:08.000080 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.000053 2582 generic.go:356] "Generic (PLEG): container finished" podID="cc9b5200-1ef3-4fd1-b9e1-c90122114983" containerID="e7cc4caa52a8589152bb60d03c00e28e0760b7079a87ecfe2df602d29d2fbe19" exitCode=0 Jul 10 16:28:08.000222 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.000122 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" event={"ID":"cc9b5200-1ef3-4fd1-b9e1-c90122114983","Type":"ContainerDied","Data":"e7cc4caa52a8589152bb60d03c00e28e0760b7079a87ecfe2df602d29d2fbe19"} Jul 10 16:28:08.073864 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.073842 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:08.116741 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.116662 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc9b5200-1ef3-4fd1-b9e1-c90122114983-maas-api-tls\") pod \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " Jul 10 16:28:08.116741 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.116732 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc9b5200-1ef3-4fd1-b9e1-c90122114983-openshift-service-ca\") pod \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " Jul 10 16:28:08.116919 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.116771 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxmf7\" (UniqueName: \"kubernetes.io/projected/cc9b5200-1ef3-4fd1-b9e1-c90122114983-kube-api-access-hxmf7\") pod \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\" (UID: \"cc9b5200-1ef3-4fd1-b9e1-c90122114983\") " Jul 10 16:28:08.117210 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.117181 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc9b5200-1ef3-4fd1-b9e1-c90122114983-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc9b5200-1ef3-4fd1-b9e1-c90122114983" (UID: "cc9b5200-1ef3-4fd1-b9e1-c90122114983"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:28:08.118733 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.118707 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc9b5200-1ef3-4fd1-b9e1-c90122114983-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc9b5200-1ef3-4fd1-b9e1-c90122114983" (UID: "cc9b5200-1ef3-4fd1-b9e1-c90122114983"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:28:08.118820 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.118786 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc9b5200-1ef3-4fd1-b9e1-c90122114983-kube-api-access-hxmf7" (OuterVolumeSpecName: "kube-api-access-hxmf7") pod "cc9b5200-1ef3-4fd1-b9e1-c90122114983" (UID: "cc9b5200-1ef3-4fd1-b9e1-c90122114983"). InnerVolumeSpecName "kube-api-access-hxmf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:28:08.217849 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.217814 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc9b5200-1ef3-4fd1-b9e1-c90122114983-openshift-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:28:08.217849 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.217849 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxmf7\" (UniqueName: \"kubernetes.io/projected/cc9b5200-1ef3-4fd1-b9e1-c90122114983-kube-api-access-hxmf7\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:28:08.218089 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:08.217862 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc9b5200-1ef3-4fd1-b9e1-c90122114983-maas-api-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:28:09.006567 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:09.006528 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" event={"ID":"cc9b5200-1ef3-4fd1-b9e1-c90122114983","Type":"ContainerDied","Data":"3c9dd4b393312c5cdcde9ca580f32b1fc10c3e7df57788500dd49ec45c33ec8b"} Jul 10 16:28:09.006567 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:09.006546 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd" Jul 10 16:28:09.007089 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:09.006598 2582 scope.go:117] "RemoveContainer" containerID="e7cc4caa52a8589152bb60d03c00e28e0760b7079a87ecfe2df602d29d2fbe19" Jul 10 16:28:09.024402 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:09.024377 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd"] Jul 10 16:28:09.026215 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:09.026190 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bcbb4aca-7ddccfc87d-k2jqd"] Jul 10 16:28:10.140669 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:28:10.140636 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc9b5200-1ef3-4fd1-b9e1-c90122114983" path="/var/lib/kubelet/pods/cc9b5200-1ef3-4fd1-b9e1-c90122114983/volumes" Jul 10 16:33:51.677282 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.677252 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m"] Jul 10 16:33:51.677686 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.677665 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9b5200-1ef3-4fd1-b9e1-c90122114983" containerName="maas-api" Jul 10 16:33:51.677686 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.677676 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9b5200-1ef3-4fd1-b9e1-c90122114983" containerName="maas-api" Jul 10 16:33:51.677757 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.677748 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc9b5200-1ef3-4fd1-b9e1-c90122114983" containerName="maas-api" Jul 10 16:33:51.680528 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.680508 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:51.683226 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.683207 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-468a4585-serving-cert\"" Jul 10 16:33:51.693376 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.693353 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m"] Jul 10 16:33:51.847798 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.847750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d0df3e-1249-48cc-99ba-4c290358938e-openshift-service-ca\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:51.847798 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.847800 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d0df3e-1249-48cc-99ba-4c290358938e-maas-api-tls\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:51.848044 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.847849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rh9s\" (UniqueName: \"kubernetes.io/projected/45d0df3e-1249-48cc-99ba-4c290358938e-kube-api-access-9rh9s\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:51.948757 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.948656 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d0df3e-1249-48cc-99ba-4c290358938e-openshift-service-ca\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:51.948757 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.948710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d0df3e-1249-48cc-99ba-4c290358938e-maas-api-tls\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:51.948757 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.948738 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rh9s\" (UniqueName: \"kubernetes.io/projected/45d0df3e-1249-48cc-99ba-4c290358938e-kube-api-access-9rh9s\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:51.949026 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:33:51.948882 2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-serving-cert: secret "maas-api-e2e-mt-468a4585-serving-cert" not found Jul 10 16:33:51.949026 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:33:51.949000 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d0df3e-1249-48cc-99ba-4c290358938e-maas-api-tls podName:45d0df3e-1249-48cc-99ba-4c290358938e nodeName:}" failed. No retries permitted until 2026-07-10 16:33:52.448975172 +0000 UTC m=+2307.996664479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/45d0df3e-1249-48cc-99ba-4c290358938e-maas-api-tls") pod "maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" (UID: "45d0df3e-1249-48cc-99ba-4c290358938e") : secret "maas-api-e2e-mt-468a4585-serving-cert" not found Jul 10 16:33:51.949439 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.949420 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d0df3e-1249-48cc-99ba-4c290358938e-openshift-service-ca\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:51.958276 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:51.958250 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rh9s\" (UniqueName: \"kubernetes.io/projected/45d0df3e-1249-48cc-99ba-4c290358938e-kube-api-access-9rh9s\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:52.453203 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:52.453166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d0df3e-1249-48cc-99ba-4c290358938e-maas-api-tls\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:52.455527 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:52.455504 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d0df3e-1249-48cc-99ba-4c290358938e-maas-api-tls\") pod \"maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:52.591084 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:52.591048 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:52.726120 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:52.726095 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m"] Jul 10 16:33:52.727955 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:33:52.727905 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d0df3e_1249_48cc_99ba_4c290358938e.slice/crio-fafc297b0d00b25c1b3af372b65b2cde3a403a2d7736b4a0536af3a21b904936 WatchSource:0}: Error finding container fafc297b0d00b25c1b3af372b65b2cde3a403a2d7736b4a0536af3a21b904936: Status 404 returned error can't find the container with id fafc297b0d00b25c1b3af372b65b2cde3a403a2d7736b4a0536af3a21b904936 Jul 10 16:33:52.729630 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:52.729608 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 16:33:53.727408 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:53.727373 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" event={"ID":"45d0df3e-1249-48cc-99ba-4c290358938e","Type":"ContainerStarted","Data":"6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad"} Jul 10 16:33:53.727824 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:53.727428 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" event={"ID":"45d0df3e-1249-48cc-99ba-4c290358938e","Type":"ContainerStarted","Data":"fafc297b0d00b25c1b3af372b65b2cde3a403a2d7736b4a0536af3a21b904936"} Jul 10 16:33:53.727824 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:53.727499 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:33:53.746268 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:53.746222 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" podStartSLOduration=2.224954166 podStartE2EDuration="2.746204812s" totalImagesPullingTime="521.250646ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:33:53.744608947 +0000 UTC m=+2309.292298259" watchObservedRunningTime="2026-07-10 16:33:53.746204812 +0000 UTC m=+2309.293894124" Jul 10 16:33:59.738382 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:33:59.738345 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:34:23.370107 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.370016 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m"] Jul 10 16:34:23.370668 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.370307 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" podUID="45d0df3e-1249-48cc-99ba-4c290358938e" containerName="maas-api" containerID="cri-o://6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad" gracePeriod=30 Jul 10 16:34:23.626638 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.626579 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:34:23.754776 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.754753 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d0df3e-1249-48cc-99ba-4c290358938e-maas-api-tls\") pod \"45d0df3e-1249-48cc-99ba-4c290358938e\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " Jul 10 16:34:23.754983 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.754876 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d0df3e-1249-48cc-99ba-4c290358938e-openshift-service-ca\") pod \"45d0df3e-1249-48cc-99ba-4c290358938e\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " Jul 10 16:34:23.754983 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.754902 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rh9s\" (UniqueName: \"kubernetes.io/projected/45d0df3e-1249-48cc-99ba-4c290358938e-kube-api-access-9rh9s\") pod \"45d0df3e-1249-48cc-99ba-4c290358938e\" (UID: \"45d0df3e-1249-48cc-99ba-4c290358938e\") " Jul 10 16:34:23.755250 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.755219 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d0df3e-1249-48cc-99ba-4c290358938e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "45d0df3e-1249-48cc-99ba-4c290358938e" (UID: "45d0df3e-1249-48cc-99ba-4c290358938e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:34:23.756898 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.756875 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d0df3e-1249-48cc-99ba-4c290358938e-kube-api-access-9rh9s" (OuterVolumeSpecName: "kube-api-access-9rh9s") pod "45d0df3e-1249-48cc-99ba-4c290358938e" (UID: "45d0df3e-1249-48cc-99ba-4c290358938e"). InnerVolumeSpecName "kube-api-access-9rh9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:34:23.756993 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.756947 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d0df3e-1249-48cc-99ba-4c290358938e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "45d0df3e-1249-48cc-99ba-4c290358938e" (UID: "45d0df3e-1249-48cc-99ba-4c290358938e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:34:23.856359 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.856330 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d0df3e-1249-48cc-99ba-4c290358938e-openshift-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:34:23.856359 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.856354 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rh9s\" (UniqueName: \"kubernetes.io/projected/45d0df3e-1249-48cc-99ba-4c290358938e-kube-api-access-9rh9s\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:34:23.856359 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.856363 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d0df3e-1249-48cc-99ba-4c290358938e-maas-api-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:34:23.883913 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.883840 2582 generic.go:356] "Generic (PLEG): container finished" podID="45d0df3e-1249-48cc-99ba-4c290358938e" containerID="6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad" exitCode=0 Jul 10 16:34:23.883913 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.883871 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" event={"ID":"45d0df3e-1249-48cc-99ba-4c290358938e","Type":"ContainerDied","Data":"6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad"} Jul 10 16:34:23.883913 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.883903 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" Jul 10 16:34:23.884116 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.883924 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m" event={"ID":"45d0df3e-1249-48cc-99ba-4c290358938e","Type":"ContainerDied","Data":"fafc297b0d00b25c1b3af372b65b2cde3a403a2d7736b4a0536af3a21b904936"} Jul 10 16:34:23.884116 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.883962 2582 scope.go:117] "RemoveContainer" containerID="6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad" Jul 10 16:34:23.892686 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.892572 2582 scope.go:117] "RemoveContainer" containerID="6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad" Jul 10 16:34:23.893018 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:34:23.892989 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad\": container with ID starting with 6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad not found: ID does not exist" containerID="6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad" Jul 10 16:34:23.893117 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.893038 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad"} err="failed to get container status \"6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad\": rpc error: code = NotFound desc = could not find container \"6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad\": container with ID starting with 6b27d80f0e9efde3f1cffb895c9ea8a91285ae69986c146bdfc3121354742fad not found: ID does not exist" Jul 10 16:34:23.908333 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.908309 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m"] Jul 10 16:34:23.912008 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:23.911985 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-468a4585-8c4dfc96d-hv77m"] Jul 10 16:34:24.139320 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:34:24.139233 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d0df3e-1249-48cc-99ba-4c290358938e" path="/var/lib/kubelet/pods/45d0df3e-1249-48cc-99ba-4c290358938e/volumes" Jul 10 16:36:10.546248 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.546153 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h"] Jul 10 16:36:10.547134 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.547110 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d0df3e-1249-48cc-99ba-4c290358938e" containerName="maas-api" Jul 10 16:36:10.547268 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.547140 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d0df3e-1249-48cc-99ba-4c290358938e" containerName="maas-api" Jul 10 16:36:10.547374 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.547360 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d0df3e-1249-48cc-99ba-4c290358938e" containerName="maas-api" Jul 10 16:36:10.551715 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.551691 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:10.554654 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.554628 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-327c4a-serving-cert\"" Jul 10 16:36:10.555827 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.555803 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h"] Jul 10 16:36:10.569945 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.569904 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70566345-d924-4fab-adc8-afe35654b4f0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:10.570081 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.570026 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70566345-d924-4fab-adc8-afe35654b4f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:10.570081 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.570072 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmzts\" (UniqueName: \"kubernetes.io/projected/70566345-d924-4fab-adc8-afe35654b4f0-kube-api-access-wmzts\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:10.670759 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.670722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmzts\" (UniqueName: \"kubernetes.io/projected/70566345-d924-4fab-adc8-afe35654b4f0-kube-api-access-wmzts\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:10.670975 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.670794 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70566345-d924-4fab-adc8-afe35654b4f0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:10.670975 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.670844 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70566345-d924-4fab-adc8-afe35654b4f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:10.671080 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:36:10.671002 2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-serving-cert: secret "maas-api-e2e-inf-a-327c4a-serving-cert" not found Jul 10 16:36:10.671080 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:36:10.671074 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70566345-d924-4fab-adc8-afe35654b4f0-maas-api-tls podName:70566345-d924-4fab-adc8-afe35654b4f0 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:11.171057021 +0000 UTC m=+2446.718746311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/70566345-d924-4fab-adc8-afe35654b4f0-maas-api-tls") pod "maas-api-e2e-inf-a-327c4a-6646997485-zss5h" (UID: "70566345-d924-4fab-adc8-afe35654b4f0") : secret "maas-api-e2e-inf-a-327c4a-serving-cert" not found Jul 10 16:36:10.671475 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.671456 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70566345-d924-4fab-adc8-afe35654b4f0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:10.680156 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:10.680134 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmzts\" (UniqueName: \"kubernetes.io/projected/70566345-d924-4fab-adc8-afe35654b4f0-kube-api-access-wmzts\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:11.176184 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:11.176146 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70566345-d924-4fab-adc8-afe35654b4f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:11.178554 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:11.178527 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70566345-d924-4fab-adc8-afe35654b4f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-327c4a-6646997485-zss5h\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:11.464951 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:11.464852 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:11.609838 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:11.609813 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h"] Jul 10 16:36:11.611453 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:36:11.611425 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70566345_d924_4fab_adc8_afe35654b4f0.slice/crio-52ca16450951844e0b777afc009af9500b74cb78f1baa0703e70f083db98dce4 WatchSource:0}: Error finding container 52ca16450951844e0b777afc009af9500b74cb78f1baa0703e70f083db98dce4: Status 404 returned error can't find the container with id 52ca16450951844e0b777afc009af9500b74cb78f1baa0703e70f083db98dce4 Jul 10 16:36:12.414946 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:12.414851 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" event={"ID":"70566345-d924-4fab-adc8-afe35654b4f0","Type":"ContainerStarted","Data":"da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4"} Jul 10 16:36:12.414946 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:12.414900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" event={"ID":"70566345-d924-4fab-adc8-afe35654b4f0","Type":"ContainerStarted","Data":"52ca16450951844e0b777afc009af9500b74cb78f1baa0703e70f083db98dce4"} Jul 10 16:36:12.415131 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:12.414970 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:36:12.432800 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:12.432753 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" podStartSLOduration=1.997117497 podStartE2EDuration="2.432738202s" totalImagesPullingTime="435.620705ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:12.431121656 +0000 UTC m=+2447.978810978" watchObservedRunningTime="2026-07-10 16:36:12.432738202 +0000 UTC m=+2447.980427510" Jul 10 16:36:18.426861 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:36:18.426832 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:39:27.727063 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:27.726969 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h"] Jul 10 16:39:27.729821 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:27.727233 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" podUID="70566345-d924-4fab-adc8-afe35654b4f0" containerName="maas-api" containerID="cri-o://da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4" gracePeriod=30 Jul 10 16:39:27.978248 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:27.978187 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:39:28.048742 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.048710 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70566345-d924-4fab-adc8-afe35654b4f0-openshift-service-ca\") pod \"70566345-d924-4fab-adc8-afe35654b4f0\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " Jul 10 16:39:28.048902 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.048750 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70566345-d924-4fab-adc8-afe35654b4f0-maas-api-tls\") pod \"70566345-d924-4fab-adc8-afe35654b4f0\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " Jul 10 16:39:28.048992 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.048972 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmzts\" (UniqueName: \"kubernetes.io/projected/70566345-d924-4fab-adc8-afe35654b4f0-kube-api-access-wmzts\") pod \"70566345-d924-4fab-adc8-afe35654b4f0\" (UID: \"70566345-d924-4fab-adc8-afe35654b4f0\") " Jul 10 16:39:28.049102 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.049078 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70566345-d924-4fab-adc8-afe35654b4f0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "70566345-d924-4fab-adc8-afe35654b4f0" (UID: "70566345-d924-4fab-adc8-afe35654b4f0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:39:28.049319 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.049291 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70566345-d924-4fab-adc8-afe35654b4f0-openshift-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:39:28.050843 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.050822 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70566345-d924-4fab-adc8-afe35654b4f0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "70566345-d924-4fab-adc8-afe35654b4f0" (UID: "70566345-d924-4fab-adc8-afe35654b4f0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:39:28.050975 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.050958 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70566345-d924-4fab-adc8-afe35654b4f0-kube-api-access-wmzts" (OuterVolumeSpecName: "kube-api-access-wmzts") pod "70566345-d924-4fab-adc8-afe35654b4f0" (UID: "70566345-d924-4fab-adc8-afe35654b4f0"). InnerVolumeSpecName "kube-api-access-wmzts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:39:28.150316 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.150291 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmzts\" (UniqueName: \"kubernetes.io/projected/70566345-d924-4fab-adc8-afe35654b4f0-kube-api-access-wmzts\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:39:28.150316 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.150314 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70566345-d924-4fab-adc8-afe35654b4f0-maas-api-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\"" Jul 10 16:39:28.371482 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.371391 2582 generic.go:356] "Generic (PLEG): container finished" podID="70566345-d924-4fab-adc8-afe35654b4f0" containerID="da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4" exitCode=0 Jul 10 16:39:28.371482 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.371435 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" Jul 10 16:39:28.371482 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.371464 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" event={"ID":"70566345-d924-4fab-adc8-afe35654b4f0","Type":"ContainerDied","Data":"da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4"} Jul 10 16:39:28.371721 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.371510 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h" event={"ID":"70566345-d924-4fab-adc8-afe35654b4f0","Type":"ContainerDied","Data":"52ca16450951844e0b777afc009af9500b74cb78f1baa0703e70f083db98dce4"} Jul 10 16:39:28.371721 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.371534 2582 scope.go:117] "RemoveContainer" containerID="da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4" Jul 10 16:39:28.381204 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.381187 2582 scope.go:117] "RemoveContainer" containerID="da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4" Jul 10 16:39:28.381454 ip-10-0-135-133 kubenswrapper[2582]: E0710 16:39:28.381437 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4\": container with ID starting with da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4 not found: ID does not exist" containerID="da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4" Jul 10 16:39:28.381524 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.381464 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4"} err="failed to get container status \"da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4\": rpc error: code = NotFound desc = could not find container \"da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4\": container with ID starting with da652ed928e90cbc7ed237c11537d4bb71056e8c3ea3e54d1b450b0a8582eee4 not found: ID does not exist" Jul 10 16:39:28.389909 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.389881 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h"] Jul 10 16:39:28.393326 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:28.393306 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-327c4a-6646997485-zss5h"] Jul 10 16:39:30.139864 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:30.139825 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70566345-d924-4fab-adc8-afe35654b4f0" path="/var/lib/kubelet/pods/70566345-d924-4fab-adc8-afe35654b4f0/volumes" Jul 10 16:39:41.795803 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:41.795770 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d4df45c74-ckrps_033da1b0-894b-48ef-8fc2-ce1b84f713b3/authorino/0.log" Jul 10 16:39:47.057616 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:47.057587 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6998bfc557-xgpmv_49f070d0-c4ed-45af-a32b-5809739b5d48/manager/0.log" Jul 10 16:39:47.729364 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:47.729337 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-765dfd8876-r448f_35070e4f-e5f0-4477-a6e3-db86de17dc30/copy-manifests/0.log" Jul 10 16:39:47.739674 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:47.739643 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-765dfd8876-r448f_35070e4f-e5f0-4477-a6e3-db86de17dc30/manager/0.log" Jul 10 16:39:49.132715 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:49.132683 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d4df45c74-ckrps_033da1b0-894b-48ef-8fc2-ce1b84f713b3/authorino/0.log" Jul 10 16:39:50.788967 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:50.788915 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b74489749-phr4r_fc240166-f20a-40d7-bfdf-cdc8ffda89d5/kube-auth-proxy/0.log" Jul 10 16:39:51.039416 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:51.039335 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-n55wg_334a0321-f565-4352-b99e-49b703e4c067/payload-pre-processing/0.log" Jul 10 16:39:51.659941 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:51.659910 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ksn9k_75f2ae27-0de0-43d5-8e7e-8730d5c98065/main/0.log" Jul 10 16:39:51.781650 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:39:51.781623 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jbcx8_60777672-368b-4ff2-9d56-3caa79dc6d75/main/0.log" Jul 10 16:40:00.047517 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:00.047485 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t8nbw_f088c170-6610-4e41-ad7c-0857e37b85c4/global-pull-secret-syncer/0.log" Jul 10 16:40:00.212092 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:00.212066 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cqntp_1ad63bd1-5947-49fb-9c85-94014575e90a/konnectivity-agent/0.log" Jul 10 16:40:00.260758 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:00.260732 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-133.ec2.internal_53237d582513d117bd08a5146cf4f447/haproxy/0.log" Jul 10 16:40:05.402351 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:05.402237 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d4df45c74-ckrps_033da1b0-894b-48ef-8fc2-ce1b84f713b3/authorino/0.log" Jul 10 16:40:07.404632 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.404604 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59c62ede-c192-4010-b54f-051f36b7216c/alertmanager/0.log" Jul 10 16:40:07.426499 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.426474 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59c62ede-c192-4010-b54f-051f36b7216c/config-reloader/0.log" Jul 10 16:40:07.448755 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.448730 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59c62ede-c192-4010-b54f-051f36b7216c/kube-rbac-proxy-web/0.log" Jul 10 16:40:07.470669 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.470593 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59c62ede-c192-4010-b54f-051f36b7216c/kube-rbac-proxy/0.log" Jul 10 16:40:07.491873 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.491851 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59c62ede-c192-4010-b54f-051f36b7216c/kube-rbac-proxy-metric/0.log" Jul 10 16:40:07.514358 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.514331 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59c62ede-c192-4010-b54f-051f36b7216c/prom-label-proxy/0.log" Jul 10 16:40:07.536642 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.536616 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59c62ede-c192-4010-b54f-051f36b7216c/init-config-reloader/0.log" Jul 10 16:40:07.620030 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.619997 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-7jnsl_5d212765-ebf1-4605-a6f0-9ca9fc7520d8/kube-state-metrics/0.log" Jul 10 16:40:07.642837 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.642814 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-7jnsl_5d212765-ebf1-4605-a6f0-9ca9fc7520d8/kube-rbac-proxy-main/0.log" Jul 10 16:40:07.665157 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.665129 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-7jnsl_5d212765-ebf1-4605-a6f0-9ca9fc7520d8/kube-rbac-proxy-self/0.log" Jul 10 16:40:07.691760 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.691728 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-dcc847c66-pqmpp_9dd8ee42-c218-4230-862c-1b52c53f28b0/metrics-server/0.log" Jul 10 16:40:07.726110 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.726034 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-h52gh_a54a2baa-3029-492e-a879-a47aa1de5658/monitoring-plugin/0.log" Jul 10 16:40:07.758712 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.758684 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8pdzg_67e7aaa8-c68d-41ff-bbfa-7b1349f84f82/node-exporter/0.log" Jul 10 16:40:07.784693 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.784663 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8pdzg_67e7aaa8-c68d-41ff-bbfa-7b1349f84f82/kube-rbac-proxy/0.log" Jul 10 16:40:07.806325 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.806303 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8pdzg_67e7aaa8-c68d-41ff-bbfa-7b1349f84f82/init-textfile/0.log" Jul 10 16:40:07.997034 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:07.996917 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fc8ws_1cf47c89-b329-4772-a08a-c6bc9313f659/kube-rbac-proxy-main/0.log" Jul 10 16:40:08.020488 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.020459 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fc8ws_1cf47c89-b329-4772-a08a-c6bc9313f659/kube-rbac-proxy-self/0.log" Jul 10 16:40:08.042876 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.042838 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fc8ws_1cf47c89-b329-4772-a08a-c6bc9313f659/openshift-state-metrics/0.log" Jul 10 16:40:08.105039 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.105016 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_551c40eb-bcf8-4f63-8732-07b68b0d5032/prometheus/0.log" Jul 10 16:40:08.133976 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.133950 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_551c40eb-bcf8-4f63-8732-07b68b0d5032/config-reloader/0.log" Jul 10 16:40:08.156206 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.156178 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_551c40eb-bcf8-4f63-8732-07b68b0d5032/thanos-sidecar/0.log" Jul 10 16:40:08.177659 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.177635 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_551c40eb-bcf8-4f63-8732-07b68b0d5032/kube-rbac-proxy-web/0.log" Jul 10 16:40:08.200944 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.200908 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_551c40eb-bcf8-4f63-8732-07b68b0d5032/kube-rbac-proxy/0.log" Jul 10 16:40:08.221957 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.221920 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_551c40eb-bcf8-4f63-8732-07b68b0d5032/kube-rbac-proxy-thanos/0.log" Jul 10 16:40:08.243247 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.243227 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_551c40eb-bcf8-4f63-8732-07b68b0d5032/init-config-reloader/0.log" Jul 10 16:40:08.271555 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.271484 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-9bl7k_bc314e7a-a06d-49d1-aa96-01ee327b510b/prometheus-operator/0.log" Jul 10 16:40:08.290631 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.290609 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-9bl7k_bc314e7a-a06d-49d1-aa96-01ee327b510b/kube-rbac-proxy/0.log" Jul 10 16:40:08.315611 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.315578 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-bjpfh_f5290af6-7b8b-4fa4-9627-0aab1b6d1e6c/prometheus-operator-admission-webhook/0.log" Jul 10 16:40:08.341949 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.341903 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d656fdcdf-ggf4n_08313b1b-d0a8-4a81-af88-a655054fc26f/telemeter-client/0.log" Jul 10 16:40:08.371393 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.371365 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d656fdcdf-ggf4n_08313b1b-d0a8-4a81-af88-a655054fc26f/reload/0.log" Jul 10 16:40:08.388687 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.388662 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d656fdcdf-ggf4n_08313b1b-d0a8-4a81-af88-a655054fc26f/kube-rbac-proxy/0.log" Jul 10 16:40:08.420053 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.420028 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db7bd667-8t4p7_3cd1188a-4ea6-458f-bd4e-8d721792e486/thanos-query/0.log" Jul 10 16:40:08.442136 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.442110 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db7bd667-8t4p7_3cd1188a-4ea6-458f-bd4e-8d721792e486/kube-rbac-proxy-web/0.log" Jul 10 16:40:08.463920 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.463898 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db7bd667-8t4p7_3cd1188a-4ea6-458f-bd4e-8d721792e486/kube-rbac-proxy/0.log" Jul 10 16:40:08.490026 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.489996 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db7bd667-8t4p7_3cd1188a-4ea6-458f-bd4e-8d721792e486/prom-label-proxy/0.log" Jul 10 16:40:08.511054 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.511023 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db7bd667-8t4p7_3cd1188a-4ea6-458f-bd4e-8d721792e486/kube-rbac-proxy-rules/0.log" Jul 10 16:40:08.531182 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:08.531115 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db7bd667-8t4p7_3cd1188a-4ea6-458f-bd4e-8d721792e486/kube-rbac-proxy-metrics/0.log" Jul 10 16:40:09.978361 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:09.978326 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls"] Jul 10 16:40:09.978786 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:09.978772 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70566345-d924-4fab-adc8-afe35654b4f0" containerName="maas-api" Jul 10 16:40:09.978830 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:09.978787 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="70566345-d924-4fab-adc8-afe35654b4f0" containerName="maas-api" Jul 10 16:40:09.978879 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:09.978870 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="70566345-d924-4fab-adc8-afe35654b4f0" containerName="maas-api" Jul 10 16:40:09.984186 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:09.984165 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:09.987040 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:09.987019 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lf2rd\"/\"openshift-service-ca.crt\"" Jul 10 16:40:09.987176 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:09.987096 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lf2rd\"/\"kube-root-ca.crt\"" Jul 10 16:40:09.988329 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:09.988306 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lf2rd\"/\"default-dockercfg-tt42s\"" Jul 10 16:40:09.991563 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:09.991542 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls"] Jul 10 16:40:10.065064 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.065026 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-lib-modules\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.065064 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.065061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-podres\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.065329 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.065088 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-sys\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.065329 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.065168 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-proc\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.065329 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.065279 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzx7w\" (UniqueName: \"kubernetes.io/projected/1c499cbb-d2ae-4be7-9f14-969d6901ed92-kube-api-access-hzx7w\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.165940 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.165903 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-sys\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.166109 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.165968 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-proc\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.166109 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.166059 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzx7w\" (UniqueName: \"kubernetes.io/projected/1c499cbb-d2ae-4be7-9f14-969d6901ed92-kube-api-access-hzx7w\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.166109 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.166057 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-sys\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.166109 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.166093 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-proc\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.166266 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.166096 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-lib-modules\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.166266 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.166154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-podres\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.166266 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.166194 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-lib-modules\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.166368 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.166265 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c499cbb-d2ae-4be7-9f14-969d6901ed92-podres\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.174244 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.174222 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzx7w\" (UniqueName: \"kubernetes.io/projected/1c499cbb-d2ae-4be7-9f14-969d6901ed92-kube-api-access-hzx7w\") pod \"perf-node-gather-daemonset-cp4ls\" (UID: \"1c499cbb-d2ae-4be7-9f14-969d6901ed92\") " pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.295978 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.295875 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.426520 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.426490 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls"] Jul 10 16:40:10.428884 ip-10-0-135-133 kubenswrapper[2582]: W0710 16:40:10.428860 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c499cbb_d2ae_4be7_9f14_969d6901ed92.slice/crio-b173df4b58882a79fd23bba258bee75c786cadb71b88d92224422cc211ef4aaa WatchSource:0}: Error finding container b173df4b58882a79fd23bba258bee75c786cadb71b88d92224422cc211ef4aaa: Status 404 returned error can't find the container with id b173df4b58882a79fd23bba258bee75c786cadb71b88d92224422cc211ef4aaa Jul 10 16:40:10.580794 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.580770 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" event={"ID":"1c499cbb-d2ae-4be7-9f14-969d6901ed92","Type":"ContainerStarted","Data":"21a774b3fdc1d89ac4e3d46dfdbab07e3d7f08304d2a69cf241f402ce8560e4a"} Jul 10 16:40:10.580895 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.580824 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" event={"ID":"1c499cbb-d2ae-4be7-9f14-969d6901ed92","Type":"ContainerStarted","Data":"b173df4b58882a79fd23bba258bee75c786cadb71b88d92224422cc211ef4aaa"} Jul 10 16:40:10.580975 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.580904 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:10.597870 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.597828 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" podStartSLOduration=1.5978147059999999 podStartE2EDuration="1.597814706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:40:10.596146235 +0000 UTC m=+2686.143835571" watchObservedRunningTime="2026-07-10 16:40:10.597814706 +0000 UTC m=+2686.145504016" Jul 10 16:40:10.854791 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.854697 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7465488669-htcgx_7c8a6a0b-080d-492b-8ae9-aa3d52eca924/console/0.log" Jul 10 16:40:10.890659 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:10.890620 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-bd8gn_a74f3da0-f8dd-48ef-9e6b-f6208b2933f5/download-server/0.log" Jul 10 16:40:12.556040 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:12.555998 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5wfj_62349f0c-8a86-41ff-b791-a3b2e0279717/dns/0.log" Jul 10 16:40:12.581178 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:12.581153 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5wfj_62349f0c-8a86-41ff-b791-a3b2e0279717/kube-rbac-proxy/0.log" Jul 10 16:40:12.634207 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:12.634181 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hh9vx_c808ae90-63ce-47cd-9895-1b478aa0d6de/dns-node-resolver/0.log" Jul 10 16:40:13.194622 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:13.194583 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2m2th_6a280651-376b-4c63-84d9-190f0e77719c/node-ca/0.log" Jul 10 16:40:14.270835 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:14.270794 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b74489749-phr4r_fc240166-f20a-40d7-bfdf-cdc8ffda89d5/kube-auth-proxy/0.log" Jul 10 16:40:14.401064 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:14.401024 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-n55wg_334a0321-f565-4352-b99e-49b703e4c067/payload-pre-processing/0.log" Jul 10 16:40:15.151331 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:15.151284 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gtxc4_bcc40706-c6bc-4739-8b1f-bc1438b91219/serve-healthcheck-canary/0.log" Jul 10 16:40:15.747118 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:15.747088 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ghdxd_38fe9a80-c896-4e1e-8f8c-b25ebdfe967c/kube-rbac-proxy/0.log" Jul 10 16:40:15.768909 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:15.768884 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ghdxd_38fe9a80-c896-4e1e-8f8c-b25ebdfe967c/exporter/0.log" Jul 10 16:40:15.790123 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:15.790096 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ghdxd_38fe9a80-c896-4e1e-8f8c-b25ebdfe967c/extractor/0.log" Jul 10 16:40:16.595469 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:16.595444 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lf2rd/perf-node-gather-daemonset-cp4ls" Jul 10 16:40:18.212852 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:18.212820 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6998bfc557-xgpmv_49f070d0-c4ed-45af-a32b-5809739b5d48/manager/0.log" Jul 10 16:40:18.487705 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:18.487613 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-765dfd8876-r448f_35070e4f-e5f0-4477-a6e3-db86de17dc30/manager/0.log" Jul 10 16:40:18.538703 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:18.538681 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-765dfd8876-r448f_35070e4f-e5f0-4477-a6e3-db86de17dc30/copy-manifests/0.log" Jul 10 16:40:19.987736 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:19.987710 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67b6bf9495-w7vbf_82583ea8-ad39-4b6d-8702-16722af26dd1/manager/0.log" Jul 10 16:40:20.013800 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:20.013775 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q44f7_06c112c2-128e-4cac-9822-84c0f898a2ad/openshift-lws-operator/0.log" Jul 10 16:40:20.647633 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:20.647596 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b74489749-phr4r_fc240166-f20a-40d7-bfdf-cdc8ffda89d5/kube-auth-proxy/0.log" Jul 10 16:40:20.755563 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:20.755505 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-n55wg_334a0321-f565-4352-b99e-49b703e4c067/payload-pre-processing/0.log" Jul 10 16:40:22.071018 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:22.070957 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b74489749-phr4r_fc240166-f20a-40d7-bfdf-cdc8ffda89d5/kube-auth-proxy/0.log" Jul 10 16:40:22.183902 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:22.183860 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-n55wg_334a0321-f565-4352-b99e-49b703e4c067/payload-pre-processing/0.log" Jul 10 16:40:26.476874 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:26.476847 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25qj9_73c352b8-b4e1-4dcd-966e-54894064139f/kube-multus-additional-cni-plugins/0.log" Jul 10 16:40:26.497546 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:26.497523 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25qj9_73c352b8-b4e1-4dcd-966e-54894064139f/egress-router-binary-copy/0.log" Jul 10 16:40:26.517718 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:26.517698 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25qj9_73c352b8-b4e1-4dcd-966e-54894064139f/cni-plugins/0.log" Jul 10 16:40:26.539681 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:26.539662 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25qj9_73c352b8-b4e1-4dcd-966e-54894064139f/bond-cni-plugin/0.log" Jul 10 16:40:26.563103 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:26.563085 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25qj9_73c352b8-b4e1-4dcd-966e-54894064139f/routeoverride-cni/0.log" Jul 10 16:40:26.588530 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:26.588503 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25qj9_73c352b8-b4e1-4dcd-966e-54894064139f/whereabouts-cni-bincopy/0.log" Jul 10 16:40:26.630487 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:26.630465 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25qj9_73c352b8-b4e1-4dcd-966e-54894064139f/whereabouts-cni/0.log" Jul 10 16:40:27.235545 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:27.235519 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s2xvp_a8883484-f14a-4e4f-993e-db59ef228b7f/kube-multus/0.log" Jul 10 16:40:27.318468 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:27.318432 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-57mkr_2814d1a1-a841-4022-b291-c7d78607bdfa/network-metrics-daemon/0.log" Jul 10 16:40:27.350955 ip-10-0-135-133 kubenswrapper[2582]: I0710 16:40:27.350918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-57mkr_2814d1a1-a841-4022-b291-c7d78607bdfa/kube-rbac-proxy/0.log"